Graphorin API reference v0.4.0
Graphorin API reference / @graphorin/evals / / RunOptions
Interface: RunOptions<I, O>
Defined in: evals/src/types.ts:40
Options accepted by the parallel runner.
Stable
Type Parameters
| Type Parameter |
|---|
I |
O |
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
agent | readonly | AgentLike<I, O> | - | evals/src/types.ts:41 |
concurrency? | readonly | number | Default 1 (sequential). Set higher for parallel evaluation. | evals/src/types.ts:54 |
dataset | readonly | { cases: readonly { expected?: O; id?: string; input: I; metadata?: Readonly<Record<string, unknown>>; }[]; } | - | evals/src/types.ts:42 |
dataset.cases | readonly | readonly { expected?: O; id?: string; input: I; metadata?: Readonly<Record<string, unknown>>; }[] | - | evals/src/types.ts:43 |
iterations? | readonly | number | Default 1. | evals/src/types.ts:52 |
onProgress? | readonly | (event) => void | Optional progress hook invoked after every case. Useful for terminal reporters that want a per-case heartbeat. | evals/src/types.ts:60 |
scorers | readonly | readonly Scorer<I, O>[] | - | evals/src/types.ts:50 |
signal? | readonly | AbortSignal | - | evals/src/types.ts:55 |