Skip to content

Graphorin API reference v0.4.0


Graphorin API reference / @graphorin/evals / / RunOptions

Interface: RunOptions<I, O>

Defined in: evals/src/types.ts:40

Options accepted by the parallel runner.

Stable

Type Parameters

Type Parameter
I
O

Properties

PropertyModifierTypeDescriptionDefined in
agentreadonlyAgentLike<I, O>-evals/src/types.ts:41
concurrency?readonlynumberDefault 1 (sequential). Set higher for parallel evaluation.evals/src/types.ts:54
datasetreadonly{ cases: readonly { expected?: O; id?: string; input: I; metadata?: Readonly<Record&lt;string, unknown&gt;>; }[]; }-evals/src/types.ts:42
dataset.casesreadonlyreadonly { expected?: O; id?: string; input: I; metadata?: Readonly<Record&lt;string, unknown&gt;>; }[]-evals/src/types.ts:43
iterations?readonlynumberDefault 1.evals/src/types.ts:52
onProgress?readonly(event) => voidOptional progress hook invoked after every case. Useful for terminal reporters that want a per-case heartbeat.evals/src/types.ts:60
scorersreadonlyreadonly Scorer&lt;I, O&gt;[]-evals/src/types.ts:50
signal?readonlyAbortSignal-evals/src/types.ts:55