Graphorin API reference v0.15.1

---

Graphorin API reference / @graphorin/evals / / LlmJudgeOptions

Interface: LlmJudgeOptions<I, O>

Defined in: packages/evals/src/scorers/llm/judge.ts:71

Stable

Type Parameters

Type Parameter
I
O

Properties

Property	Modifier	Type	Description	Defined in
buildPrompt?	readonly	(input) => { system: string; user: string; }	Override the scoring prompt. The default is English.	packages/evals/src/scorers/llm/judge.ts:93
maxOutputTokens?	readonly	number	Default 16 (headroom for the SCORE: <n> line).	packages/evals/src/scorers/llm/judge.ts:82
maxScore?	readonly	number	Default 10.	packages/evals/src/scorers/llm/judge.ts:76
name?	readonly	string	Optional name override. Default 'llm-judge'.	packages/evals/src/scorers/llm/judge.ts:74
offFormatRetries?	readonly	number	How many constrained re-asks a missing SCORE: <n> marker earns before the scorer throws JudgeOffFormatError. Default 1. The retry re-sends the conversation with an explicit marker-only instruction and a raised output budget (reasoning models can burn a tight maxOutputTokens on hidden reasoning and return an empty visible reply). 0 restores single-shot fail-loud.	packages/evals/src/scorers/llm/judge.ts:91
passThreshold?	readonly	number	Pass threshold (raw score). Default Math.ceil(maxScore * 0.7).	packages/evals/src/scorers/llm/judge.ts:78
provider	readonly	Provider	-	packages/evals/src/scorers/llm/judge.ts:72
temperature?	readonly	number	Default 0 for deterministic grading.	packages/evals/src/scorers/llm/judge.ts:80