Graphorin API reference / @graphorin/evals / / JUDGE_RETRY_MARKER

Variable: JUDGE_RETRY_MARKER

const JUDGE_RETRY_MARKER: "judge-retries:" = 'judge-retries:';

Defined in: packages/evals/src/scorers/llm/judge.ts:49

Stable

Stable machine-scannable token the scorer puts into the result reason (and metadata.judgeRetries) when the judge's FIRST reply was off-format and the constrained retry recovered a valid SCORE: <n> marker. A recovered grade is a real grade - the case still passes or fails on its score - but reports can now count the hidden retries (extra judge calls, extra cost) instead of presenting a recovered reply as a clean first response.

Variable: JUDGE_RETRY_MARKER ​

Variable: JUDGE_RETRY_MARKER