Skip to content

Graphorin API reference v0.13.9


Graphorin API reference / @graphorin/evals / / goldTokenCoverage

Function: goldTokenCoverage()

ts
function goldTokenCoverage(gold, observed): number;

Defined in: packages/evals/src/scorers/memory/util.ts:131

Stable

Directional containment: the fraction of the gold point's CONTENT tokens (function words stripped) present in the observed text; 1 means every content-bearing gold token appears. Falls back to the full token set when stripping would leave nothing.

Deep-retest 0.13.7 P2: symmetric tokenF1 punishes verbosity

  • gold User is pescatarian against the semantically correct The user started eating fish again on 2026-01-20, so the user identifies as pescatarian. scores F1 0.235 and was graded missed
  • hallucinated + omitted at once; its gold coverage is 1.

Parameters

ParameterType
goldstring
observedstring

Returns

number