Skip to content

Graphorin API reference v0.7.0


Graphorin API reference / @graphorin/evals / / passHatK

Function: passHatK()

ts
function passHatK(outcomes): {
  baseCases: number;
  k: number;
  value: number;
};

Defined in: packages/evals/src/stats.ts:99

pass^k over per-iteration case outcomes: group by base case id and report the fraction of base cases whose EVERY iteration passed.

Parameters

ParameterTypeDescription
outcomesreadonly { caseId: string; pass: boolean; }[]one entry per executed case iteration

Returns

ts
{
  baseCases: number;
  k: number;
  value: number;
}

k = the largest group size observed, baseCases = number of distinct base cases, value = the pass^k fraction (0 when no cases)

NameTypeDefined in
baseCasesnumberpackages/evals/src/stats.ts:101
knumberpackages/evals/src/stats.ts:101
valuenumberpackages/evals/src/stats.ts:101

Stable