Skip to content

Graphorin API reference v0.7.0


Graphorin API reference / @graphorin/evals / / pairedPassSignificance

Function: pairedPassSignificance()

ts
function pairedPassSignificance(current, baseline): PairedSignificance;

Defined in: packages/evals/src/stats.ts:146

McNemar's paired test on per-case pass outcomes of two eval runs. Only cases present in both maps are compared (by base case id).

Parameters

ParameterType
currentReadonlyMap<string, boolean>
baselineReadonlyMap<string, boolean>

Returns

PairedSignificance

Stable