Skip to content

Graphorin API reference v0.4.0


Graphorin API reference / @graphorin/evals / / loadLongMemEvalDataset

Function: loadLongMemEvalDataset()

ts
function loadLongMemEvalDataset(options): Promise<Dataset<MemoryEvalInput, string, Readonly<Record<string, unknown>>>>;

Defined in: evals/src/loaders/longmemeval.ts:61

Read a LongMemEval JSON file and return a fully-materialised Dataset of MemoryEvalInput cases scored against the reference answer string.

Parameters

ParameterType
optionsLoadLongMemEvalOptions

Returns

Promise<Dataset<MemoryEvalInput, string, Readonly<Record&lt;string, unknown&gt;>>>

Stable