Graphorin API reference v0.4.0
Graphorin API reference / @graphorin/evals / / loadLongMemEvalDataset
Function: loadLongMemEvalDataset()
ts
function loadLongMemEvalDataset(options): Promise<Dataset<MemoryEvalInput, string, Readonly<Record<string, unknown>>>>;Defined in: evals/src/loaders/longmemeval.ts:61
Read a LongMemEval JSON file and return a fully-materialised Dataset of MemoryEvalInput cases scored against the reference answer string.
Parameters
| Parameter | Type |
|---|---|
options | LoadLongMemEvalOptions |
Returns
Promise<Dataset<MemoryEvalInput, string, Readonly<Record<string, unknown>>>>