Graphorin API reference v0.8.0
Graphorin API reference / @graphorin/evals / / MemoryOperationsEvalInput
Interface: MemoryOperationsEvalInput
Defined in: packages/evals/src/loaders/memory-eval.ts:123
Input handed to the memory system under test for one operation-level eval case. The gold labels ride the input (not Case.expected) so a single observation type can serve the extraction, update and QA stages.
Stable
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
ability? | readonly | MemoryEvalAbility | Mapped ability (MemoryEvalAbility); the raw category lives in metadata. | packages/evals/src/loaders/memory-eval.ts:137 |
askedAt? | readonly | string | When the question is asked; dataset-native string. | packages/evals/src/loaders/memory-eval.ts:135 |
goldPoints | readonly | readonly MemoryGoldPoint[] | Per-operation ground truth for this case. | packages/evals/src/loaders/memory-eval.ts:127 |
haystackSessions | readonly | readonly MemoryEvalSession[] | Sessions to ingest before memory is observed. | packages/evals/src/loaders/memory-eval.ts:125 |
question? | readonly | string | QA-stage probe question (absent on operations-stage cases). | packages/evals/src/loaders/memory-eval.ts:129 |
referenceAnswer? | readonly | string | Reference answer for the QA probe. | packages/evals/src/loaders/memory-eval.ts:131 |
unanswerable? | readonly | boolean | true when the correct QA behaviour is to abstain. | packages/evals/src/loaders/memory-eval.ts:133 |