Graphorin API reference v0.15.1
Graphorin API reference / @graphorin/evals / / memoryPointTokens
Function: memoryPointTokens()
ts
function memoryPointTokens(text): readonly string[];Defined in: packages/evals/src/scorers/memory/util.ts:25
Stable
Lowercase, strip punctuation to spaces, collapse whitespace and split into tokens.
Parameters
| Parameter | Type |
|---|---|
text | string |
Returns
readonly string[]