Graphorin API reference v0.12.1
Graphorin API reference / @graphorin/provider / / JsTiktokenCounter
Class: JsTiktokenCounter
Defined in: packages/provider/src/counters/js-tiktoken.ts:75
Counter that delegates to the js-tiktoken package. Caches the dynamically-loaded module per process; tests use moduleOverride to supply a fixture-shaped substitute.
Stable
Implements
Constructors
Constructor
ts
new JsTiktokenCounter(options?): JsTiktokenCounter;Defined in: packages/provider/src/counters/js-tiktoken.ts:83
Parameters
| Parameter | Type |
|---|---|
options | JsTiktokenCounterOptions |
Returns
JsTiktokenCounter
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
id | readonly | string | Human-readable identifier ('js-tiktoken@cl100k_base', …). | packages/provider/src/counters/js-tiktoken.ts:76 |
version | readonly | string | Tokenizer version string used for cache invalidation. | packages/provider/src/counters/js-tiktoken.ts:77 |
Methods
count()
ts
count(messages): Promise<number>;Defined in: packages/provider/src/counters/js-tiktoken.ts:91
Count tokens in a list of Messages (system/user/assistant/tool).
Parameters
| Parameter | Type |
|---|---|
messages | readonly Message[] |
Returns
Promise<number>
Implementation of
countText()
ts
countText(text): Promise<number>;Defined in: packages/provider/src/counters/js-tiktoken.ts:101
Count tokens in a raw text string.
Parameters
| Parameter | Type |
|---|---|
text | string |
Returns
Promise<number>