Graphorin API reference v0.15.1

---

Graphorin API reference / @graphorin/provider-llamacpp-node / / LlamaCppNativeCounter

Class: LlamaCppNativeCounter

Defined in: src/counter.ts:34

Stable

Counter that delegates to model.tokenize(text) from the loaded GGUF instance. Cache invalidation is keyed on the model file path (when supplied) so swapping models invalidates per-message caches upstream.

Implements

• TokenCounter

Constructors

Constructor

new LlamaCppNativeCounter(options): LlamaCppNativeCounter;

Defined in: src/counter.ts:39

Parameters

Parameter	Type
options	LlamaCppNativeCounterOptions

Returns

LlamaCppNativeCounter

Properties

Property	Modifier	Type	Description	Defined in
id	readonly	string	Human-readable identifier ('js-tiktoken@cl100k_base', …).	src/counter.ts:35
version	readonly	string	Tokenizer version string used for cache invalidation.	src/counter.ts:36

Methods

count()

count(messages): Promise<number>;

Defined in: src/counter.ts:46

Count tokens in a list of Messages (system/user/assistant/tool).

Parameters

Parameter	Type
messages	readonly Message[]

Returns

Promise<number>

Implementation of

TokenCounter.count

---

countText()

countText(text): Promise<number>;

Defined in: src/counter.ts:55

Count tokens in a raw text string.

Parameters

Parameter	Type
text	string

Returns

Promise<number>

Implementation of

TokenCounter.countText