Graphorin API reference v0.15.1

---

Graphorin API reference / @graphorin/provider-llamacpp-node / / LlamaModelInstance

Interface: LlamaModelInstance

Defined in: src/runtime.ts:23

Internal

Loaded GGUF model.

Properties

Property	Modifier	Type	Defined in
trainContextSize?	readonly	number	src/runtime.ts:24

Methods

createContext()

createContext(args?): Promise<{
  dispose?: () => void;
  getSequence: {
     dispose?: () => void;
  };
}>;

Defined in: src/runtime.ts:26

Parameters

Parameter	Type
args?	{ contextSize?: number; }
args.contextSize?	number

Returns

Promise<{ dispose?: () => void; getSequence: { dispose?: () => void; }; }>

---

dispose()?

optional dispose(): Promise<void>;

Defined in: src/runtime.ts:30

Returns

Promise&lt;void&gt;

---

tokenize()

tokenize(text): 
  | Uint32Array<ArrayBufferLike>
  | Uint8Array<ArrayBufferLike>
  | readonly number[];

Defined in: src/runtime.ts:25

Parameters

Parameter	Type
text	string

Returns

| Uint32Array&lt;ArrayBufferLike&gt; | Uint8Array&lt;ArrayBufferLike&gt; | readonly number[]