Graphorin API reference v0.15.1
Graphorin API reference / @graphorin/provider-llamacpp-node / / LlamaInstance
Interface: LlamaInstance
Defined in: src/runtime.ts:14
Internal
Llama engine instance (returned by getLlama()).
Methods
loadModel()
ts
loadModel(args): Promise<LlamaModelInstance>;Defined in: src/runtime.ts:15
Parameters
| Parameter | Type |
|---|---|
args | { gpuLayers?: number | "auto"; modelPath: string; } |
args.gpuLayers? | number | "auto" |
args.modelPath | string |
Returns
Promise<LlamaModelInstance>