Skip to content

Graphorin API reference v0.12.1


Graphorin API reference / @graphorin/provider-llamacpp-node / / LlamaCppNodeRuntimeOverrides

Interface: LlamaCppNodeRuntimeOverrides

Defined in: packages/provider-llamacpp-node/src/runtime.ts:81

Test-only shape for injecting fixture-driven runtime behaviour.

Stable

Properties

PropertyModifierTypeDescriptionDefined in
createSession?readonly(model, system?) => Promise<LlamaSessionInstance>Build a streaming chat session against an already-loaded model instance. Used by the adapter to wire model.tokenize and session.promptStreamingResponse to the per-test fixture.packages/provider-llamacpp-node/src/runtime.ts:89
getLlama?readonly() => Promise<LlamaInstance>Returns a LlamaInstance (the result of getLlama()).packages/provider-llamacpp-node/src/runtime.ts:83
LlamaChatSession?readonlyLlamaChatSessionCtorOverride the LlamaChatSession constructor used by the REAL default session factory (PS-3). Tests stub it; production loads it from the node-llama-cpp peer.packages/provider-llamacpp-node/src/runtime.ts:98