Graphorin API reference v0.15.1
Graphorin API reference / @graphorin/core / / Provider
Interface: Provider
Defined in: packages/core/src/contracts/provider.ts:18
Stable
Vendor-neutral LLM provider interface. Concrete adapters live in @graphorin/provider (and companion packages such as @graphorin/provider-llamacpp-node).
Every provider exposes a name (used in spans / logs), the modelId it wraps, a static capabilities descriptor, and the two streaming / one-shot generation methods.
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
acceptsSensitivity? | readonly | readonly Sensitivity[] | Sensitivity tiers this provider is allowed to receive. Used by the ContextEngine sensitivity filter and the outbound redaction middleware to decide what content is safe to forward. | packages/core/src/contracts/provider.ts:37 |
capabilities | readonly | ProviderCapabilities | - | packages/core/src/contracts/provider.ts:21 |
modelId | readonly | string | - | packages/core/src/contracts/provider.ts:20 |
name | readonly | string | - | packages/core/src/contracts/provider.ts:19 |
Methods
countTokens()?
optional countTokens(req): Promise<number>;Defined in: packages/core/src/contracts/provider.ts:30
Optional: provider-native input token counter.
Parameters
| Parameter | Type |
|---|---|
req | ProviderRequest |
Returns
Promise<number>
generate()
generate(req): Promise<ProviderResponse>;Defined in: packages/core/src/contracts/provider.ts:27
Convenience wrapper that consumes the stream into a single result.
Parameters
| Parameter | Type |
|---|---|
req | ProviderRequest |
Returns
Promise<ProviderResponse>
stream()
stream(req): AsyncIterable<ProviderEvent>;Defined in: packages/core/src/contracts/provider.ts:24
Returns an async stream of fine-grained provider events.
Parameters
| Parameter | Type |
|---|---|
req | ProviderRequest |
Returns
AsyncIterable<ProviderEvent>