Skip to content

Graphorin API reference v0.1.0


Graphorin API reference / @graphorin/core / / Provider

Interface: Provider

Defined in: packages/core/src/contracts/provider.ts:17

Vendor-neutral LLM provider interface. Concrete adapters live in @graphorin/provider (and companion packages such as @graphorin/provider-llamacpp-node).

Every provider exposes a name (used in spans / logs), the modelId it wraps, a static capabilities descriptor, and the two streaming / one-shot generation methods.

Stable

Properties

PropertyModifierTypeDescriptionDefined in
acceptsSensitivity?readonlyreadonly Sensitivity[]Sensitivity tiers this provider is allowed to receive. Used by the ContextEngine sensitivity filter (D2) and the outbound redaction middleware (D3) to decide what content is safe to forward.packages/core/src/contracts/provider.ts:36
capabilitiesreadonlyProviderCapabilities-packages/core/src/contracts/provider.ts:20
modelIdreadonlystring-packages/core/src/contracts/provider.ts:19
namereadonlystring-packages/core/src/contracts/provider.ts:18

Methods

countTokens()?

ts
optional countTokens(req): Promise<number>;

Defined in: packages/core/src/contracts/provider.ts:29

Optional: provider-native input token counter.

Parameters

ParameterType
reqProviderRequest

Returns

Promise&lt;number&gt;


generate()

ts
generate(req): Promise<ProviderResponse>;

Defined in: packages/core/src/contracts/provider.ts:26

Convenience wrapper that consumes the stream into a single result.

Parameters

ParameterType
reqProviderRequest

Returns

Promise&lt;ProviderResponse&gt;


stream()

ts
stream(req): AsyncIterable<ProviderEvent>;

Defined in: packages/core/src/contracts/provider.ts:23

Returns an async stream of fine-grained provider events.

Parameters

ParameterType
reqProviderRequest

Returns

AsyncIterable&lt;ProviderEvent&gt;