Skip to content

Graphorin API reference v0.1.0


Graphorin API reference / @graphorin/provider-llamacpp-node / LlamaCppNodeRuntimeOverrides

Interface: LlamaCppNodeRuntimeOverrides

Defined in: runtime.ts:54

Test-only shape for injecting fixture-driven runtime behaviour.

Stable

Properties

PropertyModifierTypeDescriptionDefined in
createSession?readonly(model, system?) => Promise<LlamaSessionInstance>Build a streaming chat session against an already-loaded model instance. Used by the adapter to wire model.tokenize and session.promptStreamingResponse to the per-test fixture.runtime.ts:62
getLlama?readonly() => Promise<LlamaInstance>Returns a LlamaInstance (the result of getLlama()).runtime.ts:56