Graphorin API reference v0.1.0
Graphorin API reference / @graphorin/provider-llamacpp-node / LlamaCppNodeAdapterOptions
Interface: LlamaCppNodeAdapterOptions
Defined in: adapter.ts:45
Options accepted by llamaCppNodeAdapter.
Stable
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
acceptsSensitivity? | readonly | readonly Sensitivity[] | Sensitivity override (defaults to the loopback envelope). | adapter.ts:57 |
capabilities? | readonly | Partial<ProviderCapabilities> | Capability declaration. Merged on top of the defaults table. | adapter.ts:55 |
contextSize? | readonly | number | Optional context-window override. | adapter.ts:51 |
gpuLayers? | readonly | number | "auto" | Number of layers to offload to the GPU. Default 'auto'. | adapter.ts:49 |
modelOverride? | readonly | LlamaModelInstance | Optional model override that short-circuits the loadLlamaModule(...).loadModel(...) flow. Tests pass a fixture shaped instance. | adapter.ts:68 |
modelPath | readonly | string | Filesystem path to the .gguf model file. | adapter.ts:47 |
name? | readonly | string | Provider name attached to spans / log lines. | adapter.ts:53 |
runtimeOverrides? | readonly | LlamaCppNodeRuntimeOverrides | Test-only runtime override. When unset the adapter loads node-llama-cpp lazily on first call. | adapter.ts:62 |
sessionFactory? | readonly | (model, system?) => Promise<LlamaSessionInstance> | Optional session factory override. When unset, the adapter calls the runtime's createSession(...). | adapter.ts:73 |