Graphorin API reference v0.7.0
Graphorin API reference / @graphorin/provider / adapters/llamacpp-server / LlamaCppServerAdapterOptions
Interface: LlamaCppServerAdapterOptions
Defined in: packages/provider/src/adapters/llamacpp-server.ts:31
Options accepted by llamaCppServerAdapter.
Stable
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
acceptsSensitivity? | readonly | readonly Sensitivity[] | Override for the default acceptsSensitivity value. | packages/provider/src/adapters/llamacpp-server.ts:56 |
allowInsecureTransport? | readonly | boolean | Acknowledge the risk of running over plaintext HTTP against a public host. Without this flag the adapter throws LocalProviderInsecureTransportError. | packages/provider/src/adapters/llamacpp-server.ts:54 |
apiKey? | readonly | string | Optional bearer-auth API key (--api-key flag on the server). | packages/provider/src/adapters/llamacpp-server.ts:37 |
baseUrl? | readonly | string | Base URL of the running llama-server process. Defaults to http://127.0.0.1:8080. | packages/provider/src/adapters/llamacpp-server.ts:35 |
capabilities? | readonly | Partial<ProviderCapabilities> | Capability overrides merged on top of the adapter defaults. | packages/provider/src/adapters/llamacpp-server.ts:48 |
fetchImpl? | readonly | (input, init?) => Promise<Response> | Custom fetch implementation; useful for tests. | packages/provider/src/adapters/llamacpp-server.ts:41 |
headers? | readonly | Readonly<Record<string, string>> | Extra headers merged on top of content-type + accept defaults. | packages/provider/src/adapters/llamacpp-server.ts:39 |
logger? | readonly | (level, message, meta?) => void | Optional log sink. Tests pass a fixture sink to silence the console. | packages/provider/src/adapters/llamacpp-server.ts:60 |
model | readonly | string | GGUF model identifier exposed by the running server (e.g. 'qwen2.5:7b-instruct-q4_k_m'). | packages/provider/src/adapters/llamacpp-server.ts:33 |
name? | readonly | string | Provider name attached to spans / log lines. | packages/provider/src/adapters/llamacpp-server.ts:58 |
timeoutMs? | readonly | number | Time-to-response budget per request (PS-24). Default DEFAULT_REQUEST_TIMEOUT_MS (120s); 0 disables. | packages/provider/src/adapters/llamacpp-server.ts:46 |