Skip to content

Graphorin API reference v0.1.0


Graphorin API reference / @graphorin/provider / adapters/llamacpp-server / LlamaCppServerAdapterOptions

Interface: LlamaCppServerAdapterOptions

Defined in: packages/provider/src/adapters/llamacpp-server.ts:31

Options accepted by llamaCppServerAdapter.

Stable

Properties

PropertyModifierTypeDescriptionDefined in
acceptsSensitivity?readonlyreadonly Sensitivity[]Override for the default acceptsSensitivity value.packages/provider/src/adapters/llamacpp-server.ts:49
allowInsecureTransport?readonlybooleanAcknowledge the risk of running over plaintext HTTP against a public host. Without this flag the adapter throws import('../errors/errors.js').LocalProviderInsecureTransportError.packages/provider/src/adapters/llamacpp-server.ts:47
apiKey?readonlystringOptional bearer-auth API key (--api-key flag on the server).packages/provider/src/adapters/llamacpp-server.ts:37
baseUrl?readonlystringBase URL of the running llama-server process. Defaults to http://127.0.0.1:8080.packages/provider/src/adapters/llamacpp-server.ts:35
fetchImpl?readonly(input, init?) => Promise<Response>Custom fetch implementation; useful for tests.packages/provider/src/adapters/llamacpp-server.ts:41
headers?readonlyReadonly<Record&lt;string, string&gt;>Extra headers merged on top of content-type + accept defaults.packages/provider/src/adapters/llamacpp-server.ts:39
logger?readonly(level, message, meta?) => voidOptional log sink. Tests pass a fixture sink to silence the console.packages/provider/src/adapters/llamacpp-server.ts:53
modelreadonlystringGGUF model identifier exposed by the running server (e.g. 'qwen2.5:7b-instruct-q4_k_m').packages/provider/src/adapters/llamacpp-server.ts:33
name?readonlystringProvider name attached to spans / log lines.packages/provider/src/adapters/llamacpp-server.ts:51