Graphorin API reference v0.1.0

---

Graphorin API reference / @graphorin/provider / adapters/llamacpp-server / llamaCppServerAdapter

Function: llamaCppServerAdapter()

function llamaCppServerAdapter(options): Provider;

Defined in: packages/provider/src/adapters/llamacpp-server.ts:74

Build a Graphorin Provider backed by the upstream llama-server binary. The factory does not start the binary — operators launch it themselves with the desired model + GPU flags and pass the URL here.

Parameters

Parameter	Type
options	LlamaCppServerAdapterOptions

Returns

Provider

Example

const local = createProvider(
  llamaCppServerAdapter({
    model: 'qwen2.5:7b-instruct-q4_k_m',
    baseUrl: 'http://127.0.0.1:8080',
  }),
);

Stable