Graphorin API reference v0.1.0
Graphorin API reference / @graphorin/provider-llamacpp-node / LlamaSessionInstance
Interface: LlamaSessionInstance
Defined in: runtime.ts:38
Internal
Loaded chat session capable of streaming responses.
Methods
promptStreamingResponse()
ts
promptStreamingResponse(prompt, options?): AsyncIterable<string>;Defined in: runtime.ts:39
Parameters
| Parameter | Type |
|---|---|
prompt | string |
options? | { maxTokens?: number; signal?: AbortSignal; temperature?: number; } |
options.maxTokens? | number |
options.signal? | AbortSignal |
options.temperature? | number |
Returns
AsyncIterable<string>