Graphorin API reference v0.7.0
Graphorin API reference / @graphorin/evals / / LlmJudgeOptions
Interface: LlmJudgeOptions<I, O>
Defined in: packages/evals/src/scorers/llm/judge.ts:28
Stable
Type Parameters
| Type Parameter |
|---|
I |
O |
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
buildPrompt? | readonly | (input) => { system: string; user: string; } | Override the scoring prompt. The default is English. | packages/evals/src/scorers/llm/judge.ts:41 |
maxOutputTokens? | readonly | number | Default 16 (headroom for the SCORE: <n> line). | packages/evals/src/scorers/llm/judge.ts:39 |
maxScore? | readonly | number | Default 10. | packages/evals/src/scorers/llm/judge.ts:33 |
name? | readonly | string | Optional name override. Default 'llm-judge'. | packages/evals/src/scorers/llm/judge.ts:31 |
passThreshold? | readonly | number | Pass threshold (raw score). Default Math.ceil(maxScore * 0.7). | packages/evals/src/scorers/llm/judge.ts:35 |
provider | readonly | Provider | - | packages/evals/src/scorers/llm/judge.ts:29 |
temperature? | readonly | number | Default 0 for deterministic grading. | packages/evals/src/scorers/llm/judge.ts:37 |