Graphorin API reference v0.1.0
Graphorin API reference / @graphorin/evals / / LlmJudgeOptions
Interface: LlmJudgeOptions<I, O>
Defined in: evals/src/scorers/llm/judge.ts:16
Stable
Type Parameters
| Type Parameter |
|---|
I |
O |
Properties
| Property | Modifier | Type | Description | Defined in |
|---|---|---|---|---|
buildPrompt? | readonly | (input) => { system: string; user: string; } | Override the scoring prompt. The default is English. | evals/src/scorers/llm/judge.ts:29 |
maxOutputTokens? | readonly | number | Default 8. | evals/src/scorers/llm/judge.ts:27 |
maxScore? | readonly | number | Default 10. | evals/src/scorers/llm/judge.ts:21 |
name? | readonly | string | Optional name override. Default 'llm-judge'. | evals/src/scorers/llm/judge.ts:19 |
passThreshold? | readonly | number | Pass threshold (raw score). Default Math.ceil(maxScore * 0.7). | evals/src/scorers/llm/judge.ts:23 |
provider | readonly | Provider | - | evals/src/scorers/llm/judge.ts:17 |
temperature? | readonly | number | Default 0 for deterministic grading. | evals/src/scorers/llm/judge.ts:25 |