Skip to content

Graphorin API reference v0.1.0


Graphorin API reference / @graphorin/evals / / LlmJudgeOptions

Interface: LlmJudgeOptions<I, O>

Defined in: evals/src/scorers/llm/judge.ts:16

Stable

Type Parameters

Type Parameter
I
O

Properties

PropertyModifierTypeDescriptionDefined in
buildPrompt?readonly(input) => { system: string; user: string; }Override the scoring prompt. The default is English.evals/src/scorers/llm/judge.ts:29
maxOutputTokens?readonlynumberDefault 8.evals/src/scorers/llm/judge.ts:27
maxScore?readonlynumberDefault 10.evals/src/scorers/llm/judge.ts:21
name?readonlystringOptional name override. Default 'llm-judge'.evals/src/scorers/llm/judge.ts:19
passThreshold?readonlynumberPass threshold (raw score). Default Math.ceil(maxScore * 0.7).evals/src/scorers/llm/judge.ts:23
providerreadonlyProvider-evals/src/scorers/llm/judge.ts:17
temperature?readonlynumberDefault 0 for deterministic grading.evals/src/scorers/llm/judge.ts:25