Skip to content

Graphorin API reference v0.7.0


Graphorin API reference / @graphorin/evals / / LlmJudgeOptions

Interface: LlmJudgeOptions<I, O>

Defined in: packages/evals/src/scorers/llm/judge.ts:28

Stable

Type Parameters

Type Parameter
I
O

Properties

PropertyModifierTypeDescriptionDefined in
buildPrompt?readonly(input) => { system: string; user: string; }Override the scoring prompt. The default is English.packages/evals/src/scorers/llm/judge.ts:41
maxOutputTokens?readonlynumberDefault 16 (headroom for the SCORE: <n> line).packages/evals/src/scorers/llm/judge.ts:39
maxScore?readonlynumberDefault 10.packages/evals/src/scorers/llm/judge.ts:33
name?readonlystringOptional name override. Default 'llm-judge'.packages/evals/src/scorers/llm/judge.ts:31
passThreshold?readonlynumberPass threshold (raw score). Default Math.ceil(maxScore * 0.7).packages/evals/src/scorers/llm/judge.ts:35
providerreadonlyProvider-packages/evals/src/scorers/llm/judge.ts:29
temperature?readonlynumberDefault 0 for deterministic grading.packages/evals/src/scorers/llm/judge.ts:37