VerifierResult.
VerifierResult
result field on rollout responses contains the serialized verifier output:
Rubric Judge
For rubric-based evaluation, theRubricJudgeResult provides structured scoring:
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Output format from verifier evaluation
VerifierResult.
class VerifierResult:
success: bool # Whether the task was completed successfully
message: str # Human-readable explanation
output: str # Additional detail (defaults to message if empty)
result field on rollout responses contains the serialized verifier output:
{
"success": true,
"message": "All criteria met"
}
RubricJudgeResult provides structured scoring:
| Field | Type | Description |
|---|---|---|
score | float | Score from 0.0 to 1.0 |
verdict | string | "PASS" or "FAIL" |
confidence | float | Confidence in the verdict (0.0–1.0) |
evidence | list[string] | Bullet points with concrete evidence |
failed_criteria | list[string] | Unmet rubric criteria |
dimension_scores | list[object] | Per-dimension breakdowns: { "dimension": str, "score": float, "reason": str } |
error | string | Error message if evaluation failed |
Was this page helpful?
