Skip to main content
POST
/
api
/
v1
/
judge
/
conversation
Fetch Judgement For Conversation
curl --request POST \
  --url https://api.collinear.ai/api/v1/judge/conversation \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "conversation_prefix": [
    {
      "role": "<string>",
      "content": "<string>"
    }
  ],
  "response": {
    "role": "<string>",
    "content": "<string>"
  },
  "space_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "judge_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
}
'
{
  "detail": [
    {
      "loc": [
        "<string>"
      ],
      "msg": "<string>",
      "type": "<string>"
    }
  ]
}

​
Overview

Use this endpoint to evaluate a response in the context of a conversation. The system uses a judge model (specified by judge_id) to assess the quality or appropriateness of the given response based on the prior conversation_prefix. This is useful for scoring, grading, or analyzing the helpfulness, accuracy, or tone of a response generated by an assistant. The endpoint is designed to work with a conversation format where the conversation_prefix contains prior turns and response is the assistant’s reply. The current deployment returns:
  • score: numeric grade (higher means more concerning for safety judges).
  • category: short label for the detected issue (may be null).
  • rationale: free-form explanation from the judge model.

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
​
conversation_prefix
ConversationMessageDTO · object[]
required
​
response
ConversationMessageDTO · object
required
​
space_id
string<uuid>
required
​
judge_id
string<uuid>
required

Response

Successful Response