POST
/
api
/
v1
/
judge
/
curator
curl --request POST \
  --url https://api.collinear.ai/api/v1/judge/curator \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "conv_prefix": [
    {
      "role": "<string>",
      "content": "<string>"
    }
  ],
  "response": {
    "role": "<string>",
    "content": "<string>"
  },
  "instruction_following": true,
  "quality_of_reasoning": true,
  "coherence": true,
  "instruction_complexity": true
}'
{
  "instruction_following": 123,
  "quality_of_reasoning": 123,
  "coherence": 123,
  "instruction_complexity": 123
}

​
Parameters

  • conv_prefix: This is the conversation prefix in OpenAI format. It should be a list of dictionaries with keys role and content.

  • response: This is the response from the model. It should be in OpenAI format.

  • instruction_following: A boolean indicating whether the response follows the given instructions.

  • quality_of_reasoning: A boolean indicating the quality of reasoning in the response.

  • coherence: A boolean indicating whether the response is coherent.

  • instruction_complexity: A boolean indicating the complexity of the instruction given.

​
Response

The response will be a JSON object with the following fields:

  • instruction_following: A float value representing how well the response follows the given instructions.
  • quality_of_reasoning: A float value representing the quality of reasoning in the response.
  • coherence: A float value representing how coherent the response is.
  • instruction_complexity: A float value representing the complexity of the instruction given.

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
​
conv_prefix
object[]
required
​
response
object
required
​
instruction_following
boolean
​
quality_of_reasoning
boolean
​
coherence
boolean
​
instruction_complexity
boolean

Response

200
application/json
Successful Response
​
instruction_following
number
​
quality_of_reasoning
number
​
coherence
number
​
instruction_complexity
number

Was this page helpful?

Suggest editsRaise issue