Skip to main content
Base URL: https://simlab-api.collinear.ai

​
Launch Runs

Start a batch of rollouts (agent evaluation runs) for one or more tasks. 
POST /runs
Request body: 
{
  "scenario_id": "hr_recruiting",
  "task_ids": ["hr-102", "hr-103"],
  "rollout_count": 3,
  "model_config": {
    "model": "gpt-4o",
    "provider": "openai",
    "max_steps": 20
  },
  "task_overrides": {
    "hr-102": {
      "name": "Custom task name",
      "description": "Custom description",
      "rubric_markdown": "# Custom rubric..."
    }
  }
}
FieldTypeRequiredDescription
scenario_idstringYesScenario to run against
task_idslist[string]YesTasks to evaluate
rollout_countintNoNumber of rollouts per task (default: 1)
model_configobjectNoModel, provider, and step limit
task_overridesobjectNoPer-task overrides for name, description, or rubric
Response: 200 OK 
{
  "run_id": "run_abc123",
  "rollouts": [
    {
      "rollout_id": "rol_001",
      "task_id": "hr-102",
      "status": "queued"
    }
  ]
}