​

Introduction

Once you connect your model or upload your dataset, you can run a safety evaluation on it using a custom judge.

​

Steps to Create a Custom evaluation

​

Select Custom Evaluation

Click on Custom

​

Select a Judge

Select the Prompted Model option

Select an existing model or click the orange Add a New Model button if you want to add a new model

Edit the prompt template as needed

​

Enter Judge Name

Name your judge

​

Enter Description

Enter a short description of your judge and click “Confirm” once you’re done

​

Finalize Run

Enter a name for your run and click “Confirm” once you’re done.