Create Evaluation Criteria

Create a new evaluation criteria in a project. Use to set up criteria for evaluating LLM outputs in test runs or online evaluations.

POST /api/v2/projects/{project_id}/evaluation-criteria

Create Evaluation Criteria

cURL

curl --request POST \
  --url https://api.example.com/api/v2/projects/{project_id}/evaluation-criteria \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "name": "<string>",
  "target_id": "3c90c3cc-0d44-4b50-8888-8dd25736052a",
  "llm_eval_enabled": true,
  "id": null
}
'

201

{
  "id": "3c90c3cc-0d44-4b50-8888-8dd25736052a"
}

Authorizations

Authorization · string · header · required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

project_id · string · required

Body

application/json

name · string · required

target_type · enum<string> · required

Available options: prompt, agent

target_id · string<uuid> · required

type · enum<string> · required

Available options: 1-5, 1-3, 1-100, yes-no, multi-select, text, auto-categorization, code-bool, code-float

llm_eval_enabled · boolean · required

id · string<uuid> | null

Response

201 - application/json

CreateEvaluationCriteriaResponse(id: uuid.UUID)

id · string<uuid> · required