Evaluators

Get

GET
Get an evaluator within your organization.

Path parameters

idstringRequired

Response

This endpoint returns an object
name
string
The name of the evaluator.
description
string
The description of the evaluator.
arguments_type
enum
Whether this evaluator is target-free or target-required.
Allowed values: target_freetarget_required
return_type
enum
The type of the return value of the evaluator.
Allowed values: booleannumber
type
enum
The type of the evaluator.
Allowed values: pythonllmhumanexternal
id
string

Unique ID for the evaluator. Starts with evfn_.

created_at
datetime
updated_at
datetime
code
stringOptional
The code for the evaluator. This code will be executed in a sandboxed environment.
model_config
objectOptional
The model config defining the LLM evaluator.
logging_project
objectOptional
The project where the evaluator logs are stored.

Errors