Evaluations

Result

POST

Log an evaluation result to an evaluation run.

The run must have status ‘running’. One of result or error must be provided.

Path parameters

evaluation_idstringRequired

ID of the evaluation run. Starts with evrun_.

Request

This endpoint expects an object.
log_id
stringRequired

The log that was evaluated. Must have as its source_datapoint_id one of the datapoints in the dataset being evaluated.

evaluator_id
stringRequired

ID of the evaluator that evaluated the log. Starts with evfn_. Must be one of the evaluator IDs associated with the evaluation run being logged to.

result
unionOptional
The result value of the evaluation.
error
stringOptional
An error that occurred during evaluation.

Response

This endpoint returns an object
id
string
evaluator_id
string
evaluator_version_id
string
log_id
string
updated_at
datetime
created_at
datetime
evaluation_id
stringOptional
log
objectOptional
Request model for logging a datapoint.
version_id
stringOptional
version
anyOptional
value
unionOptional
error
stringOptional
llm_evaluator_log
objectOptional
Request model for logging a datapoint.

Errors