Create Evaluation
Create an Evaluation.
Create a new Evaluation by specifying the File to evaluate, and a name
for the Evaluation.
You can then add Runs to this Evaluation using the POST /evaluations/{id}/runs
endpoint.
Headers
X-API-KEY
Request
This endpoint expects an object.
evaluators
The Evaluators used to evaluate.
file
The File to associate with the Evaluation. This File contains the Logs you're evaluating.
name
Name of the Evaluation to help identify it. Must be unique within the associated File.
Response
Successful Response
id
Unique identifier for the Evaluation. Starts with evr
.
runs_count
The total number of Runs in the Evaluation.
evaluators
The Evaluator Versions used to evaluate.
created_at
updated_at
name
Name of the Evaluation to help identify it. Must be unique among Evaluations associated with File.
file_id
Unique identifier for the File associated with the Evaluation.
created_by
url
URL to view the Evaluation on the Humanloop.