Upsert Evaluator (API Explorer)

Prompts
Tools
Datasets
Evaluators
Flows
Directories
Files
- GETList Files
- POSTRetrieve by path
Evaluations
Logs

POSThttps://api.humanloop.com/v5/evaluators

Body Parameters

specobjectRequired
arguments_typeenumRequired
return_typeenumRequired
evaluator_type"llm"Required
llm
pathstring
version_namestring
version_descriptionstring

Request

$ curl -X POST https://api.humanloop.com/v5/evaluators \
>      -H "X-API-KEY: " \
>      -H "Content-Type: application/json" \
>      -d '{
>   "path": "Shared Evaluators/Accuracy Evaluator",
>   "version_name": "simple-evaluator",
>   "version_description": "Simple evaluator that returns 0.5"
> }'

Response

$	curl -X POST https://api.humanloop.com/v5/evaluators \
>	-H "X-API-KEY: " \
>	-H "Content-Type: application/json" \
>	-d '{
>	"path": "Shared Evaluators/Accuracy Evaluator",
>	"version_name": "simple-evaluator",
>	"version_description": "Simple evaluator that returns 0.5"
>	}'