Upsert Evaluator (API Explorer)

Prompts
Tools
Datasets
Evaluators
Flows
Directories
Files
- GETList Files
- POSTRetrieve by path
Evaluations
Logs

POSThttps://api.humanloop.com/v5/evaluators

Body Parameters

specobjectRequired
arguments_typeenumRequired
return_typeenumRequired
evaluator_type"python"Required
python
codestringRequired
pathstring
commit_messagestring

Request

$ curl -X POST https://api.humanloop.com/v5/evaluators \
>      -H "X-API-KEY: " \
>      -H "Content-Type: application/json" \
>      -d '{
>   "spec": {
>     "arguments_type": "target_required",
>     "return_type": "number",
>     "evaluator_type": "python",
>     "code": "def evaluate(answer, target):\n    return 0.5"
>   },
>   "path": "Shared Evaluators/Accuracy Evaluator",
>   "commit_message": "Initial commit"
> }'

Response

$	curl -X POST https://api.humanloop.com/v5/evaluators \
>	-H "X-API-KEY: " \
>	-H "Content-Type: application/json" \
>	-d '{
>	"spec": {
>	"arguments_type": "target_required",
>	"return_type": "number",
>	"evaluator_type": "python",
>	"code": "def evaluate(answer, target):\n return 0.5"
>	},
>	"path": "Shared Evaluators/Accuracy Evaluator",
>	"commit_message": "Initial commit"
>	}'