Remove Evaluator

1 from humanloop import Humanloop 2 3 client = Humanloop( 4 api_key="YOUR_API_KEY", 5 ) 6 client.evaluations.remove_evaluator( 7 id="id", 8 evaluator_version_id="evaluator_version_id", 9 )

1 { 2 "id": "id", 3 "runs_count": 1, 4 "evaluators": [ 5 { 6 "version": { 7 "path": "path", 8 "id": "id", 9 "spec": { 10 "arguments_type": "target_free", 11 "return_type": "boolean", 12 "evaluator_type": "llm" 13 }, 14 "name": "name", 15 "version_id": "version_id", 16 "created_at": "2024-01-15T09:30:00Z", 17 "updated_at": "2024-01-15T09:30:00Z", 18 "last_used_at": "2024-01-15T09:30:00Z", 19 "version_logs_count": 1, 20 "total_logs_count": 1, 21 "inputs": [ 22 { 23 "name": "name" 24 } 25 ] 26 }, 27 "orchestrated": true, 28 "added_at": "2024-01-15T09:30:00Z" 29 } 30 ], 31 "created_at": "2024-01-15T09:30:00Z", 32 "updated_at": "2024-01-15T09:30:00Z", 33 "name": "name", 34 "file_id": "file_id", 35 "created_by": { 36 "id": "id", 37 "email_address": "email_address", 38 "full_name": "full_name" 39 }, 40 "url": "url" 41 }

Remove an Evaluator from an Evaluation.

The Evaluator will no longer be run on the Logs in the Evaluation.

Path parameters

idstringRequired

Unique identifier for Evaluation.

evaluator_version_idstringRequired

Unique identifier for Evaluator Version.

Response

Successful Response

idstring

Unique identifier for the Evaluation. Starts with evr.

runs_countinteger

The total number of Runs in the Evaluation.

evaluatorslist of objects

The Evaluator Versions used to evaluate.

created_atdatetime

updated_atdatetime

namestringOptional

Name of the Evaluation to help identify it. Must be unique among Evaluations associated with File.

file_idstringOptional

Unique identifier for the File associated with the Evaluation.

created_byanyOptional

urlstringOptional

URL to view the Evaluation on the Humanloop.

Path parameters

Headers

Response

Errors