List Evaluations

GET

Retrieve a list of Evaluations for the specified File.

Query parameters

file_idstringRequired

Filter by File ID. Only Evaluations for the specified File will be returned.

pageintegerOptional

Page number for pagination.

sizeintegerOptional

Page size for pagination. Number of Evaluations to fetch.

Response

Successful Response

recordslist of objects

pageinteger

sizeinteger

totalinteger

Errors

GET

1 curl -G https://api.humanloop.com/v5/evaluations \
2      -H "X-API-KEY: <apiKey>" \
3      -d file_id=pr_30gco7dx6JDq4200GVOHa \
4      -d size=1

1 {
2   "records": [
3     {
4       "id": "ev_567yza",
5       "runs_count": 1,
6       "evaluators": [
7         {
8           "version": {
9             "path": "Shared Evaluators/Accuracy Evaluator",
10             "id": "ev_890bcd",
11             "spec": {
12               "arguments_type": "target_required",
13               "return_type": "number",
14               "evaluator_type": "python",
15               "code": "def evaluate(answer, target):\n    return 0.5"
16             },
17             "name": "Accuracy Evaluator",
18             "version_id": "evv_012def",
19             "created_at": "2024-05-01T12:00:00Z",
20             "updated_at": "2024-05-01T12:00:00Z",
21             "status": "committed",
22             "last_used_at": "2024-05-01T12:00:00Z",
23             "version_logs_count": 1,
24             "total_logs_count": 1,
25             "inputs": [
26               {
27                 "name": "answer"
28               }
29             ],
30             "type": "evaluator"
31           },
32           "orchestrated": false,
33           "added_at": "2024-10-12T12:00:00Z"
34         }
35       ],
36       "created_at": "2024-05-01T12:00:00Z",
37       "updated_at": "2024-05-01T12:00:00Z"
38     }
39   ],
40   "page": 1,
41   "size": 10,
42   "total": 1
43 }

Create Evaluation

Up Next

Built with

1	curl -G https://api.humanloop.com/v5/evaluations \
2	-H "X-API-KEY: <apiKey>" \
3	-d file_id=pr_30gco7dx6JDq4200GVOHa \
4	-d size=1

1	{
2	"records": [
3	{
4	"id": "ev_567yza",
5	"runs_count": 1,
6	"evaluators": [
7	{
8	"version": {
9	"path": "Shared Evaluators/Accuracy Evaluator",
10	"id": "ev_890bcd",
11	"spec": {
12	"arguments_type": "target_required",
13	"return_type": "number",
14	"evaluator_type": "python",
15	"code": "def evaluate(answer, target):\n return 0.5"
16	},
17	"name": "Accuracy Evaluator",
18	"version_id": "evv_012def",
19	"created_at": "2024-05-01T12:00:00Z",
20	"updated_at": "2024-05-01T12:00:00Z",
21	"status": "committed",
22	"last_used_at": "2024-05-01T12:00:00Z",
23	"version_logs_count": 1,
24	"total_logs_count": 1,
25	"inputs": [
26	{
27	"name": "answer"
28	}
29	],
30	"type": "evaluator"
31	},
32	"orchestrated": false,
33	"added_at": "2024-10-12T12:00:00Z"
34	}
35	],
36	"created_at": "2024-05-01T12:00:00Z",
37	"updated_at": "2024-05-01T12:00:00Z"
38	}
39	],
40	"page": 1,
41	"size": 10,
42	"total": 1
43	}