Get Evaluation Stats

GET

Get Evaluation Stats.

Retrieve aggregate stats for the specified Evaluation. This includes the number of generated Logs for each Run and the corresponding Evaluator statistics (such as the mean and percentiles).

Path parameters

idstringRequired

Unique identifier for Evaluation.

Response

Successful Response

run_statslist of objects

Stats for each Run in the Evaluation.

statusenum

Allowed values: pendingrunningcompletedcancelled

The current status of the Evaluation.

progressstringOptional

A summary string report of the Evaluation’s progress you can print to the command line;helpful when integrating Evaluations with CI/CD.

reportstringOptional

A summary string report of the Evaluation you can print to command line;helpful when integrating Evaluations with CI/CD.

Errors

GET

1 curl https://api.humanloop.com/v5/evaluations/id/stats \
2      -H "X-API-KEY: <apiKey>"

1 {
2   "run_stats": [
3     {
4       "run_id": "run_id",
5       "num_logs": 1,
6       "evaluator_stats": [
7         {
8           "evaluator_version_id": "evaluator_version_id",
9           "total_logs": 1,
10           "num_judgments": 1,
11           "num_nulls": 1,
12           "num_errors": 1,
13           "mean": 0,
14           "std": 1,
15           "percentiles": {
16             "0": -2.5,
17             "25": -0.6745,
18             "50": 0,
19             "75": 0.6745,
20             "100": 2.5
21           }
22         }
23       ],
24       "status": "pending",
25       "version_id": "version_id",
26       "batch_id": "batch_id"
27     }
28   ],
29   "status": "pending",
30   "progress": "progress",
31   "report": "report"
32 }

Get Logs for Evaluation

Up Next

Built with

1	curl https://api.humanloop.com/v5/evaluations/id/stats \
2	-H "X-API-KEY: <apiKey>"

1	{
2	"run_stats": [
3	{
4	"run_id": "run_id",
5	"num_logs": 1,
6	"evaluator_stats": [
7	{
8	"evaluator_version_id": "evaluator_version_id",
9	"total_logs": 1,
10	"num_judgments": 1,
11	"num_nulls": 1,
12	"num_errors": 1,
13	"mean": 0,
14	"std": 1,
15	"percentiles": {
16	"0": -2.5,
17	"25": -0.6745,
18	"50": 0,
19	"75": 0.6745,
20	"100": 2.5
21	}
22	}
23	],
24	"status": "pending",
25	"version_id": "version_id",
26	"batch_id": "batch_id"
27	}
28	],
29	"status": "pending",
30	"progress": "progress",
31	"report": "report"
32	}