String ID of project. Starts with pr_
.
ID of the config to evaluate. Starts with config_
.
IDs of evaluators to run on the dataset. IDs start with evfn_
ID of the dataset to use in this evaluation. Starts with evts_
.
Whether the log generations for this evaluation should be performed by Humanloop. If False
, the log generations should be submitted by the user via the API.
Unique ID for the evaluation. Starts with ev_
.