Activate and deactivate Evaluators for monitoring the Evaluator.
An activated Evaluator will automatically be run on all new Logs within the Evaluator for monitoring purposes.
Evaluators to activate for Monitoring. These will be automatically run on new Logs.
Evaluators to deactivate. These will not be run on new Logs.
Path of the Evaluator including the Evaluator name, which is used as a unique identifier.
Unique identifier for the Evaluator.
Name of the Evaluator, which is used as a unique identifier.
Unique identifier for the specific Evaluator Version. If no query params provided, the default deployed Evaluator Version is returned.
An enumeration.
The number of logs that have been generated for this Evaluator Version
The number of logs that have been generated across all Evaluator Versions
Inputs associated to the Evaluator. Inputs correspond to any of the variables used within the Evaluator template.
ID of the directory that the file is in on Humanloop.
Message describing the changes made.
The list of environments the Evaluator Version is deployed to.
The user who created the Evaluator.
Evaluators that have been attached to this Evaluator that are used for monitoring logs.
Aggregation of Evaluator results for the Evaluator Version.
Additional fields to describe the Evaluator. Helpful to separate Evaluator versions from each other with details on how they were created or used.