Submit Evaluator judgment for an existing Log.
Creates a new Log. The evaluated Log will be set as the parent of the created Log.
ID of the Evaluator version to log against.
Name of the Environment identifying a deployed version to log to.
Identifier of the evaluated Log. The newly created Log will have this one set as parent.
Path of the Evaluator, including the name. This locates the Evaluator in the Humanloop filesystem and is used as as a unique identifier. For example: folder/name or just name.
ID for an existing Evaluator.
When the logged event started.
When the logged event ended.
Generated output from the LLM. Only populated for LLM Evaluator Logs.
User defined timestamp for when the log was created.
Error message if the log is an error.
Duration of the logged event in seconds.
Captured log and debug statements.
Raw request sent to provider. Only populated for LLM Evaluator Logs.
Raw response received the provider. Only populated for LLM Evaluator Logs.
The inputs passed to the prompt template.
Identifies where the model was called from.
Any additional metadata to record.
Unique identifier for the Datapoint that this Log is derived from. This can be used by Humanloop to associate Logs to Evaluations. If provided, Humanloop will automatically associate this Log to Evaluations that require a Log for this Datapoint-Version pair.
The ID of the parent Log to nest this Log under in a Trace.
End-user ID related to the Log.
The name of the Environment the Log is associated to.
Whether the request/response payloads will be stored on Humanloop.
This will identify a Log. If you don’t provide a Log ID, Humanloop will generate one for you.
Evaluator assessment of the Log.
Whether the Log has been manually marked as completed by a user.
Successful Response
String identifier of the new Log.
Identifier of the evaluated parent Log.
Identifier of Evaluator Version for which the Log was registered.
Identifier of the Session containing both the parent and the new child Log. If the parent Log does not belong to a Session, a new Session is created with this ID.