Log

POST

Submit Evaluator judgment for an existing Log.

Creates a new Log. The evaluated Log will be set as the parent of the created Log.

Query parameters

version_idstringOptional
ID of the Evaluator version to log against.
environmentstringOptional
Name of the Environment identifying a deployed version to log to.

Request

This endpoint expects an object.
parent_idstringRequired
Identifier of the evaluated Log. The newly created Log will have this one set as parent.
pathstringOptional

Path of the Evaluator, including the name. This locates the Evaluator in the Humanloop filesystem and is used as as a unique identifier. Example: folder/name or just name.

idstringOptional
ID for an existing Evaluator.
outputstringOptional
Generated output from the LLM. Only populated for LLM Evaluator Logs.
created_atdatetimeOptional
User defined timestamp for when the log was created.
errorstringOptional
Error message if the log is an error.
provider_latencydoubleOptional
Duration of the logged event in seconds.
stdoutstringOptional
Captured log and debug statements.
provider_requestmap from strings to anyOptional
Raw request sent to provider. Only populated for LLM Evaluator Logs.
provider_responsemap from strings to anyOptional
Raw response received the provider. Only populated for LLM Evaluator Logs.
inputsmap from strings to anyOptional
The inputs passed to the prompt template.
sourcestringOptional
Identifies where the model was called from.
metadatamap from strings to anyOptional
Any additional metadata to record.
session_idstringOptional

Unique identifier for the Session to associate the Log to. Allows you to record multiple Logs to a Session (using an ID kept by your internal systems) by passing the same session_id in subsequent log requests.

source_datapoint_idstringOptional
Unique identifier for the Datapoint that this Log is derived from. This can be used by Humanloop to associate Logs to Evaluations. If provided, Humanloop will automatically associate this Log to Evaluations that require a Log for this Datapoint-Version pair.
batcheslist of stringsOptional
Array of Batch Ids that this log is part of. Batches are used to group Logs together for offline Evaluations
userstringOptional
End-user ID related to the Log.
environmentstringOptional
The name of the Environment the Log is associated to.
savebooleanOptional
Whether the request/response payloads will be stored on Humanloop.
judgmentboolean or string or list of strings or doubleOptional
Evaluator assessment of the Log.
specobjectOptional

Response

This endpoint returns an object.
idstring
String identifier of the new Log.
parent_idstring
Identifier of the evaluated parent Log.
version_idstring
Identifier of Evaluator Version for which the Log was registered.
session_idstringOptional
Identifier of the Session containing both the parent and the new child Log. If the parent Log does not belong to a Session, a new Session is created with this ID.

Errors

Built with