Update Monitoring

POST

Activate and deactivate Evaluators for monitoring the Tool.

An activated Evaluator will automatically be run on all new Logs within the Tool for monitoring purposes.

Path parameters

idstringRequired

Request

This endpoint expects an object.
activatelist of objectsOptional

Evaluators to activate for Monitoring. These will be automatically run on new Logs.

deactivatelist of objectsOptional

Evaluators to deactivate. These will not be run on new Logs.

Response

Successful Response

pathstring

Path of the Tool, including the name, which is used as a unique identifier.

idstring

Unique identifier for the Tool.

namestring

Name of the Tool, which is used as a unique identifier.

version_idstring

Unique identifier for the specific Tool Version. If no query params provided, the default deployed Tool Version is returned.

created_atdatetime
updated_atdatetime
statusenum
Allowed values: uncommittedcommitteddeleted

The status of the Tool Version.

last_used_atdatetime
version_logs_countinteger

The number of logs that have been generated for this Tool Version

total_logs_countinteger

The number of logs that have been generated across all Tool Versions

inputslist of objects

Inputs associated to the Prompt. Inputs correspond to any of the variables used within the Tool template.

directory_idstringOptional

ID of the directory that the file is in on Humanloop.

functionobjectOptional

Callable function specification of the Tool shown to the model for tool calling.

source_codestringOptional

Code source of the Tool.

setup_valuesmap from strings to anyOptional

Values needed to setup the Tool, defined in JSON Schema format: https://json-schema.org/

attributesmap from strings to anyOptional

Additional fields to describe the Tool. Helpful to separate Tool versions from each other with details on how they were created or used.

tool_typeenumOptional

Type of Tool.

commit_messagestringOptional

Message describing the changes made.

type"tool"OptionalDefaults to tool
environmentslist of objectsOptional

The list of environments the Tool Version is deployed to.

created_byanyOptional

The user who created the Tool.

committed_byanyOptional

The user who committed the Tool Version.

committed_atdatetimeOptional

The date and time the Tool Version was committed.

evaluatorslist of objectsOptional

Evaluators that have been attached to this Tool that are used for monitoring logs.

signaturestringOptional

Signature of the Tool.

evaluator_aggregateslist of objectsOptional

Aggregation of Evaluator results for the Tool Version.

Errors