Update Monitoring
Activate and deactivate Evaluators for monitoring the Tool.
An activated Evaluator will automatically be run on all new Logs
within the Tool for monitoring purposes.
Path parameters
id
Headers
X-API-KEY
Request
This endpoint expects an object.
activate
Evaluators to activate for Monitoring. These will be automatically run on new Logs.
deactivate
Evaluators to deactivate. These will not be run on new Logs.
Response
Successful Response
path
Path of the Tool, including the name, which is used as a unique identifier.
id
Unique identifier for the Tool.
name
Name of the Tool, which is used as a unique identifier.
version_id
Unique identifier for the specific Tool Version. If no query params provided, the default deployed Tool Version is returned.
created_at
updated_at
last_used_at
version_logs_count
The number of logs that have been generated for this Tool Version
total_logs_count
The number of logs that have been generated across all Tool Versions
inputs
Inputs associated to the Prompt. Inputs correspond to any of the variables used within the Tool template.
directory_id
ID of the directory that the file is in on Humanloop.
function
Callable function specification of the Tool shown to the model for tool calling.
source_code
Code source of the Tool.
setup_values
Values needed to setup the Tool, defined in JSON Schema format: https://json-schema.org/
attributes
Additional fields to describe the Tool. Helpful to separate Tool versions from each other with details on how they were created or used.
tool_type
Type of Tool.
version_name
Unique identifier for this Tool version. Each Tool can only have one version with a given name.
version_description
Description of the Version.
description
Description of the Tool.
readme
Long description of the file.
type
environments
The list of environments the Tool Version is deployed to.
created_by
The user who created the Tool.
evaluators
Evaluators that have been attached to this Tool that are used for monitoring logs.
signature
Signature of the Tool.
evaluator_aggregates
Aggregation of Evaluator results for the Tool Version.