Call Agent

Call an Agent. The Agent will run on the Humanloop runtime and return a completed Agent Log.

If the Agent requires a tool call that cannot be ran by Humanloop, execution will halt. To continue, pass the ID of the incomplete Log and the required tool call to the /agents/continue endpoint.

The agent will run for the maximum number of iterations, or until it encounters a stop condition, according to its configuration.

You can use query parameters version_id, or environment, to target an existing version of the Agent. Otherwise the default deployed version will be chosen.

Instead of targeting an existing version explicitly, you can instead pass in Agent details in the request body. A new version is created if it does not match any existing ones. This is helpful in the case where you are storing or deriving your Agent details in code.

Query parameters

version_idstringOptional

A specific Version ID of the Agent to log to.

environmentstringOptional

Name of the Environment identifying a deployed version to log to.

Request

This endpoint expects an object.

streamfalseRequired

If true, Agent events and tokens will be sent as data-only server-sent events.

pathstringOptional

Path of the Agent, including the name. This locates the Agent in the Humanloop filesystem and is used as as a unique identifier. For example: folder/name or just name.

idstringOptional

ID for an existing Agent.

messageslist of objectsOptional

The messages passed to the to provider chat endpoint.

tool_choice"none" or "auto" or "required" or objectOptional

Controls how the model uses tools. The following options are supported:

'none' means the model will not call any tool and instead generates a message; this is the default when no tools are provided as part of the Prompt.
'auto' means the model can decide to call one or more of the provided tools; this is the default when tools are provided as part of the Prompt.
'required' means the model must call one or more of the provided tools.
{'type': 'function', 'function': {name': <TOOL_NAME>}} forces the model to use the named function.

agentobject or stringOptional

The Agent configuration to use. Two formats are supported:

An object representing the details of the Agent configuration
A string representing the raw contents of a .agent file

A new Agent version will be created if the provided details do not match any existing version.

inputsmap from strings to anyOptional

The inputs passed to the prompt template.

sourcestringOptional

Identifies where the model was called from.

metadatamap from strings to anyOptional

Any additional metadata to record.

start_timedatetimeOptional

When the logged event started.

end_timedatetimeOptional

When the logged event ended.

log_statusenumOptional

Status of a Log. Set to incomplete if you intend to update and eventually complete the Log and want the File’s monitoring Evaluators to wait until you mark it as complete. If log_status is not provided, observability will pick up the Log as soon as possible. Updating this from specified to unspecified is undefined behavior.

Allowed values:

source_datapoint_idstringOptional

Unique identifier for the Datapoint that this Log is derived from. This can be used by Humanloop to associate Logs to Evaluations. If provided, Humanloop will automatically associate this Log to Evaluations that require a Log for this Datapoint-Version pair.

trace_parent_idstringOptional

The ID of the parent Log to nest this Log under in a Trace.

userstringOptional

End-user ID related to the Log.

environmentstringOptional

The name of the Environment the Log is associated to.

savebooleanOptionalDefaults to true

Whether the request/response payloads will be stored on Humanloop.

log_idstringOptional

This will identify a Log. If you don’t provide a Log ID, Humanloop will generate one for you.

provider_api_keysobjectOptional

API keys required by each provider to make API calls. The API keys provided here are not stored by Humanloop. If not specified here, Humanloop will fall back to the key saved to your organization.

return_inputsbooleanOptionalDefaults to true

Whether to return the inputs in the response. If false, the response will contain an empty dictionary under inputs. This is useful for reducing the size of the response. Defaults to true.

include_trace_childrenbooleanOptionalDefaults to false

If true, populate trace_children for the returned Agent Log. Only applies when not streaming. Defaults to false.

Response

agentobject

Agent that generated the Log.

idstring

Unique identifier for the Log.

evaluator_logslist of objects

List of Evaluator Logs associated with the Log. These contain Evaluator judgments on the Log.

output_messageobjectOptional

The message returned by the provider.

prompt_tokensintegerOptional

Number of tokens in the prompt used to generate the output.

reasoning_tokensintegerOptional

Number of reasoning tokens used to generate the output.

output_tokensintegerOptional

Number of tokens in the output generated by the model.

prompt_costdoubleOptional

Cost in dollars associated to the tokens in the prompt.

output_costdoubleOptional

Cost in dollars associated to the tokens in the output.

finish_reasonstringOptional

Reason the generation finished.

messageslist of objectsOptional

The messages passed to the to provider chat endpoint.

tool_choice"none" or "auto" or "required" or objectOptional

Controls how the model uses tools. The following options are supported:

'none' means the model will not call any tool and instead generates a message; this is the default when no tools are provided as part of the Prompt.
'auto' means the model can decide to call one or more of the provided tools; this is the default when tools are provided as part of the Prompt.
'required' means the model must call one or more of the provided tools.
{'type': 'function', 'function': {name': <TOOL_NAME>}} forces the model to use the named function.

start_timedatetimeOptional

When the logged event started.

end_timedatetimeOptional

When the logged event ended.

outputstringOptional

Generated output from your model for the provided inputs. Can be None if logging an error, or if creating a parent Log with the intention to populate it later.

created_atdatetimeOptional

User defined timestamp for when the log was created.

errorstringOptional

Error message if the log is an error.

provider_latencydoubleOptional

Duration of the logged event in seconds.

stdoutstringOptional

Captured log and debug statements.

provider_requestmap from strings to anyOptional

Raw request sent to provider.

provider_responsemap from strings to anyOptional

Raw response received the provider.

inputsmap from strings to anyOptional

The inputs passed to the prompt template.

sourcestringOptional

Identifies where the model was called from.

metadatamap from strings to anyOptional

Any additional metadata to record.

log_statusenumOptional

Status of the Agent Log. If incomplete, the Agent turn was suspended due to a tool call and can be continued by calling /agents/continue with responses to the Agent’s last message (which should contain tool calls). See the previous_agent_message field for easy access to the Agent’s last message.

Allowed values:

source_datapoint_idstringOptional

trace_parent_idstringOptional

The ID of the parent Log to nest this Log under in a Trace.

batcheslist of stringsOptional

Array of Batch IDs that this Log is part of. Batches are used to group Logs together for offline Evaluations

userstringOptional

End-user ID related to the Log.

environmentstringOptional

The name of the Environment the Log is associated to.

savebooleanOptionalDefaults to true

Whether the request/response payloads will be stored on Humanloop.

log_idstringOptional

This will identify a Log. If you don’t provide a Log ID, Humanloop will generate one for you.

trace_flow_idstringOptional

Identifier for the Flow that the Trace belongs to.

trace_idstringOptional

Identifier for the Trace that the Log belongs to.

trace_childrenlist of objectsOptional

Logs nested under this Log in the Trace.

previous_agent_messageobjectOptional

The Agent’s last message, which should contain tool calls. Only populated if the Log is incomplete due to a suspended Agent turn with tool calls. This is useful for continuing the Agent call by calling /agents/continue.

1	curl -X POST https://api.humanloop.com/v5/agents/call \
2	-H "X-API-KEY: <apiKey>" \
3	-H "Content-Type: application/json" \
4	-d '{
5	"path": "Banking/Teller Agent",
6	"messages": [
7	{
8	"role": "user",
9	"content": "I\'d like to deposit $1000 to my savings account from my checking account."
10	}
11	]
12	}'

1	{
2	"agent": {
3	"path": "Banking/Teller Agent",
4	"id": "ag_1234567890",
5	"model": "claude-3-7-sonnet-latest",
6	"tools": [
7	{
8	"type": "file",
9	"link": {
10	"file_id": "pr_1234567890",
11	"version_id": "prv_1234567890"
12	},
13	"on_agent_call": "continue"
14	},
15	{
16	"type": "inline",
17	"json_schema": {
18	"name": "stop",
19	"description": "Call this tool when you have finished your task.",
20	"strict": true,
21	"parameters": {
22	"type": "object",
23	"properties": {
24	"output": {
25	"type": "string"
26	}
27	},
28	"additionalProperties": false,
29	"required": [
30	"output"
31	]
32	}
33	},
34	"on_agent_call": "stop"
35	}
36	],
37	"name": "Teller Agent",
38	"version_id": "agv_1234567890",
39	"created_at": "2024-05-01T12:00:00Z",
40	"updated_at": "2024-05-01T12:00:00Z",
41	"status": "committed",
42	"last_used_at": "2024-05-01T12:00:00Z",
43	"version_logs_count": 1,
44	"total_logs_count": 1,
45	"inputs": [],
46	"endpoint": "chat",
47	"template": [
48	{
49	"role": "system",
50	"content": "You are a helpful digital assistant, helping users navigate our digital banking platform."
51	}
52	],
53	"provider": "anthropic",
54	"reasoning_effort": 1024,
55	"max_iterations": 3
56	},
57	"id": "log_1234567890",
58	"evaluator_logs": []
59	}

Headers

Query parameters

Request

Response

Errors