Update By Reference (v4.0)

Update a logged datapoint by its reference ID.

The reference_id query parameter must be provided, and refers to the reference_id of a previously-logged datapoint.

Query parameters

reference_idstringRequired

A unique string to reference the datapoint. Identifies the logged datapoint created with the same reference_id.

Request

This endpoint expects an object.

outputstringOptional

Generated output from your model for the provided inputs.

errorstringOptional

Error message if the log is an error.

durationdoubleOptional

Duration of the logged event in seconds.

Response

Successful Response

idstring

String ID of logged datapoint. Starts with data_.

configobject

evaluation_resultslist of objects

observability_statusenum

Allowed values: pendingrunningcompletedfailed

Status of a Log for observability.

Observability is implemented by running monitoring Evaluators on Logs.

updated_atdatetime

projectstringOptional

The name of the project associated with this log

project_idstringOptional

The unique ID of the project associated with this log.

session_idstringOptional

ID of the session to associate the datapoint.

session_reference_idstringOptional

A unique string identifying the session to associate the datapoint to. Allows you to log multiple datapoints to a session (using an ID kept by your internal systems) by passing the same session_reference_id in subsequent log requests. Specify at most one of this or session_id.

parent_idstringOptional

ID associated to the parent datapoint in a session.

parent_reference_idstringOptional

A unique string identifying the previously-logged parent datapoint in a session. Allows you to log nested datapoints with your internal system IDs by passing the same reference ID as parent_id in a prior log request. Specify at most one of this or parent_id. Note that this cannot refer to a datapoint being logged in the same request.

inputsmap from strings to anyOptional

The inputs passed to the prompt template.

sourcestringOptional

Identifies where the model was called from.

metadatamap from strings to anyOptional

Any additional metadata to record.

savebooleanOptional

Whether the request/response payloads will be stored on Humanloop.

source_datapoint_idstringOptional

ID of the source datapoint if this is a log derived from a datapoint in a dataset.

reference_idstringOptional

Unique user-provided string identifying the datapoint.

messageslist of objectsOptional

The messages passed to the to provider chat endpoint.

outputstringOptional

Generated output from your model for the provided inputs. Can be None if logging an error, or if logging a parent datapoint with the intention to populate it later

judgmentboolean or double or list of strings or stringOptional

config_idstringOptional

Unique ID of a config to associate to the log.

environmentstringOptional

The environment name used to create the log.

feedbacklist of objectsOptional

created_atdatetimeOptional

User defined timestamp for when the log was created.

errorstringOptional

Error message if the log is an error.

stdoutstringOptional

Captured log and debug statements.

durationdoubleOptional

Duration of the logged event in seconds.

output_messageobjectOptional

The message returned by the provider.

prompt_tokensintegerOptional

Number of tokens in the prompt used to generate the output.

output_tokensintegerOptional

Number of tokens in the output generated by the model.

prompt_costdoubleOptional

Cost in dollars associated to the tokens in the prompt.

output_costdoubleOptional

Cost in dollars associated to the tokens in the output.

provider_requestmap from strings to anyOptional

Raw request sent to provider.

provider_responsemap from strings to anyOptional

Raw response received the provider.

userstringOptional

User email address provided when creating the datapoint.

provider_latencydoubleOptional

Latency of provider response.

tokensintegerOptional

Total number of tokens in the prompt and output.

raw_outputstringOptional

Raw output from the provider.

finish_reasonstringOptional

Reason the generation finished.

toolslist of objectsOptional

tool_choice"none" or "auto" or "required" or objectOptional

Controls how the model uses tools. The following options are supported: ‘none’ forces the model to not call a tool; the default when no tools are provided as part of the model config. ‘auto’ the model can decide to call one of the provided tools; the default when tools are provided as part of the model config. Providing {‘type’: ‘function’, ‘function’: {name’: <TOOL_NAME>}} forces the model to use the named function.

batch_idslist of stringsOptional

List of batch IDs the log belongs to.

1	curl -X PATCH "https://api.humanloop.com/v4/logs?reference_id=reference_id" \
2	-H "X-API-KEY: <apiKey>" \
3	-H "Content-Type: application/json" \
4	-d '{}'

1	{
2	"id": "id",
3	"config": {
4	"type": "generic",
5	"id": "config",
6	"name": "config",
7	"status": "config",
8	"created_by": {
9	"id": "id",
10	"email_address": "email_address",
11	"verified": true,
12	"full_name": "full_name"
13	},
14	"description": "config",
15	"other": {
16	"key": "value"
17	}
18	},
19	"evaluation_results": [
20	{
21	"id": "id",
22	"evaluator_id": "evaluator_id",
23	"evaluator_version_id": "evaluator_version_id",
24	"log_id": "log_id",
25	"updated_at": "2024-01-15T09:30:00Z",
26	"created_at": "2024-01-15T09:30:00Z",
27	"evaluation_id": "evaluation_id",
28	"version_id": "version_id",
29	"version": {
30	"key": "value"
31	},
32	"value": true,
33	"error": "error"
34	}
35	],
36	"observability_status": "pending",
37	"updated_at": "2024-01-15T09:30:00Z",
38	"project": "project",
39	"project_id": "project_id",
40	"session_id": "session_id",
41	"session_reference_id": "session_reference_id",
42	"parent_id": "parent_id",
43	"parent_reference_id": "parent_reference_id",
44	"inputs": {
45	"key": "value"
46	},
47	"source": "source",
48	"metadata": {
49	"key": "value"
50	},
51	"save": true,
52	"source_datapoint_id": "source_datapoint_id",
53	"reference_id": "reference_id",
54	"messages": [
55	{
56	"role": "user",
57	"content": "content",
58	"name": "name",
59	"tool_call_id": "tool_call_id",
60	"tool_calls": [
61	{
62	"id": "id",
63	"type": "function",
64	"function": {
65	"name": "name"
66	}
67	}
68	],
69	"tool_call": {
70	"name": "name"
71	}
72	}
73	],
74	"output": "output",
75	"judgment": true,
76	"config_id": "config_id",
77	"environment": "environment",
78	"feedback": [
79	{
80	"type": "rating",
81	"value": true,
82	"id": "id",
83	"data_id": "data_id",
84	"user": "user",
85	"created_at": "2024-01-15T09:30:00Z"
86	}
87	],
88	"created_at": "2024-01-15T09:30:00Z",
89	"error": "error",
90	"stdout": "stdout",
91	"duration": 1.1,
92	"output_message": {
93	"role": "user",
94	"content": "content",
95	"name": "name",
96	"tool_call_id": "tool_call_id",
97	"tool_calls": [
98	{
99	"id": "id",
100	"type": "function",
101	"function": {
102	"name": "name"
103	}
104	}
105	],
106	"tool_call": {
107	"name": "name",
108	"arguments": "arguments"
109	}
110	},
111	"prompt_tokens": 1,
112	"output_tokens": 1,
113	"prompt_cost": 1.1,
114	"output_cost": 1.1,
115	"provider_request": {
116	"key": "value"
117	},
118	"provider_response": {
119	"key": "value"
120	},
121	"user": "user",
122	"provider_latency": 1.1,
123	"tokens": 1,
124	"raw_output": "raw_output",
125	"finish_reason": "finish_reason",
126	"tools": [
127	{
128	"id": "id",
129	"name": "name",
130	"signature": "signature",
131	"result": "result"
132	}
133	],
134	"tool_choice": "none",
135	"batch_ids": [
136	"batch_ids"
137	]
138	}

Query parameters

Request

Response

Errors