If true, tokens will be sent as data-only server-sent events. If num_samples > 1, samples are streamed back independently.
Unique ID of a project to associate to the log. Either this or project
must be provided.
A unique string identifying the session to associate the datapoint to. Allows you to log multiple datapoints to a session (using an ID kept by your internal systems) by passing the same session_reference_id
in subsequent log requests. Specify at most one of this or session_id
.
A unique string identifying the previously-logged parent datapoint in a session. Allows you to log nested datapoints with your internal system IDs by passing the same reference ID as parent_id
in a prior log request. Specify at most one of this or parent_id
. Note that this cannot refer to a datapoint being logged in the same request.
The format of the response. Only type json_object is currently supported for chat.
Include the log probabilities of the top n tokens in the provider_response