This endpoint returns a stream of object.
Array containing the chat responses.
The raw responses returned by the model provider.
Unique identifier of the parent project. Will not be provided if the request was made without providing a project name or id
The number of chat responses.
Include the log probabilities of the top n tokens in the provider_response
The suffix that comes after a completion of inserted text. Useful for completions that act like inserts.
End-user ID passed through to provider call.
Counts of the number of tokens used and related stats.
The raw request sent to the model provider.
ID of the session if it belongs to one.
Controls how the model uses tools. The following options are supported: 'none' forces the model to not call a tool; the default when no tools are provided as part of the model config. 'auto' the model can decide to call one of the provided tools; the default when tools are provided as part of the model config. Providing {'type': 'function', 'function': {name': <TOOL_NAME>}} forces the model to use the named function.