Inference
Completion chunk object
Represents a streamed chunk of a completion response returned by model, based on the provided input.
event
enum<string>
Type of server-sent event.
Available options: token_sampled
index
integer
The index of the choice in the list of generated choices.
text
string
Generated text output.
token
integer
Generated output token.
Was this page helpful?