The server emits token fragments or events as decoding progresses over a persistent connection. Clients assemble the stream, handle partial structured data, and support cancellation or errors after output has begun.
A streaming response sends generated output incrementally instead of waiting for the entire result.
The server emits token fragments or events as decoding progresses over a persistent connection. Clients assemble the stream, handle partial structured data, and support cancellation or errors after output has begun.