FAQ: Why is streaming not working?

Streaming is not yet documented as a verified stable public feature. Start by proving the same request works without streaming.

Debug flow

1. Disable streaming in the client.
2. Send the same prompt to chat/completions.
3. Check Usage Logs.
4. If non-streaming works, inspect client parsing and proxy buffering.
5. If non-streaming fails, fix that error first.

Common causes

• Proxy buffers streamed chunks.
• Client expects a different event format.
• Model or provider response is slow.
• The tool silently switched endpoint shape.

Safe fallback

Use non-streaming responses for first integration and support debugging.