NexoRouter

Documentation

FAQ: Why did the request time out? in the NexoRouter documentation.

FAQ: Why did the request time out?

Timeouts usually mean the upstream model did not complete quickly enough for the current gateway and client settings.

CodeMeaning
upstream_request_timeoutOverall upstream request timed out.
upstream_headers_timeoutProvider did not start the response in time.
upstream_body_timeoutProvider response body stalled.
upstream_unreachableGateway could not reach the upstream provider.

Fix it

  • Use at least 60 seconds for standard chat models.
  • Use up to 180 seconds for slow reasoning-style models.
  • Avoid cancel-and-retry loops.
  • Try a faster model for interactive UI.
  • Check Status if multiple models fail.

If your client disconnects before the provider finishes, retrying may create a new billable request.

FAQ: Why did the request time out? — NexoRouter