Issue evidence · AI API · BerriAI/litellm

routing_strategy "cost-based-routing" breaks all sync Router methods with RouterRateLimitError

GitHub issue: https://github.com/BerriAI/litellm/issues/45718

Reproduced

With one healthy deployment, every sync Router call raises "No deployments available" under cost-based routing, while async resolves it.

What Badgr ran

Built a Router with one mock deployment and called get_available_deployment (sync) and async_get_available_deployment on LiteLLM 1.104.2, under cost-based-routing and four other strategies.

What came back

  • cost-based-routing: sync raised RouterRateLimitError; async returned the deployment.
  • simple-shuffle, least-busy, latency-based-routing and usage-based-routing-v2: sync worked.

Related Badgr pages

Checked 2026-10-10 in Badgr’s local development environment.

← All issue evidence