It provides failover between multiple providers (of both the same model, with routing based on price, performance or availability, and you can define presets that allows automated failover to entirely different models if you want), middleware/plugins - such as optionally adding auto-compaction or web search, detailed logging, making all the models available via either OpenAI or Anthropic compatible API endpoints.
