Get the latest tech news
Show HN: Any-LLM – Lightweight router to access any LLM Provider
Communicate with an LLM provider using a single interface - mozilla-ai/any-llm
Simple, unified interface- one function for all providers, switch models with just a string change Developer friendly- full type hints for better IDE support and clear, actionable error messages Leverages official provider SDKs when available, reducing maintenance burden and ensuring compatibility Stays framework-agnostic so it can be used across different projects and use cases Actively maintained- we use this in our own product ( any-agent) ensuring continued support No Proxy or Gateway server required so you don't need to deal with setting up any other service to talk to whichever LLM provider you need. The landscape of LLM provider interfaces presents a fragmented ecosystem with several challenges that any-llm aims to address: LiteLLM: While popular, it reimplements provider interfaces rather than leveraging official SDKs, which can lead to compatibility issues and unexpected behavior modifications AISuite: Offers a clean, modular approach but lacks active maintenance, comprehensive testing, and modern Python typing standards.
Or read this on Hacker News