Get the latest tech news

Show HN: Any-LLM – Lightweight router to access any LLM Provider


Communicate with an LLM provider using a single interface - mozilla-ai/any-llm

Simple, unified interface- one function for all providers, switch models with just a string change Developer friendly- full type hints for better IDE support and clear, actionable error messages Leverages official provider SDKs when available, reducing maintenance burden and ensuring compatibility Stays framework-agnostic so it can be used across different projects and use cases Actively maintained- we use this in our own product ( any-agent) ensuring continued support No Proxy or Gateway server required so you don't need to deal with setting up any other service to talk to whichever LLM provider you need. The landscape of LLM provider interfaces presents a fragmented ecosystem with several challenges that any-llm aims to address: LiteLLM: While popular, it reimplements provider interfaces rather than leveraging official SDKs, which can lead to compatibility issues and unexpected behavior modifications AISuite: Offers a clean, modular approach but lacks active maintenance, comprehensive testing, and modern Python typing standards.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Source

Source

Photo of router

router

Photo of LLM Provider

LLM Provider

Related news:

News photo

OSS Rebuild: open-source, rebuilt to last

News photo

A ChatGPT ‘router’ that automatically selects the right OpenAI model for your job appears imminent

News photo

NVIDIA Makes More Hopper, Blackwell Header Files Open-Source