Get the latest tech news

Show HN: An open-source AI Gateway with integrated guardrails


A Blazing Fast AI Gateway. Route to 200+ LLMs with 1 fast & friendly API. - Portkey-AI/gateway

About a year ago, we started Portkey to solve a problem we'd faced ourselves — lack of adequate tooling to confidently put LLM apps in production. With Portkey Gateway, we now process billions of LLM tokens every day, and help hundreds of companies take their AI apps to production. Outputs can be complete hallucinations or factually inaccurate Results may show bias, violate privacy norms, or potentially harm the organization

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Source

Source

Photo of gateway

gateway

Related news:

News photo

Show HN: Nyro – Open-source AI assistant for your OS

News photo

Show HN: ScholArxiv – an open-source, aesthetic, minimal research paper explorer

News photo

Open-Source AMD GPU Implementation Of CUDA "ZLUDA" Has Been Taken Down