Get the latest tech news
Show HN: ArchGW – An intelligent edge and service proxy for agents
The edge and AI gateway for agentic apps. Arch handles the messy low-level work in building agents like applying guardrails, routing prompts to the right agent, and unifying access to any LLM. It’s...
But past the thrill of a quick hack, you are left building, maintaining and scaling low-level plumbing code for agents that slows down AI innovation. ⛨ Guardrails: Centrally configure and prevent harmful outcomes and ensure safe user interactions ⚡ Tools Use: For common agentic scenarios let Arch instantly clarify and convert prompts to tools/API calls 🕵 Observability: W3C compatible request tracing and LLM metrics that instantly plugin with popular tools 🧱 Built on Envoy: Arch runs alongside app servers as a containerized process, and builds on top of Envoy's proven HTTP management and scalability features to handle ingress and egress traffic related to prompts and LLMs. To offer consistent latencies and throughput, and to manage our expenses, we will enable access to the hosted version via developers keys soon, and give you the option to run that LLM locally.
Or read this on Hacker News
