Get the latest tech news
Show HN: Butter – A Behavior Cache for LLMs
For Your LLM Butter is a cache that identifies patterns in LLM responses and saves you money by serving responses directly. It's also deterministic, allowing your AI systems to consistently repeat past behaviors.
None
Or read this on Hacker News
