Get the latest tech news
Wasting Inferences with Aider
Auto-Fixing Bugs from Asana (for 9 cents!)
This week’s ‘Works on My Machine’ explores a pattern that leans into the “Waste Inferences!” concept I’ve shared in the past and asks the question: what if we just trigger multiple AI attempts automatically from our project management tool and just pick the best result? If we continue to see the costs of models of this scale fall by by 90% again, not only will parallel attempts be economically feasible, but they could become the standard way we get a high success rate when working with LLM-based agents. While this demo used a simple bug and app, the low cost and automation potential suggest this “Waste Inferences” / Agent Cluster approach could absolutely scale to more complex scenarios especially as models and tooling improve.
Or read this on Hacker News