Get the latest tech news
Hugging Face: 5 ways enterprises can slash AI costs without sacrificing performance
Ultimately, model makers and enterprises are focusing on the wrong issue: They should be computing smarter, not harder.
Adopt “nudge theory” in system design, set conservative reasoning budgets, limit always-on generative features and require opt-in for high-cost compute modes. The “canonical example,” Luccioni noted, is adding cutlery to takeout: Having people decide whether they want plastic utensils, rather than automatically including them with every order, can significantly reduce waste. Instead of chasing the largest GPU clusters, begin with the question: “What is the smartest way to achieve the result?” For many workloads, smarter architectures and better-curated data outperform brute-force scaling.
Or read this on Venture Beat
