Get the latest tech news
This tool estimates how much electricity your chatbot messages consume
A Hugging Face engineer has built an open source tool to help estimate how much energy AI chatbot models consume.
It’s not easy to pin down model power consumption, but it’s widelyexpected that growing usage of AI technologies will drive electricity needs to new heights in the next couple of years. “Even small energy savings can scale up across millions of queries — model choice or output length can lead to major environmental impact,” Delavande and the tool’s other creators wrote in a statement. Delavande’s tool is designed to work with Chat UI, an open-source front-end for models like Meta’s Llama 3.3 70B and Google’s Gemma 3.
Or read this on TechCrunch
