Get the latest tech news
Why Some AI Models Spew 50 Times More Greenhouse Gas to Answer the Same Question
It's possible for you to make your LLM use "greener," according to new research.
Researchers from the Hochschule München University of Applied Sciences in Germany evaluated 14 LLMs ranging from 7 to 72 billion parameters—the levers and dials that fine-tune a model’s understanding and language generation—on 1,000 benchmark questions about various subjects. “The environmental impact of questioning trained LLMs is strongly determined by their reasoning approach,” study author Maximilian Dauner, a researcher at Hochschule München University of Applied Sciences, said in a statement. “Users can significantly reduce emissions by prompting AI to generate concise answers or limiting the use of high-capacity models to tasks that genuinely require that power,” Dauner said in a statement.
Or read this on r/technology
