Get the latest tech news

Meta's Next Llama AI Models Are Training on a GPU Cluster 'Bigger Than Anything' Else


Meta CEO Mark Zuckerberg laid down the newest marker in generative AI training on Wednesday, saying that the next major release of the company's Llama model is being trained on a cluster of GPUs that's "bigger than anything" else that's been reported. From a report: Llama 4 development is well under...

Meta CEO Mark Zuckerberg laid down the newest marker in generative AI training on Wednesday, saying that the next major release of the company's Llama model is being trained on a cluster of GPUs that's "bigger than anything" else that's been reported. From a report: Llama 4 development is well underway, Zuckerberg told investors and analysts on an earnings call, with an initial launch expected early next year. While Meta appears to have the lead now, most of the big players in the field are likely working toward using compute clusters with more than 100,000 advanced chips.

Get the Android app

Or read this on Slashdot

Read more on:

Photo of Meta

Meta

Photo of Models

Models

Photo of Llama

Llama

Related news:

News photo

Meta is making a robot hand that can ‘feel’ touch

News photo

Meta’s Reality Labs posts $4.4 billion loss in third quarter

News photo

Mark Zuckerberg Has Stopped Talking About Meta’s Election Plans