Get the latest tech news
You can now run the most powerful open source AI models locally on Mac M4 computers, thanks to Exo Labs
To further support adoption of local AI solutions, Exo Labs is preparing to launch a free benchmarking website next week.
For enterprises working in highly regulated industries, or even those simply conscious of cost, who still want to leverage the most powerful AI models — Exo Labs’ demoes show a viable path forward. Cheema, a University of Oxford physics graduate who previously worked in distributed systems engineering for web3 and crypto companies, was motivated to launch Exo Labs in March 2024 after finding himself stymied by the slow progress of machine learning research on his own computer. The site will provide detailed comparisons of hardware setups, including single-device and multi-device configurations, allowing users to identify the best solutions for running LLMs based on their needs and budget.
Or read this on Venture Beat