Get the latest tech news

My iPhone 16 Pro Max produces garbage output when running MLX LLMs

TL;DR: My iPhone 16 Pro Max produces garbage output when running MLX LLMs. An iPhone 15 Pro runs the same code perfectly. A MacBook Pro also runs the same code perfectly. The tensor outputs on the 16 show numerical values an order of magnitude wrong. I suspect it points

None

Get the Android app