Get the latest tech news

Reverse-engineering the RK3588 NPU: Hacking limits to run vision transformers

Reverse-engineering the Rockchip RK3588 NPU to run SmolVLM 15x faster by discovering hardware limits, defeating compiler optimizations, and building a custom sharding runtime

None

Get the Android app

Or read this on Hacker News

Related news:

China's global technology and engineering ascendancy continues

In-Depth: The Engineering Behind Apple's 3D-Printed Watch Cases

Agentic AI is all about the context — engineering, that is

« Racks of AI chips are too damn heavy | Old data centers physically cannot support rows and rows of GPUs, which is one reason for the massive AI data center buildout.

Waymo Seeking Over $15 Billion Near $100 Billion Valuation »