Get the latest tech news
Show HN: Shoehorn – Quantize any model down to run on your machine
Solves a per-tensor quantization that uses 99.99% of your exact VRAM budget — every spare megabyte spent where it buys the most quality. macOS, Linux, and Windows.
None
Or read this on Hacker News
