Get the latest tech news
14× faster embeddings: how we rebuilt the ONNX path in Manticore
Released in Manticore Search 27.1.5, the new ONNX Runtime backend makes auto-embeddings ~14× faster on average than the previous SentenceTransformers/Candle path on the same hardware, same model, same weights — and the margin holds whether you run 1 client thread or 32.
None
Or read this on Hacker News
