Get the latest tech news

Why BM25 queries with more terms can be faster (and other scaling surprises)


I analyzed how BM25 query latencies scale with document count and top_k. Longer queries scale less efficiently, and essential terms impact performance in some surprising ways.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of terms

terms

Photo of bm25

bm25

Photo of scaling surprises

scaling surprises

Related news:

News photo

"We write to ask that you enforce your app stores' terms of service against X" [pdf]

News photo

Democrats ask Apple and Google to remove X’s undressing bot from their app stores / Grok’s nonconsensual deepfakes violate the app stores’ terms of service, the senators argue.

News photo

The Origin of the Terms Big-Endian and Little-Endian (2003)