Get the latest tech news
From grep to SPLADE: a journey through semantic search
Full-text search, BERT, embeddings, query expansion, and more—what an app developer needs to know about modern search technologies.
If you’ve attempted to implement it in your app, you may have discovered that what seems simple on the surface is a deeply challenging technical problem that has kept the brightest minds in computer science busy for decades. Rather than processing each word independently, the text is split into chunks and fed as a sequence into the LLM, allowing the model to perceive the richer semantics woven into our languages. The nature of most embedding models (and efficient dense vector search algorithms) means that—if you’re not careful—the same query could produce different results between runs.
Or read this on Hacker News
