Hybrid Search
Hybrid search runs dense and sparse engines in parallel and merges the results:
- dense understands semantics but misses keywords;
- sparse matches exactly but doesn’t understand synonyms.
Merging is normalized weighted sums or RRF (Reciprocal Rank Fusion, uses only ranks).
Then neural cross-encoder re-ranking: query and document are fed together, the model compares word-by-word – slower but much more accurate than bi-encoder.
No single strategy is reliable in all scenarios on its own.
Related: Dense Embedding, Sparse BM25 Search, RAG