Bi-Encoder

Bi-Encoder processes query and document independently into vector embeddings, allowing document vectors to be pre-indexed for fast sub-second nearest neighbor search across massive corpora, though at the expense of missing fine-grained token-level cross interactions.