Marktechpost (@Marktechpost)T2·78 pts
- LEANN uses pruned graphs and product quantization codes, performing GPU-batched re-embedding only on search path nodes for extreme compression.
- On a 76GB Wikipedia corpus, LEANN requires only 4GB RAM compared to 188GB for HNSW, maintaining comparable accuracy on the Natural Questions dataset.
- The key trade-off is retrieval speed: LEANN averages 2.48 seconds per query versus 0.05 seconds for HNSW, making it unsuitable for low-latency real-time apps.