Termsslug: tail-latency

Tail Latency

尾延迟

Latency metric representing the slowest portion of request response times

Curated Intelligence

2 items · Page 1/1
InfoQ 中文T2·Infra
78 pts
Perplexity Replaces DynamoDB with Rust-based CobbleDB for LLM Search

Perplexity migrated its core search service from Amazon DynamoDB to CobbleDB, a custom Rust-based distributed key-value store, to address latency and cost bottlenecks in high-throughput LLM retrieval. By decoupling persistent storage from the hot data layer, the team achieved a fivefold reduction in batch read latency and cut storage costs by at least 20%. The system was built in two months by two engineers working with AI coding agents and is planned for open-source release.