Perplexity has shifted its search infrastructure from Amazon DynamoDB to CobbleDB, a custom key-value store written in Rust. This migration was designed to handle large document batches more efficiently, resulting in a fivefold reduction in query latency. The move also lowered cloud storage costs while maintaining high throughput for production traffic.
- CobbleDB is a homegrown Rust key-value store replacing DynamoDB for search workloads.
- Query latency dropped by 5x after migrating away from managed DynamoDB.
- Cloud storage expenses were reduced through more efficient data handling.
- The architecture supports high query volumes with improved efficiency.