宝玉 (@dotey)T2·78 pts
- Server-side context caching reduces median request size from 800KB to 1.8KB and cuts time-to-first-token by ~35%.
- Pricing model remains unchanged; costs are still based on standard token rates, optimizing network transfer rather than compute.
- Threads expire after 5 minutes and do not support Zero Data Retention (ZDR), requiring local maintenance of full records for reconstruction.