Termsslug: late-arriving-data

Late-Arriving Data

迟到数据

Streaming records whose event time precedes processing time and arrive after window closure.

Curated Intelligence

1 items · Page 1/1
Hacker News AIT2·Tools
72 pts
Aggregates as Functions Not Sums in ClickHouse Reporting

The author recounts four attempts at building real-time sales-receipt reports on Kafka and ClickHouse, showing that at-least-once delivery duplicates and late-arriving backlog break any aggregate defined as a running sum of inserts. The fix is to treat an aggregate as a function over its document set, so duplicates and late documents trigger recomputation instead of manual correction.