Point of View

Streaming has a silence problem.

When a Kafka partition goes quiet, is it done or just slow? Netflix, Uber, and Walmart each trade something to handle it. Reading Kafka's offsets instead turned a 30-minute sort into <100 ms and 5.5% out of order into 0 — in one job.