High-throughput processing of kafka messages with support for at-least-once delivery