apache/storm — pull request #272 by viktortnk (2014-09-27 14:25:03+00:00)
Title: STORM-511 update startOffset in PartitionManager when submitted in fetch...

... request one is out of rangeWith default behaviour (KafkaConfig.useStartOffsetTimeIfOffsetOutOfRange == true) when Kafka returns the error about offset being out of range, storm.kafka.KafkaUtils.fetchMessages tries to fix offset in local scope and retry fetch request. But if there are no more messages appeared under that specified partition it will never update the PartitionManager, but keep sending tons of requests with invalid offset to Kafka broker. On both sides Storm and Kafka logs grow extremely quick during that time.