apache/spark — pull request #1356 by uncleGen (2014-07-10 12:43:38+00:00)
Title: Bug Fix: LiveListenerBus Queue Overflow

As we know, the size of "eventQueue" is fixed. When event comes faster than consume speed of listener, overflow events will be thrown away with throwing an "logQueueFullErrorMessage'. As a result, we find spark UI in chaotic state. In my Strategy, those overflow events are "cached" in "blockManager" first , and replayed by "replayThread" when "eventQueue" is free. The unique drawback is some display delay in Spark UI. But it is better than event loss. This delay will disappear when event stress alleviates.