SPARK-1729. Make Flume pull data from source, rather than the current push model

Added support for polling several Flume agents from a single receiver.