SPARK-1729. New Flume-Spark integration.

Made the Flume Sink considerably simpler. Added a lot of documentation.