Simple indexing using lucene on spark.
- create index from rdds of sources/doc
- after indexing store the segment files to hdfs