added handling for hdfs files
removed solr dependency
fix fs construction
hdfs now works