shell-sed&awk ;hadoop-hbase,mahout,solr