added code for indexing twitter data set
add functionality to main function for indexing