created package for indexing code and updated requirements.txt
Added new files removed unnecessary languages from schema.xml
decompressing  article before indexing
added html tag stripper to text_general and text_pt
More improvements to the schema
improved schema and fixed bug on doc_manager
improved schema and fixed bug on doc_manager
update schema.xml to one that actually works
update schema.xml to one that actually works
started integration of solr uploading in Downloader
More improvements to the schema
fixed bug in solr_doc_manager and fixed uploading of documente via mongo-connector.
removed debugging code
finished script for initial loading of collections into Solr;
Changed Googlescraper and googlerss to allow filtering of sources by language.
added an extra argument to googlerss to specify filtering strategy: by language or by TLD
fixed bug
fixed bug in indexing articles as they are downloaded
implemented different Solr cores for articles and feeds.
implemented different Solr cores for articles and feeds.
simplified the if-else clause