final version of the twitter crawling and functional + comments about exceptions catching