working tests and better twitter scraper