Add mock web server test to crawler, update gems