testing the queue
crazy refactor...
fixing crawler bugs
testing the crawler; things are looking up