cleaned up some annoying poop in the crawler, added a dictionary