Working again.
I abstracted the parser from the crawler.  This will allow us to integrate the robots controller in a very simple manner.