Initial checkin.

With the help of a colleague I finally figured out how to push to github. So now there are two (identical) sets of changes that add the crawler. Can you sort this out? It's probably some special kind of null merge. Sorry. :-(