Cleanup recursive Crawler

Bugs removed and router function streemlined. In addition added
callback to router for errorhandling.