Improvements to micro-crawler, added new test site