Crawler generator working again, added test to prevent regressions in future