tested the crawler, it seems to work