Updates for v0 of the crawler