Fix crawler bug

Crawler will now scan the root index, this was skipped before.