Changes to let crawlers advance beyond the first state