Add an option to support crawling