fix crawling agent set
remove require_tree for production bug