added max store size to crawl to throttle when exceeded