Updated mapper to keep crawling directories that have been found in the map