Only try to scan the children of directories