Ensure that walks through empty directories finish