Only load envdir if the path is a dir.