CMake: Remove non-existing directory