Surround dir deletion with try catch, no need to fail the configuration on this