Do not try to remove a non-existing path