Core/Phases: fix logic in SetInPhase()
- we should not remove the terrain swap if another phase still use it