If you cast Haste, after you are already in Difficult Terrain, you would treat your movement as Normal because Haste doubles your movement speed.