What's physically displayed will switch, but if you switch back it'll be the new evs. This only renders on the relevant "tab" for that pokemon.