Fix view flicking between fovs while spectating