Yes, your ping time could go up with a VPN server. However, you can minimize this by choosing a server that is very near the Valorant server.