If using a free or overloaded VPN provider, often. If using a more reputable provider that prioritizes speed and latency, almost never.