If privacy is what matters to your the most, you should leave the VPN ON all the time.