A VPN is there to protect your device, and so you can remain anonymous. Apps always keep transferring data to and fro, which can mean that your private information can also go in and out. Keeping your VPN turned off can do more damage than good.