It's just as safe as logging into your bank account via a browser or app. It's always important to use a strong password for your bank account that you don't use anywhere else.
Plus, make sure you have a screen lock in place to protect your Google Pay app from unauthorized access.
If you're only using Google Pay to track your spending versus as a digital wallet, you might want to try a budgeting app like Ivy Wallet instead.