Yes, there are records that you’ve made transactions with it on your bank statement, but for privacy and anonymity reasons, these transactions are marked as check payments, so no one can know where you actually spent your money.