Yes and no. The Apple Pay system will keep a transaction history on your device, but only on your device. When you pay for something or send someone money, Apple does not store any information from the transactions that can be tied back to you. Apple is one of the few large companies that do take steps to give their users as much privacy as possible.