When you give your credit card number over the phone, you have the same protections available as you would if you entered it online or swiped it at a store. The Fair Credit Billing Act limits your personal responsibility for fraudulent charges to $50, no matter how your credit card was used.