What to do if a scammer has your phone number. If the worst happens and a scammer gains access to your phone number, you still have options: Contact your service provider immediately and explain the situation. If need be, ask them to put a temporary freeze on your line so that scammers can't use your number.