For landlines, dial *69 (or what is known as Last Return Call) to automatically call back the last number that called you. On a mobile phone, dial #69. Keep in mind that your phone provider may set a time limit in calling back a number, typically within 30 minutes of the last call.