You don't have to. A factory reset does not affect your SIM card. But, it does affect your call logs.