The to_python method of the phone number field should return None in case the phone_number is left empty, and only the prefix and the extension were completed. By doing so the international phone number validation is skipped when the field is not required.