It is unlikely for someone to enable call forwarding and add a phone number without having physical access to your phone. However, it is always recommended to protect your personal phone and maintain its security to prevent unauthorized access.