If you added the phone number anyone has in their contact number's list, he could find your personal Instagram account. In fact, if you've marked your number as private, however, it will be a finding source for anyone.