follow your heart.
Sex dolls don't get pregnant and don't transmit viruses (unless you use a sex doll with other people),
you can go without a condom, and that's okay if you prefer condoms.