No. Having sex adds health benefits to your life, but absence of sex doesn’t “take those benefits away.” But this depends. People who replace a lack of sex in their life with other sources of emotional, mental, or physical satisfaction— such as spirituality, therapy, exercise (like going to the gym), nutrition, and healthy relationships— can be (and are) just as healthy as people who have sex regularly or even more on average.