No. To be spiritual, you do not need to become a hermit and live in the mountains away from society. You can indulge in worldly pleasures as long as you do not become attached to them and chase after them. This attachment will hinder your progress on the spiritual path.