Yes, it is possible to transmit the herpes simplex virus even when the cold sore is not visible. The virus can be present in the skin cells and fluids even without any obvious signs. It is important to take precautions to prevent the spread of the virus, especially in situations like swimming or close physical contact with others.