No, releasing sperm does not affect muscle growth. Testosterone is responsible for assisting in muscle build-up by synthesizing protein. It is true that you lose protein when you ejaculate. However, the important part is that this amount is negligible and has no effect whatsoever on the building up of your muscle mass.