If you stop taking hormones you may lose your hair faster than if you hadn't taken hormones. You may lose muscle and strength in your upper body. Your skin may become softer. Your body will make less testosterone.