Most cases of inverted nipples are congenital – some people are just born that way. However, some nipples become inverted after breastfeeding when scar tissue builds in the milk ducts. Nipples that become inverted after birth are usually caused by one of three things: not enough skin at the base of the nipple, constricted milk ducts, or scarring of the milk ducts due to breastfeeding.