Though it’s uncommon, men can be diagnosed with breast cancer. The main reasons that breast cancer is more common in women is because 1) women have more fully formed breast tissue including milk-producing glands, the most common site where breast cancer begins and 2) breast cells in women are exposed to higher levels of the hormones estrogen and progesterone, which are important for the growth of breast tissue but can also stimulate the growth of breast cancer cells.