Typically, cancer cells form in the ducts and grow outside the ducts invading the breast tissue.