Treatment options for engorged armpits include cold compresses, limited touching of the armpit tissue, frequent feeding of the baby, and seeking medical treatment if there are signs of infection. Time will also help with engorgement, as the body will adjust to the demand for milk.