Breast abscesses feel like a lump under the skin; however, it is not just a lump. The tissue of the breast starts to decay when there is an infection. This destroyed tissue then forms a sac underneath the skin which starts to fill up with pus. If left untreated, more tissue may be destroyed and the pus-filled lump may continue to grow.