If the infection has caused a collection of pus (an abscess) to form, it might go away, but typically this requires draining by a medical professional. Any lump that persists or grows over time should be seen by a medical provider.