You should try ice packs, baking soda baths, and fever-reducing medication. Skin lumps caused by injury usually fade on their own as the swelling goes down. Applying an ice pack and elevating the area can reduce inflammation and ease pain.