Apply cold compress to the area if the small red bumps are causing you any discomfort. Pack a few ice cubes into a plastic bag to make an ice pack. Seal the bag and place it on the affected skin for several minutes.