Tea tree oil may also : ease redness and irritation around the piercing. shrink papules, pustules, and other bumps. prevent keloids and other scar tissue from forming.