Removing the piercing may help reduce irritation and inflammation, but it may not make the bump disappear. Sometimes, scar tissue may form even after the piercing is removed. Consulting with a healthcare professional for proper diagnosis and treatment is important.