If you remove your belly button piercing jewelry, the hole may close up. However, this depends on how long the piercing has been and how quickly your body heals.