Sure, the natal teeth should be removed while the newborn infant is still in the hospital if they are loose. Most often, this procedure is done when the tooth is loose and the baby is at risk of inhaling the tooth. Several studies report that aspirating or ingesting natal teeth is a reason for removing loose teeth.