If you find the nest (which might be cleverly hidden), rescue the bird immediately as you can. Please don’t be alarmed; parent birds cannot let their babies apart solely on their fragrance.
They would not abandon a baby that has had interaction with people.” So let the cute ones alone while reintroducing the small dumpy ones into the nest.