If your ear canal is 'too big,' then there's nothing for the earbuds to sit against, so they'll fall out very easily,” Dr. Voigt. “And if the ear canal is 'too small,' the earbud won't be able to go in deep enough to fit properly, so it can pop out.