Ears may be too close to the jaw The closer your ears are to your jaw, the closer they are with the TMJs. This means that simple movements like talking or chewing can alter the size and shape of your ear canal. These movements and changes in the ear can wiggle the earbuds out of place, causing them to fall off.