Yes, swollen adenoids can cause infections in the ear and sinus. Hearing can get affected if the middle ear fluid is infected. While this hearing loss is usually temporary, you should still seriously consider surgery to have the adenoids removed if they are getting infected often.