Most people with hay fever are allergic to grass pollen, but it can also be caused by trees and weeds. Research suggests that pollution, such as cigarette smoke or car exhaust fumes, can make allergies worse.