If it wobbles around on your head it can shift in the wind, will not protect you in an accident, and may even come off. If this is the way your too-loose helmet fits, you should not wear it. Go find a helmet that actually fits you.