If someone is in the car with you and they have contraband on them, they may drop it under their seat and suddenly it's your contraband!
I'd say 50% of the people arrested during a traffic stop and subsequently charged with a drug felony are arrested as a direct result of allowing a search.