It's a matter of respect for liberty and private property rights. Let's look at it. The most rabid anti-smoker probably wouldn't demand laws outlawing cigarette smoking within one's own home or car. He might buy the argument that since homes and cars are private property, a person has a right to decide how they'll be used. But that points up a logical inconsistency of cigarette prohibitionists who allege a concern for health.
Cigarette smoke in a house produces secondhand smoke just as it does in an office, mall or airplane.
House guests and family members of smokers breathe secondhand smoke. Therefore, if the health of others is the concern of anti-smokers, they ought to demand laws banning smoking even in private homes. You're right but the cigarette tyrants better not make the same response. If they do the logic of their health argument begins to crack or their totalitarian agenda to outlaw tobacco altogether is exposed. Like a home, restaurants and airplanes are also private property.