Sarkashi
Your understanding is right. Since there is no direct directive for smoking therefore people do not thing it is a sin. In this case their remorselessness is not like the remorselessness of sinner who knows God has forbidden a sin he is committing.