If they don't react in a way you expect, stop and don't push it harder. Either they found it offensive, weren't in the mood, or didn't get it - all of these could lead to social disaster. Apologize if you have to, and try to change the subject. Redeem yourself by using other icebreakers and conversation starters. Remember, you can always try again.