If you want to sustain a happy relationship with your spouse, you're going to have to start telling them the truth at some point. Tell them directly and tell them kindly.
Every adult is entitled to a history.
The more you are able to be honest with each other, the greatest your chances of human happiness. But it requires real discretion and real understanding of one another to decide how far back in your history you should go. Obviously you've had a life before you met one another, and you might not want to discuss what you got up to with the dinosaurs. It depends where he tells you. If it's outside the store, you should certainly discourage him and make your disapproval clear, but it is not your obligation to call the cops.