Prevent showing exit message twice

Ref: #51

@stephenplusplus Do you have a better idea for this?