Add close button to alert.