Close alert when retry

Regression added by refactor