Remove old alert and move to notify middleware.