Add alert message, yes and cancel buttons when removing support
Close #57