Add button to create an alert in toolbar