Add alert button to sidebar.