Add ability to remove menus

Closes #3216