If the notebook you want to delete is set as default, the delete option will be grayed out. Set another notebook as default, then the option to delete will be available.