Remove unused code

Card emphasis on highlight hover isn't supported by the sidebar
right now and we no longer disable annotating in the sidebar.