Remove the gray bg from annotation cards on hover

As discussed in #1634