Make hover less sticky by following the cursor on changes, and simplify

Now we don't check for the previously displayed set of annotations,
just hide and show again.