Correctly trigger hover class removal.