Only stop the propagation on hover if whitelisted