Fix remove throttled event handlers on destroy