Add failsafe to avoid flickering due to spurious out events

- On certain pages I actually get more out events than I do over events;
  drop still works fine, but I get lots of flickering on the page.  With
  this change as long as those events aren't slower than 50ms it doesn't
  happen, but 50ms is still short enough it's not really noticeable.