Possibly fix delay/lag issue

Do handle all events!
This should fix https://github.com/jonls/freeserf/issues/50