Thin out the SDL events to be actually responded to