Fix some xinput events getting dropped