Fix getEventModifierState, no allocations

Alternative to #1637 that doesn't allocate on every event.

Test Plan: Crossed fingers.