Remove key modifiers in KeyboardInput

~~Needs testing on x11 and cocoa~~
Win32 and x11 are working, needs testing on cocoa