Check for keydowns AND keyups for user interaction