Patent ID: 8487888
Filing Date: 2013-07-16
Classification: G06F

Abstract:
1. On a computing system comprising a multi-touch display, a method of multi-modal interaction, the method comprising: displaying on the display a first content item and a second content item; recognizing a hand posture of a user's first hand directed at the display; displaying on the display a modal region based on the hand posture, the modal region defining an area on the display at a first location on the display based upon a location of the hand posture; applying a mode to the modal region, the mode indicating a family of functionalities to be associated with the modal region and defining a mapping of one or more touch gestures to one or more corresponding actions associated with the mode; while the modal region remains displayed, recognizing a first touch gesture interacting with the first content item within the modal region at the first location on the display; performing a first action on the display based upon a mapping of the first touch gesture to the first action:, detecting a change in the location of the hand posture; in response, displaying a movement of the modal region to a second location on the display such that the modal region moves over the second content item; recognizing a second touch gesture interacting with the second content item within the modal region at the second location on the display; and performing a second action on the display based upon a mapping of the second touch gesture to the second action.