Source: http://www.google.com/patents/US20070120834
Timestamp: 2016-07-24 22:42:57
Document Index: 83994925

Matched Legal Cases: ['art 400', 'art 400', 'art 400', 'art 400', 'art 400', 'art 400']

Patent US20070120834 - Method and system for object control - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsA system (111 ) and method (200) for providing sensory feedback (210) for touchless feedback control is provided. The system can include a touchless sensing unit (110) that detects at least one position (304) of an object in a touchless sensing space (300), and an indicator (166) communicatively coupled...http://www.google.com/patents/US20070120834?utm_source=gb-gplus-sharePatent US20070120834 - Method and system for object controlAdvanced Patent SearchPublication numberUS20070120834 A1Publication typeApplicationApplication numberUS 11/562,413Publication dateMay 31, 2007Filing dateNov 21, 2006Priority dateNov 29, 2005Also published asUS7834850Publication number11562413, 562413, US 2007/0120834 A1, US 2007/120834 A1, US 20070120834 A1, US 20070120834A1, US 2007120834 A1, US 2007120834A1, US-A1-20070120834, US-A1-2007120834, US2007/0120834A1, US2007/120834A1, US20070120834 A1, US20070120834A1, US2007120834 A1, US2007120834A1InventorsMarc BoillotOriginal AssigneeNavisense, LlcExport CitationBiBTeX, EndNote, RefManPatent Citations (12), Referenced by (146), Classifications (4), Legal Events (4) External Links: USPTO, USPTO Assignment, EspacenetMethod and system for object control
[0050] Referring to FIG. 9, a flowchart 400 for activating a cursor object is shown. When describing the flowchart 400, reference will be made to FIGS. 1, 2, 7 and 8, although it must be noted that the flowchart 400 can be practiced in any other suitable system or device. Moreover, the steps of the flowchart 400 are not limited to the particular order in which they are presented in FIG. 9. The flowchart 400 can also have a greater number of steps or a fewer number of steps than those shown in FIG. 9. [0051] At step 401, the flowchart can begin. At step 402, a movement can be detected. For example, referring to FIG. 1, a user typing at the keyboard 100 can temporarily pause from typing and raise a finger, such as the right finger 187, within the finger space region 300. The sensing unit 110 awaits an ultrasonic signal reflection, and upon receipt, the detector 112 detects a finger movement. The detector 112 can also detect finger movement for the laptop 150, the headset 230, and the mobile device 240 embodiments. At step 404 an activation within a first boundary can be evaluated. Recall from FIG. 7, that the sensing space can include a plurality of boundary regions each associated with a sensory feedback effect. The first boundary can correspond to any one boundary within the sensing space. For example, referring to FIG. 1, the detector 112 determines if the finger 187 is located at a position within a first boundary 304 of the sensing space. Notably, the sensing unit 110, when using ultrasonic pulse echo detection, provides an estimate of the finger location by solving a set of geometric equations using multiple range measurements. The detector 112 assesses whether the location of the finger determined by the sensing unit 110 is within an activation range (e.g. boundary or banded region). For example, referring to FIG. 8, the first boundary 304 corresponds to an elliptical boundary sufficiently close to the sensing unit 110. The far elliptical boundary 314 can be up to 10 inches away from the sensing unit 110. Each point within the boundary can be described by a three dimensional (x,y,z) point. Alternatively a plane within the elliptical region can be described by a two dimensional point (x,y). For example, referring to FIG. 7, a planar slice of a series of concentric elliptical boundary regions are shown. The user can raise a finger within the center ellipse 304 to generate an activation cue. Notably, each point along a principal axis is described by a TOF. Accordingly, a TOF uniquely describes a position that can be identified as falling within or outside of a boundary region. For example, referring back to FIG. 8, a first boundary can correspond to a radius of approximately 1 inch from the sensing unit 110 though is not limited to this range. Accordingly, when a user positions a finger 302 within the first boundary region 304, the sensing unit 110 detects movement and the detector 112 identifies an activation cue. Notably, the activation cue includes a temporal attribute to ensure that an activation cue was intentional. For example, the timer 114 sets a time length of 1 second such that the detector 112 associates the finger placement with an activation cue. The time length can be pre-specified and can vary in accordance with a user preference. For example, the user may position the finger within 1 inch of the sensing unit for a time length of 1 second, thereby satisfying the first boundary position criterion. The user leaves the finger within the first boundary region for at least 1 second before the detector 112 identifies the movement as an activation cue. [0052] At step 406, a control can be enabled if an activation cue is identified. For example, referring to FIG. 3, the user positions the finger 302 within the first boundary region 304 for a pre-specified amount of time to create the activation cue, i.e. the user intentionally positions the finger within a particular region for a pre-specified amount of time to take control of the cursor for moving the cursor 124 on the display 122. If the detector 112 determines that the finger is within the correct region (e.g. the first boundary 304 of the sensing space 300) and the timer 114 determines that the finger positioning has satisfied the time requirements of an activation cue, the feedback unit 116 enables a navigation control. When the sensing unit is an arrangement of ultrasonic transducers, the sensing unit 110 determines a position of the finger using time of flight (TOF) measurements. For example, an activation cue can be specified as the placing a finger 302 at the center position of the sensing unit for at least one second. Notably, with a transmitter (TX) 342 and receiver (RX) 342 pair on the left, and a transmitter (TX) 342 and receiver (RX) 343 pair on the right the TOF is the same for the left pair and the right pair if the TX/RX pairs are symmetrically placed with respect to the center of the sensing element 110. Notably, the TOF increases as the finger moves away from the sensing unit 110 since the transmitted pulse must travel a farther distance. Accordingly, the finger can be identified within a first boundary region when the TOF satisfies a range associated with the first boundary region, and within a second boundary region when the TOF satisfies a range associated with the second boundary region. [0053] When the detector 112 identifies an activation cue, the controller 125 (FIG. 1) enables a navigation control of the cursor 124 on the display 122. The flowchart for controlling sensory feedback 400 can operate together with a cursor control such that control of the cursor is granted when an intentional action, such as an activation cue, is initiated to assume control of the cursor. Understandably, a sensing unit that moves the cursor 124 in accordance with a finger movement, and having no control mechanisms, would continually move the cursor as the user is typing. The sporadic movement of the cursor while the user is interfacing with a computer may be considered an annoyance by a user. In practice, a user does not generally navigate a cursor during normal the typing of text. An activation control method allows a user typing at the keyboard to take control of a cursor under an established control condition; that is, when the user intentionally gestures an activation cue, such as the positioning of a finger at a particular location for a pre-specified amount of time. Accordingly, the feedback unit 166 coordinates lighting effects with a cursor control based on the location of a finger within the sensing space (e.g. finger space region) such that visual feedback is provided to the user for navigating the cursor within the sensing space and controlling the cursor. [0054] The indicator 166 informs a user of the status of the activation cue. For example, the indicator 166 can be a light emitting diode (LED), light contrast display (LCD), a color stick, a software graphics display, or a voice responder for providing a visual or auditory cue back to the user. In the particular example of a LED, the LED lights up when the activation cue is detected. In another aspect, the intensity of the LED slowly increases as the time length approaches the pre-specified time length and begins to blink when an activation cue is detected. In another configuration the indicator 166 changes color as a function of an object's position. The indicator informs the user that the user can gain control of the cursor 122 thereby removing uncertainty as to when control is granted. [0055] For example, referring to FIG. 7, the sensing space 300 (e.g. finger space region) can have boundaries associated with different activation colors. For example, the center region 304 corresponds with the color green and the outer region 314 corresponds with the color red. Green can visually signify to the user that a control has been granted, such as navigational control of the cursor object. Red can visually signify to the user that control has been restricted, for example, when the user moves a finger outside the sensing space. The feedback unit 116 can slowly change the illumination from a first color to a second color by blending colors. For example, the colors can be adjusted on a continuous wavelength scale changing colors in accordance with a physical light spectrum. The feedback unit 116 can slowly decrease the illumination as a finger moves from a first boundary region to a second boundary region, and increase the illumination as the finger moves closer to a first boundary region. [0056] The center region 304 can correspond to an activation region for detecting an activation cue. For example, the first boundary region 304 is associated with a first illumination that visually signifies gaining control of a cursor object, and the second boundary region 314 is associated with a second illumination that visually signifies relinquishing control of the cursor object. Enabling navigation control at the center region 304 based on an activation cue allows a user to move the cursor in any direction with reference to the center position; up, down, right, left, and diagonal. The user can control the cursor within the sensing space until the user moves the finger outside the boundary 314 at which point the indication element changes to a red color. Other colors are contemplated within the embodiments of the invention. Navigation control is disabled and the user can move the finger back within the sensing space without the cursor moving from the position at which navigation control was disabled. The user reenters the finger to the region 304 without moving the cursor to assume navigation control. Notably, the user relinquishes control of the cursor when the finger exceeds a second predefined boundary region. Upon relinquishing control, the cursor stays at the last position when cursor control was granted, i.e., the cursor object is left at the last position where the finger had control of the cursor object. The navigation control is disabled until the finger initiates an activation cue within a first boundary region, such as 304. The detector 112 changes the color and/or intensity of the indication element 166 as the finger moves within the sensing space. Notably, the detector 112 can change color pattern having attributes such as blinking rate, contrast, hue, intensity and color as a function of the finger position. [0057] At step 408, a location and a time length can be identified. For example, referring back to FIG. 2, the finger can be positioned within a boundary of the sensing space for a pre-specified period of time. After the detector 112 identifies an activation cue the user can proceed to move the finger to control an object. Notably, the feedback unit 116 provides sensory feedback to the user to inform the user that control of the cursor object has been granted. The sensory feedback can be visual based for the laptop embodiment 150, audio based for the headset 230, and physical, visual, or audio for the mobile device 240. The finger can move around within the sensing space demarcated by a first boundary 304 and a second boundary 314 for controlling a cursor. During movement, the feedback unit 116 receives positional information of the finger within the sensing space. The feedback unit 116 converts positional information to illumination behaviors. For example, referring to FIG. 5, the feedback unit 116 can change the lighting patters when the finger moves between the first boundary 304 and the second boundary 314. [0058] The sensing unit 110 identifies a position of the finger within the sensing space and moves the cursor 124 in accordance with the coordinates calculated by the sensing unit 110. When the finger exceeds a second boundary the handle to the navigation control can be relinquished. Notably, the second boundary movement approximately represents the maximal extent of general finger movement when the hands are stationed in the normal typing position. Notably, the user can change the size of the sensing space to expand or compress the sensing space. For example the user may wish to extend the sensing space beyond a normal hand typing position. The user may want to elevate a hand and control the cursor rather than leaving the hands in a normal default typing position. Accordingly, the detector 112 determines if the user wants to change the sensing space after the activation cue has been detected. [0059] At step 410, a sensitivity of the sensing unit 110 can be adjusted based on the measured time and location. For example, the user can leave the finger within the first boundary region for a time period greater than the time length required in order to satisfy the activation cue for assuming control of the cursor. Notably, the detector 112 begins to expand the region the longer in time the user leaves the finger in the same position when at the location of the activation cue. The detector 112 can be manually configured to not adjust the sensitivity or extent of the boundary regions. The step of adjusting the sensitivity is optional. The detector 112 expands the sensing space by increasing the intensity of the transmitting pulse energy in the sensing unit 110. The higher the pulse energy, the greater the sensing space. Notably, the sensing unit, when activated, produces a transmit pulse with an energy level sufficient to cover the sensing space (i.e. 176 or 300). Accordingly, the sensing unit, when not-activated, reduces the transmit pulse energy such that movement within the sensing space does not produce a reflection of sufficient strength to be detected by the detector 112. In another arrangement, the sensing unit 110 includes a filter which keeps the detector 112 disabled unless an activation cue is received. The filter enables the detector 112 when an activation cue is detected and turns the detector 112 off when the finger leaves the sensing space. The indication element 166 indicates to the user that the sensing space is expanding (e.g. strength of transmitted pulse) either by increasing the blinking rate or changing the blinking style. When the user moves the finger away from the location of the activation cue (e.g. within the first boundary 304) the sensing space no longer changes. Accordingly, the user expands the sensing space by leaving the finger at the activation cue position longer. [0060] For example, a user positions a finger at the center 304 and the detector 112 checks for the location, and the timer 114 checks to ensure a time length is satisfied. During this wait period, the feedback unit 116 can blink the lighting element 166 and increase the rate of the blinking as the time of activation approaches. Upon expiration of the timer, with the finger still at the center 304, the feedback unit 116 changes the blinking pattern to a constant illumination. For example, the light can blink green during authentication of the activation cue and then change to a solid green. The user can identify the change in the visual stimulus as an acknowledgement that control of the cursor has been gained. Similarly, when the user desires to relinquish control of the cursor, the user can move the finger outside a second boundary. The feedback unit 116 can change the illumination, such as the blinking rate, intensity, or color, as the finger approaches the second boundary. Notably, the lighting element 166 changes illumination which provides visual feedback to the user that cursor control will be changed. [0061] At step 412, an activation outside a second boundary can be evaluated. For example, referring to FIG. 2, the user may move the finger 312 outside a second boundary 314. The second boundary can demarcate the maximal range of finger extent when the hand is at a normal typing position. When the finger is within the first boundary 304 and the second boundary 314, movement of the finger results in movement of the cursor 124. The user can move the cursor 124 in accordance with the finger movement when the finger is within the sensing space between the first boundary and second boundary. [0062] For example the feedback unit 116 enables an illumination behavior when a finger is within a first boundary region. The feedback unit 116 adjusting a light pattern of an illumination element as the finger moves within a sensing space. In one aspect, the lighting element 166 can emit a light pattern with sufficient intensity to produce a light pattern on a user's finger. For example, a lighting element positioned downwards on the fingers produces a light pattern on the top side of the finger. In one aspect, the light emitted is not seen until it causes a reflection on the user's fingers or hands. For example, referring to FIG. 2, a lighting element such as a laser pointing down on the keyboard will produce a pattern on the user's fingers. The light pattern provides visual feedback for controlling the cursor object. Notably, a plurality of lighting elements can be positioned circumferential to the sensing space such that trespassing a boundary produces a light pattern on the trespassing object. For example, the light pattern can be generated only when a boundary regions is crossed. Or, the light pattern can change as a boundary is crossed. In one arrangement, the feedback unit 116 disables an illumination behavior when a finger is within a second boundary region. The light pattern provides a visual indication of where the finger can be positioned to control cursory navigation. [0063] At step 414, control can be disabled. Referring back to FIG. 2, when the user moves the finger outside the second boundary 314, cursory navigation control ceases and the cursor remains at the last position when control was enabled. The user can the move the finger back in the sensing space between the first 304 and second boundary 314 without gaining control of the cursor, and hence, without moving the cursor. Understandably, this is beneficial because it allows the user to bring the finger back in the sensing space without moving the cursor from the last position. This action is a hysterics effect. Only when the user brings the finger back to within the first boundary region 304 (or band), does the detector 112 allow the user to regain control of the cursor. Accordingly, the user can resume control of the cursor at the last position thereby providing continuous movement of the cursor 124 around the display 122. [0064] It should be noted that the flowchart 400 for enabling sensory feedback for touchless control is one embodiment of the method. The method of sensory feedback can include identifying a location and movement of a first object and presenting a sensory feedback in accordance with a behavior of the object. For example, the method can include recognizing a movement, such as a finger sign or gesture, and changing a sensory feedback in accordance with the recognized gesture. [0065] The present invention may be realized in hardware, software, or a combination of hardware and software. The present invention may be realized in a centralized fashion in one computer system or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system or other apparatus adapted for carrying out the methods described herein is suited. A typical combination of hardware and software may be a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein. [0066] The present invention also may be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which when loaded in a computer system is able to carry out these methods. Computer program in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: a) conversion to another language, code or notation; b) reproduction in a different material form. [0067] This invention may be embodied in other forms without departing from the spirit or essential attributes thereof. Accordingly, reference should be made to the following claims, rather than to the foregoing specification, as indicating the scope of the invention. Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5274363 *Feb 1, 1991Dec 28, 1993IbmInteractive display systemUS6130663 *Jul 31, 1997Oct 10, 2000Null; Nathan D.Touchless input method and apparatusUS6137427 *Oct 27, 1998Oct 24, 2000Binstead; Ronald PeterMultiple input proximity detector and touchpad systemUS6313825 *Dec 28, 1998Nov 6, 2001Gateway, Inc.Virtual input deviceUS6937227 *Jul 14, 2003Aug 30, 2005Iowa State University Research Foundation, Inc.Hand-held pointing deviceUS7078911 *Feb 5, 2004Jul 18, 2006Cehelnik Thomas GPatent application for a computer motional command interfaceUS7081884 *Apr 25, 2003Jul 25, 2006Microsoft CorporationComputer input device with angular displacement detection capabilitiesUS7092109 *Jan 8, 2004Aug 15, 2006Canon Kabushiki KaishaPosition/orientation measurement method, and position/orientation measurement apparatusUS7130754 *Jul 16, 2004Oct 31, 2006Canon Kabushiki KaishaSensor calibration apparatus, sensor calibration method, program, storage medium, information processing method, and information processing apparatusUS20050088416 *Oct 22, 2003Apr 28, 2005Hollingsworth Tommy D.Electric field proximity keyboards and detection systemsUS20060161871 *Sep 30, 2005Jul 20, 2006Apple Computer, Inc.Proximity detector in handheld deviceUS20060256090 *May 12, 2005Nov 16, 2006Apple Computer, Inc.Mechanical overlay* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS7479949Apr 11, 2008Jan 20, 2009Apple Inc.Touch screen device, method, and graphical user interface for determining commands by applying heuristicsUS7646372Dec 12, 2005Jan 12, 2010Sony Computer Entertainment Inc.Methods and systems for enabling direction detection when interfacing with a computer programUS7663689Feb 16, 2010Sony Computer Entertainment Inc.Method and apparatus for optimizing capture device settings through depth informationUS7737944Jan 18, 2007Jun 15, 2010Sony Computer Entertainment America Inc.Method and system for adding a new player to a game in response to controller activityUS7760248Jul 20, 2010Sony Computer Entertainment Inc.Selective sound source listening in conjunction with computer interactive processingUS7770118 *Aug 3, 2010Research In Motion LimitedNavigation tool with audible feedback on a handheld communication device having a full alphabetic keyboardUS7782297Aug 24, 2010Sony Computer Entertainment America Inc.Method and apparatus for use in determining an activity level of a user in relation to a systemUS7803050May 8, 2006Sep 28, 2010Sony Computer Entertainment Inc.Tracking device with sound emitter for use in obtaining information for controlling game program executionUS7854655May 8, 2006Dec 21, 2010Sony Computer Entertainment America Inc.Obtaining input for controlling execution of a game programUS7874917Jan 25, 2011Sony Computer Entertainment Inc.Methods and systems for enabling depth and direction detection when interfacing with a computer programUS7880729Aug 4, 2006Feb 1, 2011Apple Inc.Center button isolation ringUS7883415Sep 15, 2003Feb 8, 2011Sony Computer Entertainment Inc.Method and apparatus for adjusting a view of a scene being displayed according to tracked head motionUS7910843Mar 22, 2011Apple Inc.Compact input deviceUS7932897Apr 26, 2011Apple Inc.Method of increasing the spatial resolution of touch sensitive devicesUS8022935Jul 6, 2006Sep 20, 2011Apple Inc.Capacitance sensing electrode with integrated I/O mechanismUS8035629Dec 1, 2006Oct 11, 2011Sony Computer Entertainment Inc.Hand-held computer interactive deviceUS8044314Oct 25, 2011Apple Inc.Hybrid buttonUS8059099Nov 15, 2011Apple Inc.Techniques for interactive input to portable electronic devicesUS8062126Oct 26, 2006Nov 22, 2011Sony Computer Entertainment Inc.System and method for interfacing with a computer programUS8072470May 29, 2003Dec 6, 2011Sony Computer Entertainment Inc.System and method for providing a real-time three-dimensional interactive environmentUS8125461Sep 5, 2008Feb 28, 2012Apple Inc.Dynamic input graphic displayUS8139793May 4, 2006Mar 20, 2012Sony Computer Entertainment Inc.Methods and apparatus for capturing audio signals based on a visual imageUS8142288May 8, 2009Mar 27, 2012Sony Computer Entertainment America LlcBase station movement detection and compensationUS8160269Apr 17, 2012Sony Computer Entertainment Inc.Methods and apparatuses for adjusting a listening area for capturing soundsUS8188968May 29, 2012Sony Computer Entertainment Inc.Methods for interfacing with a program using a light input deviceUS8209063 *Jun 26, 2012Research In Motion LimitedNavigation tool with audible feedback on a handheld communication deviceUS8233642Jul 31, 2012Sony Computer Entertainment Inc.Methods and apparatuses for capturing an audio signal based on a location of the signalUS8246456 *Jun 19, 2008Aug 21, 2012Wms Gaming Inc.Wagering game machine with virtual input deviceUS8251820Aug 28, 2012Sony Computer Entertainment Inc.Methods and systems for enabling depth and direction detection when interfacing with a computer programUS8274479Sep 25, 2012Apple Inc.Gimballed scroll wheelUS8287373Apr 17, 2009Oct 16, 2012Sony Computer Entertainment Inc.Control device for communicating visual informationUS8303411Oct 12, 2010Nov 6, 2012Sony Computer Entertainment Inc.Methods and systems for enabling depth and direction detection when interfacing with a computer programUS8310656Nov 13, 2012Sony Computer Entertainment America LlcMapping movements of a hand-held controller to the two-dimensional image plane of a display screenUS8313380May 6, 2006Nov 20, 2012Sony Computer Entertainment America LlcScheme for translating movements of a hand-held controller into inputs for a systemUS8323106Jun 24, 2008Dec 4, 2012Sony Computer Entertainment America LlcDetermination of controller three-dimensional location using image analysis and ultrasonic communicationUS8330061Mar 18, 2011Dec 11, 2012Apple Inc.Compact input deviceUS8342963Apr 10, 2009Jan 1, 2013Sony Computer Entertainment America Inc.Methods and systems for enabling control of artificial intelligence game charactersUS8350818 *Nov 13, 2009Jan 8, 2013Eric FritzleyTouch-sensitive display method and apparatusUS8368753Feb 5, 2013Sony Computer Entertainment America LlcController with an integrated depth cameraUS8393964May 8, 2009Mar 12, 2013Sony Computer Entertainment America LlcBase station for position locationUS8395590Jun 1, 2009Mar 12, 2013Apple Inc.Integrated contact switch and touch sensor elementsUS8411034 *Mar 12, 2010Apr 2, 2013Marc BoillotSterile networked interface for medical systemsUS8416198Apr 9, 2013Apple Inc.Multi-dimensional scroll wheelUS8432372Apr 30, 2013Microsoft CorporationUser input using proximity sensingUS8446370May 21, 2013Apple Inc.Touch pad for handheld deviceUS8482530Aug 21, 2007Jul 9, 2013Apple Inc.Method of capacitively sensing finger positionUS8514185Aug 1, 2007Aug 20, 2013Apple Inc.Mutual capacitance touch sensing deviceUS8519835 *Mar 2, 2011Aug 27, 2013Htc CorporationSystems and methods for sensory feedbackUS8527657Mar 20, 2009Sep 3, 2013Sony Computer Entertainment America LlcMethods and systems for dynamically adjusting update rates in multi-player network gamingUS8537108 *Oct 9, 2009Sep 17, 2013Research In Motion LimitedNavigation tool with audible feedback on a handheld communication device having a full alphabetic keyboardUS8537132Apr 23, 2012Sep 17, 2013Apple Inc.Illuminated touchpadUS8542907Dec 15, 2008Sep 24, 2013Sony Computer Entertainment America LlcDynamic three-dimensional object mapping for user-defined control deviceUS8545322Dec 6, 2011Oct 1, 2013Konami Gaming, Inc.Gaming machine with proximity sensing touchless displayUS8547401Aug 19, 2004Oct 1, 2013Sony Computer Entertainment Inc.Portable augmented reality device and methodUS8552990Aug 1, 2007Oct 8, 2013Apple Inc.Touch pad for handheld deviceUS8564544Sep 5, 2007Oct 22, 2013Apple Inc.Touch screen device, method, and graphical user interface for customizing display of content category iconsUS8570378Oct 30, 2008Oct 29, 2013Sony Computer Entertainment Inc.Method and apparatus for tracking three-dimensional movements of an object using a depth sensing cameraUS8599033 *Sep 4, 2009Dec 3, 2013Sony CorporationInformation processing device, information notification method and computer programUS8683378Jan 9, 2008Mar 25, 2014Apple Inc.Scrolling techniques for user interfacesUS8686939May 6, 2006Apr 1, 2014Sony Computer Entertainment Inc.System, method, and apparatus for three-dimensional input controlUS8743060Jul 6, 2009Jun 3, 2014Apple Inc.Mutual capacitance touch sensing deviceUS8749493Jul 30, 2007Jun 10, 2014Apple Inc.Movable touch pad with added functionalityUS8758132Aug 27, 2012Jun 24, 2014Sony Computer Entertainment Inc.Methods and systems for enabling depth and direction detection when interfacing with a computer programUS8781151Aug 16, 2007Jul 15, 2014Sony Computer Entertainment Inc.Object detection using video input combined with tilt angle informationUS8786553 *Oct 6, 2006Jul 22, 2014Kyocera CorporationNavigation pad and method of using sameUS8797260May 6, 2006Aug 5, 2014Sony Computer Entertainment Inc.Inertially trackable hand-held controllerUS8816967Sep 25, 2008Aug 26, 2014Apple Inc.Capacitive sensor having electrodes arranged on the substrate and the flex circuitUS8820133Sep 30, 2008Sep 2, 2014Apple Inc.Co-extruded materials and methodsUS8840470Feb 24, 2009Sep 23, 2014Sony Computer Entertainment America LlcMethods for capturing depth data of a scene and applying computer actionsUS8866780Apr 8, 2013Oct 21, 2014Apple Inc.Multi-dimensional scroll wheelUS8872771Jul 7, 2009Oct 28, 2014Apple Inc.Touch sensing device having conductive nodesUS8884171 *May 24, 2010Nov 11, 2014Luidia Inc.Pen transcription system with improved noise rejectionUS8902227Sep 10, 2007Dec 2, 2014Sony Computer Entertainment America LlcSelective interactive mapping of real-world objects to create interactive virtual-world objectsUS8907894 *Mar 25, 2010Dec 9, 2014Northridge Associates LlcTouchless pointing deviceUS8923562May 16, 2013Dec 30, 2014Industrial Technology Research InstituteThree-dimensional interactive device and operation method thereofUS8933805 *Apr 4, 2011Jan 13, 2015Controlled Entry Distributors, Inc.Adjustable touchless transmitter to wirelessly transmit a signalUS8933890Aug 1, 2007Jan 13, 2015Apple Inc.Techniques for interactive input to portable electronic devicesUS8949735Mar 1, 2013Feb 3, 2015Google Inc.Determining scroll direction intentUS8952886Dec 19, 2007Feb 10, 2015Apple Inc.Method and apparatus for accelerated scrollingUS8961313May 29, 2009Feb 24, 2015Sony Computer Entertainment America LlcMulti-positional three-dimensional controllerUS8976265Oct 26, 2011Mar 10, 2015Sony Computer Entertainment Inc.Apparatus for image and sound capture in a game environmentUS9009626Dec 19, 2007Apr 14, 2015Apple Inc.Method and apparatus for accelerated scrollingUS9177387Feb 11, 2003Nov 3, 2015Sony Computer Entertainment Inc.Method and apparatus for real time motion captureUS9335924Oct 17, 2013May 10, 2016Apple Inc.Touch screen device, method, and graphical user interface for customizing display of content category iconsUS9354751Sep 16, 2009May 31, 2016Apple Inc.Input device with optimized capacitive sensingUS9360967Jul 6, 2006Jun 7, 2016Apple Inc.Mutual capacitance touch sensing deviceUS9367151Jan 28, 2014Jun 14, 2016Apple Inc.Touch pad with symbols based on modeUS9381424Jan 11, 2011Jul 5, 2016Sony Interactive Entertainment America LlcScheme for translating movements of a hand-held controller into inputs for a systemUS9389715 *Nov 2, 2011Jul 12, 2016Samsung Electronics Co., Ltd.Display apparatus for sensing multi-touch and proximity objectUS20050157204 *Jan 16, 2004Jul 21, 2005Sony Computer Entertainment Inc.Method and apparatus for optimizing capture device settings through depth informationUS20060139322 *Feb 28, 2006Jun 29, 2006Sony Computer Entertainment America Inc.Man-machine interface using a deformable deviceUS20060274911 *May 8, 2006Dec 7, 2006Xiadong MaoTracking device with sound emitter for use in obtaining information for controlling game program executionUS20060277571 *May 4, 2006Dec 7, 2006Sony Computer Entertainment Inc.Computer image and audio processing of intensity and input devices for interfacing with a computer programUS20060280312 *May 4, 2006Dec 14, 2006Mao Xiao DMethods and apparatus for capturing audio signals based on a visual imageUS20060287087 *May 7, 2006Dec 21, 2006Sony Computer Entertainment America Inc.Method for mapping movements of a hand-held controller to game commandsUS20070015559 *Jan 18, 2007Sony Computer Entertainment America Inc.Method and apparatus for use in determining lack of user activity in relation to a systemUS20070021208 *May 8, 2006Jan 25, 2007Xiadong MaoObtaining input for controlling execution of a game programUS20070146339 *Jul 13, 2006Jun 28, 2007Samsung Electronics Co., LtdMobile apparatus for providing user interface and method and medium for executing functions using the user interfaceUS20070192026 *Jun 6, 2006Aug 16, 2007Research In Motion LimitedNavigation tool with audible feedback on a handheld communication deviceUS20070192027 *Jun 6, 2006Aug 16, 2007Research In Motion LimitedNavigation tool with audible feedback on a wireless handheld communication deviceUS20070192028 *Jun 6, 2006Aug 16, 2007Research In Motion LimitedNavigation tool with audible feedback on a handheld communication device having a full alphabetic keyboardUS20070192699 *Jun 6, 2006Aug 16, 2007Research In Motion LimitedNavigation tool with audible feedback on a handheld communication device having a reduced alphabetic keyboardUS20070223732 *Mar 13, 2007Sep 27, 2007Mao Xiao DMethods and apparatuses for adjusting a visual image based on an audio signalUS20070287541 *Aug 20, 2007Dec 13, 2007Jeffrey GeorgeTracking display with proximity button activationUS20070298882 *Dec 12, 2005Dec 27, 2007Sony Computer Entertainment Inc.Methods and systems for enabling direction detection when interfacing with a computer programUS20080084397 *Oct 6, 2006Apr 10, 2008Peter OnNavigation pad and method of using sameUS20080096654 *Oct 20, 2006Apr 24, 2008Sony Computer Entertainment America Inc.Game control using three-dimensional motions of controllerUS20080122796 *Sep 5, 2007May 29, 2008Jobs Steven PTouch Screen Device, Method, and Graphical User Interface for Determining Commands by Applying HeuristicsUS20080174570 *Apr 11, 2008Jul 24, 2008Apple Inc.Touch Screen Device, Method, and Graphical User Interface for Determining Commands by Applying HeuristicsUS20080220867 *May 15, 2008Sep 11, 2008Sony Computer Entertainment Inc.Methods and systems for applying gearing effects to actions based on input dataUS20080261693 *Jun 24, 2008Oct 23, 2008Sony Computer Entertainment America Inc.Determination of controller three-dimensional location using image analysis and ultrasonic communicationUS20080274804 *Jan 18, 2007Nov 6, 2008Sony Computer Entertainment America Inc.Method and system for adding a new player to a game in response to controller activityUS20080284742 *Aug 6, 2007Nov 20, 2008Prest Christopher DMethod and apparatus for implementing multiple push buttons in a user input deviceUS20090139778 *Nov 30, 2007Jun 4, 2009Microsoft CorporationUser Input Using Proximity SensingUS20090158220 *Dec 15, 2008Jun 18, 2009Sony Computer Entertainment AmericaDynamic three-dimensional object mapping for user-defined control deviceUS20090229892 *Sep 5, 2008Sep 17, 2009Apple Inc.Switchable sensor configurationsUS20100060473 *Sep 4, 2009Mar 11, 2010Sony CorporationInformation processing device, information notification method and computer programUS20100060568 *Mar 11, 2010Apple Inc.Curved surface input device with normalized capacitive sensingUS20100073319 *Mar 25, 2010Apple Inc.Capacitive sensor having electrodes arranged on the substrate and the flex circuitUS20100190548 *Jun 19, 2008Jul 29, 2010Wms Gaming Inc.Wagering game machine with virtual input deviceUS20100231509 *Sep 16, 2010Marc BoillotSterile Networked Interface for Medical SystemsUS20100259369 *Oct 9, 2009Oct 14, 2010Research In Motion LimitedNavigation tool with audible feedback on a handheld communication device having a full alphabetic keyboardUS20100304868 *May 29, 2009Dec 2, 2010Sony Computer Entertainment America Inc.Multi-positional three-dimensional controllerUS20100313409 *Dec 16, 2010Apple Inc.Hybrid buttonUS20110014981 *Jan 20, 2011Sony Computer Entertainment Inc.Tracking device with sound emitter for use in obtaining information for controlling game program executionUS20110090147 *Mar 25, 2010Apr 21, 2011Qualstar CorporationTouchless pointing deviceUS20110115716 *Nov 13, 2009May 19, 2011Research In Motion LimitedTouch-sensitive display method and apparatusUS20110284296 *Nov 24, 2011Jacob HarelPen Transcription System with Improved Noise RejectionUS20120146953 *Jun 14, 2012Samsung Electronics Co., Ltd.Display apparatus for sensing multi-touch and proximity objectUS20120194561 *Sep 19, 2010Aug 2, 2012Nadav GrossingerRemote control of computer devicesUS20120223823 *Mar 2, 2011Sep 6, 2012HtcSystems and Methods for Sensory FeedbackUS20120235904 *Sep 20, 2012The Board of Trustees of the Leland Stanford, Junior, UniversityMethod and System for Ergonomic Touch-free InterfaceUS20120249327 *Oct 4, 2012Controlled Entry Distributors, Inc.Adjustable touchless transmitter to wirelessly transmit a signalUS20130050458 *Nov 3, 2010Feb 28, 2013Sungun KimDisplay device and method of controlling the sameUS20130088434 *Oct 6, 2011Apr 11, 2013Sony Ericsson Mobile Communications AbAccessory to improve user experience with an electronic displayUS20130191741 *Jan 24, 2012Jul 25, 2013Motorola Mobility, Inc.Methods and Apparatus for Providing Feedback from an Electronic DeviceUS20140005886 *Jun 29, 2012Jan 2, 2014Microsoft CorporationControlling automotive functionality using internal- and external-facing sensorsUS20140282267 *Sep 6, 2012Sep 18, 2014Eads Deutschland GmbhInteraction with a Three-Dimensional Virtual ScenarioUS20140368434 *Jun 13, 2013Dec 18, 2014Microsoft CorporationGeneration of text by way of a touchless interfaceUS20140368472 *Sep 3, 2014Dec 18, 2014Elliptic Laboratories AsTouchless user interfacesEP2109030A2 *Apr 8, 2009Oct 14, 2009Lg Electronics Inc.Mobile terminal and screen control method thereofEP2131272A2 *May 29, 2009Dec 9, 2009LG Electronics Inc.Mobile communication terminal having proximity sensor and display controlling method thereinEP2131272A3 *May 29, 2009May 7, 2014LG Electronics Inc.Mobile communication terminal having proximity sensor and display controlling method thereinEP2315103A2 *May 24, 2010Apr 27, 2011Qualstar CorporationTouchless pointing deviceWO2007130833A3 *Apr 25, 2007Aug 7, 2008Xiadong MaoScheme for detecting and tracking user manipulation of a game controller body and for translating movements thereof into inputs and game commandsWO2009073262A1 *Sep 18, 2008Jun 11, 2009Microsoft CorporationUser input using proximity sensing* Cited by examinerClassifications U.S. Classification345/173International ClassificationG09G5/00Cooperative ClassificationG06F3/016European ClassificationG06F3/01FLegal EventsDateCodeEventDescriptionMar 7, 2007ASAssignmentOwner name: NAVISENSE, LLC, FLORIDAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BOILLOT, MARC;REEL/FRAME:018977/0676Effective date: 20070307Owner name: NAVISENSE, LLC,FLORIDAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BOILLOT, MARC;REEL/FRAME:018977/0676Effective date: 20070307Jun 18, 2012ASAssignmentOwner name: NAVISENSE, LLC, FLORIDAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MCINTOSH, JASON;BOILLOT, MARC;REEL/FRAME:028390/0465Effective date: 20120617Jun 2, 2014FPAYFee paymentYear of fee payment: 4Jun 2, 2014SULPSurcharge for late paymentRotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services