Systems, methods, and devices for capturing gesture-based inputs are disclosed herein. The concept employs infrared light emitting diodes (LEDs), infrared (IR) sensor, and processing of the information obtained by the interplay of the two. The processed information may be effectively translated to various gesture-based control systems, such as those employed to interact with electronic systems and displays.

BACKGROUND

Interfaces are becoming more complex and dual in nature. Providing multiple ways to interact with a system is becoming more commonplace. Thus, a user of a system may selectively choose a first or second technique for engaging the system. In certain instances, the transition between a first and second technique may require a toggle switch. In other instances, both the first and second techniques may simultaneously be available to the user.

One such input technique is a gesture based input. The gesture based input allows a detection of movement from a cue, such as a body part (commonly the hand), and based on the detected movement or gesture, a command is initiated. The gesture based inputs do not require the user to make contact with a touch, surface, pad, or device.

The gesture is captured via a video camera or motion detector. Accordingly, the video camera captures the movement, correlates the movement to a stored command center (i.e. a processor and storage device), and translates the movement into an action.

The conventional gesture-based input systems employ image/video capturing techniques. The amount of processing consumed with the conventional gesture-based systems may place a strain on available processing power and storage capabilities. Because image or real-time video is stored and processed, a powerful processor and a digital storage amount may become necessary. Thus, conventional gesture-based input systems may be both wasteful in resources and costly to implement.

SUMMARY

The following description relates to a s capturing gesture-based inputs. Exemplary embodiments may also be directed to any of the system, the wireless charging device, a display, or combinations thereof.

A system for capturing gesture-based inputs is included herein. The system includes a light emitting diode (LED) cycler to communicate instructions to a gesture-based capturing device to pulse a plurality of LEDs and a plurality of infrared (IR) sensors; a light detector to receive a plurality of data sets from the gesture-based capturing device generated from the plurality of IR sensors; a signal detector to receive information based on the plurality of data sets; and a command communicator to communicate the received information to an output device.

A method for controlling a gesture-based input device is included herein. The method includes turning on a set of light emitting diodes (LEDs), the set being a grouping of LEDs greater than one; performing an infrared (IR) sensor detection based on the turned on set of the LEDs to create at least one of a plurality of data sets; determining whether there are more sets to iterate to, and in response to the determination being no, waiting a predetermined time period to elapse, and returning to the turning and setting the set of LEDs to be a first set; in response to the determination being yes, iterating a step count by one, the step count being an index of the set of LEDs; and returning to the turning.

A gesture-based input device for interfacing with an electronic system is included herein. The device includes a plurality of light emitting diodes (LEDs); and a plurality of infrared (IR) sensors. Further, the plurality of LEDs are turned on/off in a predetermined pattern, and the plurality of IR sensors collect information, the collected information being employed to provide gesture-based control of the electronic system.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. Other features and aspects will be apparent from the following detailed description, the drawings, and the claims.

DETAILED DESCRIPTION

The invention is described more fully hereinafter with references to the accompanying drawings, in which exemplary embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure is thorough, and will fully convey the scope of the invention to those skilled in the art. It will be understood that for the purposes of this disclosure, “at least one of each” will be interpreted to mean any combination the enumerated elements following the respective language, including combination of multiples of the enumerated elements. For example, “at least one of X, Y, and Z” will be construed to mean X only, Y only, Z only, or any combination of two or more items X, Y, and Z (e.g. XYZ, XZ, YZ, X). Throughout the drawings and the detailed description, unless otherwise described, the same drawing reference numerals are understood to refer to the same elements, features, and structures. The relative size and depiction of these elements may be exaggerated for clarity, illustration, and convenience.

Gesture-based input systems and devices may be employed for various input related activities. An appendage, for example, a hand may be contorted or moved, with the contortion or movement correlated to a specific action or command. The action or command may be translated via a processor or computing device, and corresponded to a stimulation of an action.

For example, the movement of a hand from one location to another location may be employed to simulate a pointer on a digital display. Further, a change of shape of the hand may represent a command or other action. In the case of the pointer, for example, the closing of the hand may correspond to an execution of an icon associated with the pointers current location. As gesture-based control devices are known, a detailed description will be omitted.

However, as explained in the Background section, conventional gesture-based input/control devices or systems employ image or video capturing devices. The implementation of these devices may be costly and/or resource intensive (i.e. consuming a significant portion of a processor's availability). Thus, the implementation may be frustrated for at least the above-enumerated reasons.

Disclosed herein is a gesture-based input system, method or device based on light emitting diodes (LED) and a light sensor. Employing the concepts disclosed herein, the implementation of a gesture-based input system may be simplified, reduced in cost, and still effectively provide accurate gesture detection.

The aspects disclosed herein may be employed in any location or context where an input interface is employed or utilized. The interface provided herein may be provided as a stand-alone device, integrated into existing electronic systems, or provided in a newly designed electronic system.

FIG. 1is a block diagram illustrating an example computer100. The computer100includes at least one processor102coupled to a chipset104. The chipset104includes a memory controller hub120and an input/output (I/O) controller hub122. A memory106and a graphics adapter112are coupled to the memory controller hub120, and a display118is coupled to the graphics adapter112. A storage device108, keyboard110, pointing device114, and network adapter116are coupled to the I/O controller hub122. Other embodiments of the computer100may have different architectures.

The storage device108is a non-transitory computer-readable storage medium such as a hard drive, compact disk read-only memory (CD-ROM), DVD, or a solid-state memory device. The memory106holds instructions and data used by the processor102. The pointing device114is a mouse, track ball, or other type of pointing device, and is used in combination with the keyboard110to input data into the computer100. The pointing device114may also be a gaming system controller, or any type of device used to control the gaming system. For example, the pointing device114may be connected to a video or image capturing device that employs biometric scanning to detect a specific user. The specific user may employ motion or gestures to command the point device114to control various aspects of the computer100.

The graphics adapter112displays images and other information on the display118. The network adapter116couples the computer system100to one or more computer networks.

The types of computers used by the entities and processes disclosed herein can vary depending upon the embodiment and the processing power required by the entity. The computer100may be a mobile device, tablet, smartphone or any sort of computing element with the above-listed elements. For example, a data storage device, such as a hard disk, solid state memory or storage device, might be stored in a distributed database system comprising multiple blade servers working together to provide the functionality described herein. The computers can lack some of the components described above, such as keyboards110, graphics adapters112, and displays118.

The computer100may act as a server (not shown) for the content sharing service disclosed herein. The computer100may be clustered with other computer100devices to create the server. The various computer100devices that constitute the server may communicate with each other over a network.

FIG. 2illustrates a system200for capturing gesture-based inputs. The system200may be implemented on a device, such as computer100described above. The system200includes a light emitting diode (LED) cycler210, a light detector interface220, a change detector230, a signal detector240, and a command communicator250.

The system200is wired, or wirelessly coupled to the other elements shown inFIG. 2, such as the gesture-based interface device260(which is shown in greater detail inFIG. 3), the persistent store205, and output devices. The output device may include one, or both of the display280or the electronic system270. The persistent store205may be any of the storage devices enumerated above with regards to storage device108.

The LED cycler210communicates the LED control data211to the gesture-based interface device260. The LED control data211includes information about which of the LEDs contained on the gesture-based interface device260is to be turned on. For example, the gesture-based interface device260may include a pattern of LEDs (as shown inFIG. 3). The LED control data211may instigate a set of the LEDs to turn on for a predetermined time period. As explained in the methods described in this disclosure, the number of LEDs on the gesture-based interface device260may be cycled in a pattern so that a specific number of sets including different or same numbers of individual LEDs are turned on.

The LED control data211may also instigate the turning on of the set of infrared (IR) light sensors contained on the gesture-based interface device260. In response the IR light sensors turning on, a light detecting data221is also generated. Although only one light detecting data221is shown, there may be an individual data set for each cycle of LEDs asserted on. A cycle is defined as a grouping or plurality of LEDs (i.e. a set) being turned on simultaneously. Thus, as explained further below, the when a set of LEDs is asserted, or turned on, the IR sensors may also be turned on and employed to detect a light detection from the reflection off an object (i.e. an appendage or hand).

The light detector220receives the light detecting data221from the gesture-based interface device260. As explained above, a data221may be received respectively for each assertion of the LED cycler210. For example, if the gesture-based interface device260contains 24 LEDs, a set may include 3 LEDs. Thus, the LED cycler210may cycle through all the LEDs with 8 different cycles. In this way, there would be 8 different data sets of light detecting data221. The different data sets may be superimposed with each other to create a whole data of the relative light over the gesture-based input device260.

In this way, placing an object over the gesture-based input device260, such as a hand or an appendage, may create a different reading of the light detection data221based on the location of the object and the relative distance of the object from the gesture-based input device260. This is due to the LEDs on the gesture-based input device260reflecting off the object, and subsequently, the reflection being sensed by the various sensors.

The change detector230retrieves a previous data set231from the persistent store205, and determines whether the light detecting data221(the combined data) is different. The previous data set231may be light detecting data221from a previous operation of the LED cycler210and light detector220.

In response to no difference, the system200ceases further operation. However, if the difference is over a predetermined threshold, the signal detector240retrieves profile data241from the persistent store205. The profile data241corresponds to a predefined object and location of the object based on the light detecting data221. For example, if a hand or appendage is placed over the gesture-based input device260, the profile data241may retrieve data associated with the hand or appendage at a specific location.

In another example, the profile data241may be cross-referenced to a lookup table206(stored in the persistent store205), and employed to retrieve specific command data242. The specific command data242may correspond to an action to control an electronic system270. The specific command data242may correspond to specific actions associated with gesture-based control systems, such as rotation, switching, pointing, and the like. Thus, the system200may be cognizant of both a location of the object and the correlated gesture of the object (i.e. pointing, turning, switching, swiping, and the like).

The command communicator250communicates the retrieved data from the signal detector240to an output device. As shown inFIG. 2, the output device may be an electronic system270or a display280.

For example, the command data252(processed via the command data241), may be employed to serve as a command to operate and interact with an electronic system270. In the scenario that the electronic system270is a radio or entertainment system, the turning motion (captured by system200) may simulate the interaction of a knob associated with the radio or the entertainment system.

In another example, the output device may be a display280. The display280may be any electronic display associated with the electronic system270, or individually provided. Employing the display data251(sourced from the profile data241), the display280may render an electronic rendition of the object captured by the gesture-based input device260.

Employing the aspects disclosed above, a location and gesture associated with the object may be ascertained via the recorded light data received.

FIGS. 3(a) and (b)illustrate an example implementation of a gesture-based input device260. The gesture-based input device260includes 24 LEDs (labeled301-324), and four IR light sensors (330-333). The number of implemented LEDs and IR light sensors is purely exemplary. The LEDs shown are infrared LEDs, which aid with the usage of the IR light sensors.

As explained above, the sets of LEDs may be chosen by an implementer of the system200. For example, in the situation shown in FIG.3(b), the LEDs301-324are divided into 8 equal sets. The 8 equal sets are cycled through individually, with each of the IR sensors being asserted to capture a reading associated with the 8 equal sets.

The time that the LEDs are asserted and turned on may be set by an implementer of system200. Further, as explained above, various permutations and combinations may be employed by an implementer of the system200or the device260.

FIG. 4illustrates a method400for controlling a gesture-based input system. The method400may be implemented on a computer, such as the one described above with regards toFIG. 1.

In operation410, a first set of LEDs are turned on. As explained inFIG. 3(b), the set may be predetermined by the implementer of method400. The method400may proceed to operation420.

In operation420, detection via the provided IR sensors may be performed. The IR sensors sense light reflecting off a foreign object over the gesture-based input system from the provided LEDs (i.e. the set of LEDs turned on).

In operation430, a determination is made as to whether there are more sets to be cycled through. If yes, the method400proceeds to operation440. If No, the method400proceeds to operation445. In operation445, a predetermined time elapsing is determined to occur, and in response to that occurring, the method400proceeds back to operation410(where the method400is performed iteratively).

In parallel, the method400may also proceed to method500. In method500, the detected data (from operation420), is processed and either converted to a digital display or employed as an input for an electronic system.

In operation440, the step count is iterated. In operation450, the current set (based on the iteration) of LEDs is turned on. The method400may proceed back to operation420.

FIG. 5illustrates a method500for processing light sensor data. The light sensor data may be sourced from system200, or method400(and specifically after operation430).

In operation510, the light sensor data is received. The light sensor data may be defined by iterative and multiple readings based on a cycling of available LEDs.

In operation520, a difference between the presently received light sensor data, and a previous recordation is compared. If there is no difference, the method proceeds to end560. If there is a difference, the method500proceeds to operation530.

In operation530, the corresponding gesture or position of the object associated with the light sensor data is retrieved. Operation530may branch out into four different operations: 1) determination of a different gesture541; 2) determination of a different position542; both (541and542); or none (543and544). If nothing is performed, the method500proceeds to end560.

In operation550, the corresponding command associated with either the retrieved gesture or position is retrieved. Although not shown, an image of graphical user interface (GUI) may be transmitted to an electronic display capable of receiving such images or image data.

The retrieved command may be transmitted to an electronic system, and employed as an interface or input command.

FIGS. 6(a)-(c)illustrate examples of an implementation of system200, according to the aspects disclosed herein. Although system200is not shown, system200is coupled to all the elements shown inFIGS. 6(a)-(c).

As shown inFIG. 6(a), a display280is provided, and a gesture-based input device260is also provided. On the display280, there is an engage-able GUI610. In the state shown inFIG. 6(a), there is no object or appendage over the gesture-based input device260.

InFIG. 6(b), a hand600is placed over the gesture-based input device280. The hand600is open. Correspondingly, employing the aspects disclosed herein, a digital hand620is shown in display280.

InFIG. 6(c), the hand600now makes a pointing gesture, and is moved to cause the digital hand620to move so that it overlaps the GUI610. The GUI610is engaged (i.e. shown as shaded), with the digital hand620also shown to be in a pointing orientation.

The aspects disclosed herein presumably employ LEDs, IR sensors, and an algorithm to control the LEDs and IR sensors to receive data that may be translated to a gesture detection. Thus, employing the aspects disclosed herein, image and video capturing devices may be effectively omitted from a gesture-based detection device. This may lead to a more robust and cost-effective implementation.