Abstract:
Provided is a data projection device including a device body and a first projector connected to the device body. The first projector is configured to project a display image onto an adjacent surface separate from the device body. An input detection sensor is connected to the device body and is configured to detect motions of a user within a field of view proximate the device body, and to generate an input signal responsive to the detected motions. A diagnostic processing unit is disposed within the device body and is connected to the first projector and the input detection sensor for receiving the input signal therefrom. The diagnostic processing unit is configured to be operatively connectable with a data source to receive vehicle data therefrom and to process the data and modify the display image according to the received data and the input signal.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    The present continuation patent application claims priority to U.S. patent Ser. No. 13/458,611 filed on Apr. 27, 2012; now U.S. Pat. No. 8,509,986, issued Aug. 13, 2013, and a continuation of U.S. patent Ser. No. 13/892,488 filed on May 13, 2013, the contents of which are expressly incorporated herein by reference. 
     
    
     STATEMENT RE: FEDERALLY SPONSORED RESEARCH/DEVELOPMENT 
       [0002]    Not Applicable 
       BACKGROUND OF THE INVENTION 
       [0003]    1. Technical Field of the Invention 
         [0004]    The present invention relates generally to a virtual user interface, and more specifically to a virtual user interface including a projection device for displaying data on an adjacent surface external to the device tool and a virtual user input for detecting user input gestures. 
         [0005]    2. Description of the Related Art 
         [0006]    It is well known that computers and other electronic modules have been increasingly incorporated into automobiles. Accordingly, during operation of a recently manufactured vehicle, electronic data is generated, collected and stored within a computer(s) located on the vehicle. The data may be retrieved by an automotive diagnostic tool, which is configured to operatively connect with the vehicle&#39;s computer and download the data therefrom. The data retrieved from the vehicle may include diagnostic trouble codes (DTC), freeze frame data, live data, etc. Once the data is retrieved, the data may be processed to determine the diagnostic health of the vehicle. 
         [0007]    Most automotive diagnostic tools include a built-in display screen which displays images during operation of the tool. The display screen may display the operating conditions of the tool (such as whether the tool is connected to the vehicle), diagnostic data (such as DTCs), possible repair solutions, or the like. Thus, the display screen is an integral component of most automotive diagnostic tools. 
         [0008]    Although built-in display screens provide suitable depiction of the functions and data commonly associated with operating the automotive diagnostic tool, conventional displays suffer from some deficiencies. One significant deficiency associated with conventional displays is the cost of the displays. In particular, the display is oftentimes the most expensive component on conventional automotive scan tools. Therefore, if alternate display mechanisms were available, the manufacturing cost of the tools would decrease, thereby reducing the overall cost to the automotive diagnostic tool. 
         [0009]    Another deficiency commonly associated with conventional built-in displays is that they have a fixed size, which is dictated by the size of the automotive diagnostic tool, i.e., the built-in display screen is typically set within the automotive diagnostic tool. Thus, built-in display screens tend to be small, particularly in hand held automotive diagnostic tools. Therefore, it is difficult for multiple people to observe images on a small, built-in display screen. Furthermore, due to the relatively small nature of the built-in display screens, there is a limited amount of content that the conventional display screens can show. Therefore, the user may be required to navigate through several different screens to view information which may otherwise be displayed on a single, larger screen. 
         [0010]    Although in some situations it is beneficial to minimize the user input on diagnostic tools to provide ease of use, in other situations, it may be desirable to provide additional input options. For instance, a more sophisticated user input may allow a user to enter more information, which would enhance the diagnostic process and may simplify the use of the automotive diagnostic tool in certain circumstances. However, it may be difficult to incorporate additional input options a handheld automotive diagnostic tool because of the limited space available on the tool. 
         [0011]    Therefore, there is a need in the art for an improved user interface including a more cost effective and adaptable display device, and a user input that provides the user with enhanced resources to allow for more simplified and thorough user input. 
       BRIEF SUMMARY OF THE INVENTION 
       [0012]    The present invention specifically addresses and alleviates the above-identified deficiencies in the art. There is provided a data projection device including a virtual user interface including a projection display and a virtual user input. The projection display projects an image onto an adjacent surface to display diagnostic information to the user. The projection display is not constrained by the size or form factor of the device (in contrast to conventional built-in display screens), but instead utilizes adjacent surfaces external to the device as a “projection screen” upon which an image is projected for display to the user. 
         [0013]    The virtual user input provides a unique means by which the user may input information into the device during use thereof. In particular, the virtual user input is configured to detect input gestures made by the user and convert the input gestures into input signals. The input gestures may be performed without the user physically engaging or contacting the device. Thus, the virtual user input is not constrained by the physical dimension of the device, and instead, may provide for more comprehensive and thorough input by the user, which results in an easier-to-use device with greater capabilities. 
         [0014]    According to one embodiment, the device includes a device body and a first projector connected to the device body. The first projector is configured to project a display image onto an adjacent surface separate from the device body. An input detection sensor is connected to the device body and is configured to detect motions of a user within a field of view proximate the device body, and to generate an input signal responsive to the detected motions. A processing unit is disposed within the device body and is connected to the first projector and the input detection sensor for receiving the input signal therefrom. The processing unit is configured to receive data and to process the data and modify the image according to the received data and the input signal. 
         [0015]    The data projection device may additionally include a second projector connected to the device body and configured to project an input template within the field of view. The first projector and the second projector may be configured to project the input template and the display image in spaced relation to each other. The input template may include an image of a keypad having a first button and a second button. 
         [0016]    The device may include a position correlation module in communication with the input detection sensor and configured to correlate the first button with a first position coordinate and the second button with a second position coordinate. The user input signal may include information related to the first button when the input detection sensor detects the user at the first position coordinate and the user input signal including information related to the second button when the input detection sensor detects the user at the second position coordinate. 
         [0017]    The present invention is best understood by reference to the following detailed description when read in conjunction with the accompanying drawings. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0018]    These as well as other features of the present invention will become more apparent upon reference to the drawings wherein: 
           [0019]      FIG. 1  is an upper perspective view of a handheld data projection device having a virtual user interface including a projection display and a virtual user input; 
           [0020]      FIG. 1A  is an upper perspective view of the device shown in  FIG. 1 , wherein the virtual user input image is different from the virtual user input image displayed in  FIG. 1 ; and 
           [0021]      FIG. 2  is a schematic view of the device depicted in  FIG. 1 . 
       
    
    
       [0022]    Common reference numerals are used throughout the drawings and detailed description to indicate like elements. 
       DETAILED DESCRIPTION OF THE INVENTION 
       [0023]    The detailed description set forth below is intended as a description of the presently preferred embodiment of the invention, and is not intended to represent the only form in which the present invention may be constructed or utilized. The description sets forth the functions and sequences of steps for constructing and operating the invention. It is to be understood, however, that the same or equivalent functions and sequences may be accomplished by different embodiments and that they are also intended to be encompassed within the scope of the invention. 
         [0024]    Referring now to the drawings, wherein the showings are for purposes of illustrating a preferred embodiment of the present invention only, and not for the purposes of limiting the same, there is shown a handheld electronic device  10 , such as a data projection and processing device, having a virtual user interface including a projection display and a virtual user input. The virtual user interface allows the handheld device  10  to display data in a remote projection field  12  and detect user input gestures performed in spaced relation to the handheld device. The projection display includes a projector  14  which serves an alternative to conventional built-in display screens such as an LCD or LED type display screen. The projector  14  may be implemented into the handheld device  10  at a reduced cost and may provide more versatility than conventional display systems. Furthermore, the virtual user input provides a complementary input system to the projection display and allows the user to communicate with the device  10  and enter user input into the device  10  without physically touching or contacting the device  10 . In view of the remote nature of the display and input systems associated with the virtual user interface, the display and input system are not constrained by the physical form factor of the device  10 . Thus, the projection display and virtual user input may be larger and easier to use than the display and input systems on conventional electronic devices. 
         [0025]    Referring now specifically to  FIG. 1 , an embodiment of the device  10  is shown as an automotive diagnostic tool configured for use a vehicle  15  having an onboard computer (i.e., a data generator)  16  for generating and storing data during operation of the vehicle  15 . The onboard computer may include a single computer or several computers/sensors/electronic modules located throughout the vehicle. The computer  16  includes a vehicle connector  24  for accessing the data in the computer  16 . 
         [0026]      FIG. 1  additionally shows an automotive diagnostic tool  10  including a tool body  18  and a tool connector  20 . The automotive diagnostic tool  10  may be similar to conventional code readers, scan tools, or the like, and may be configured to interface with a vehicle computer  16  to retrieve data therefrom. In this regard, the automotive diagnostic tool  10  may be capable of communicating with the vehicle computer  16  in an OBD-II protocol or other protocols known in the art. The tool connector  20  is configured to be operatively engageable with the vehicle connector  24  for placing the tool  10  in communication with the vehicle computer  16 . The tool  10  may be connected to the on-board computer  16  via wired or wireless communication means. The exemplary embodiment shows a cable connector  22  disposed between the tool connector  20  and a computer connector  24  to facilitate wired data transfer between the on-board computer  16  and the tool  10 . Wireless communication between the computer  16  and the tool  10  by means of wireless technology, such as Bluetooth®, RF, infra-red, or other wireless technologies known by those skilled in the art. 
         [0027]    Data received by the tool, or data projection device  10  is communicated to a diagnostic processing unit, such as CPU  26  (see  FIG. 2 ) or microprocessor located within the tool body  18 . The data retrieved from the vehicle computer  16  may include graphical data and/or text data, such as diagnostic trouble codes (DTCs), DTC definitions, I/M monitor status, emission status warning lights, malfunction indicator lamp (MIL) status, live data, freeze frame data, etc. The data may be analyzed locally within the tool  10  or externally by remote diagnostic databases. For instance, the user may simply request a listing of DTCs retrieved from the vehicle. In that case, all of the processing may be performed locally by the tool  10 . In addition, the tool  10  may be able to perform basic functionalities, such as determining the most likely problem associated with a particular DTC. However, for a more comprehensive analysis, the tool  10  may upload the data to a remote diagnostic database for further diagnostic processing. The tool  10  may receive a diagnostic summary from the remote database indicating the most likely problem with the vehicle and the most likely solution for correcting the most likely problem. For more details on the remote diagnostic process, see U.S. Patent Application Publication No. 2010/0174446, entitled, Automotive Diagnostic Process, and U.S. Pat. No. 8,068,951, entitled Vehicle Diagnostic System, both of which are owned by Innova Electronics Corp., which also owns the present application, the contents of which are incorporated herein by reference. The tool  10  may include a transceiver  25  for facilitating communication with the remote database or other remote locations. The transceiver  25  may be capable of communicating with the remote database via wireless or wired communication means. 
         [0028]    Although the exemplary embodiment of the present invention includes the automotive diagnostic tool  10 , as noted above, various aspects of the present invention include other handheld electronic devices which display information, including cell phones, tablet computers, personal digital assistants, etc. Therefore, although the exemplary automotive diagnostic tool  10  receives data from a vehicle, it is contemplated that other embodiments of the present invention may receive data from other external resources to display other types of images/information. For instance, data may be received from the Internet, cellular communication networks, local networks, etc. 
         [0029]    After the data processing is complete, the CPU  26  generates a diagnostic display signal which corresponds to the underlying data received from the on-board computer  16 . For instance, the display signal may correspond directly to the data retrieved from the vehicle, such as the listing to DTCs, live data, freeze frame data, etc., or the display signal may correspond to the diagnostic summary received from a remote database and include the most likely solution, the most likely fix, repair solutions, repair procedures, repair costs, local repair shops, etc. The CPU may also be capable of generating non-diagnostic display signals for displaying graphical data and/or text data by the projector  14 . For instance, the non-diagnostic display signals may correspond to the start-up sequence, shut-down sequence, and other diagnostic or non-diagnostic images. 
         [0030]    The CPU  26  is in communication with the diagnostic display projector  14  and communicates the display signal(s) thereto. The diagnostic display projector  14  is configured to receive the display signal and generate a projection which may be directed onto an adjacent surface  28  for viewing by the user. As used herein, the term “adjacent surface” upon which the image is displayed may be a wall, floor, desktop, tabletop, a surface of the vehicle, or other surfaces contemplated by those skilled in the art. The adjacent surface  28  is not part of the tool  10 , and as such, the tool  10  does not employ a built in display screen for displaying the information to the user. Instead, the image is projected onto the adjacent surface  28  to allow the user to observe the image. In this regard, the adjacent surface  28  acts as a conventional “projection screen,” wherein light from the diagnostic display projector  14  is directed toward the adjacent surface  28  and is reflected off of the adjacent surface  28  toward the user. The image projected onto the adjacent surface  28  may have to be focused or otherwise adjusted for optimal viewing by the user. In this regard, the display projector  14  may have brightness adjustment options, focus adjustment options, color adjustment options (i.e., black/white or color), or other image options known in the art. 
         [0031]    Since the image is projected onto an adjacent surface  28 , the size of the projection field  12  is not necessarily limited by the size of the tool  10 . For instance, the tool  10  may be a compact, hand held diagnostic tool  10 , yet the size of the projection field  12  may be much larger than the size of the tool  10 . Thus, the image projection system provides a more user friendly display than smaller, built-in display screens. 
         [0032]    The image projected by the display projector  14  may be a static image, i.e. the information does not change (such as a listing of DTCs), or a dynamic image, i.e. varying information (such as live data from the vehicle). Furthermore, the image may be segregated into several display portions which display different types of data or images. In the exemplary display field  12  depicted in  FIG. 1  the image includes display portions  30   a - f , wherein each display portions  30   a - f  may display different data to the user. For instance, display portion  30   a  depicts a line graph, while portion  30   d  depicts a bar graph, and portions  30   b,    30   c,    30   e,  and  30   f  display text. In this regard, the diagnostic display projector  14  includes the capability of generating an image that is sufficiently detailed to display the type of information that is commonly displayed in conventional diagnostic tools or other electronic devices. For instance, the projector  14  may be capable of projecting images commonly displayed on cell phones, tablet computers, such as “app” related images, maps, video games, videos, voice calls, etc. 
         [0033]    Referring now specifically to  FIG. 2 , the diagnostic display projector  14  may include a projector housing  32  and a light element  34  connected to the projector housing  32 , wherein the light element  34  emits the light which creates the display image. The light element  34  may be configured to generate an image having a brightness intensity large enough to project onto the adjacent surface  28 . 
         [0034]    According to one embodiment, the projector housing  32  is selectively pivotable relative to the tool body  18  to allow for selective pivotal adjustment of the image onto the adjacent surface  28 . The pivotal movement of the projector housing  32  relative to the tool body  18  allows the user to direct the image onto the most convenient portion of the adjacent surface  28 . There may be a more desirable portion of the adjacent surface  28  on which the image may be projected. For example, in the case of a desktop, a portion of the desktop may be covered by a computer, a keyboard, etc., while only a portion of the desktop remains exposed and thus defines a preferred image projection surface. The user may selectively pivot the projector housing  32  relative to the base portion to direct the image onto the exposed surface of the desktop to provide a clearer projection of the image. 
         [0035]    In addition to adjusting the location of the image, the display projector  14  may additionally include a focusing lens  36  configured to adjust the size of the image by making the image larger or smaller. Therefore, the virtual display associated with the tool  10  is extremely versatile by allowing a user to selectively choose where the image is projected and how big the image will be. This type of versatility is not found in conventional built-in display screens on traditional automotive diagnostic tools. 
         [0036]    The virtual user interface of the automotive diagnostic tool  10  additionally includes a virtual user input system that allows the user to make input gestures in spaced relation to the tool  10  to navigate through the information and screens projected by the tool as well as to select or input data into the tool  10 . Therefore, the virtual user input is configured to identify the input gestures and generate corresponding input signals. 
         [0037]    In one embodiment, the user&#39;s gestures are detected by an input detection sensor  44  connected to the tool body  18 . The input detection sensor  44  may detect gestures made by the user in space, such as waving a hand or clapping hands, or alternatively, gestures made against a surface, such as tapping a finger on the surface or moving a finger on the surface. In this regard, the gestures made by the user and detected by the input detection sensor  44  may be correlated by the position correlation module  45 . For instance, if the user is viewing a particular screen and wants to advance to the next screen, the user may wave his hand toward the input detection sensor  44 , almost as if to “push” the current screen out of view. Furthermore, if the user wants to select a highlighted item, the user may tap the surface  28  adjacent the input detection sensor  44 , similar to a “double-click” on a conventional computer mouse. Thus, the input detection sensor  44  may allow the user to make basic input commands without being constrained by a physical input device. 
         [0038]    For more complex user input, the virtual user input may projects an input template  40  onto the surface  28  to guide the user for making gestures which are detectable by the virtual user input. The input template  40  may be as simple as a single button or may be more sophisticated and include a traditional keypad, also known as a QWERTY pad. The virtual user input is configured to correlate the virtual “buttons” projected onto the surface  28  with a physical location such that when the user is detected in that physical location, the virtual user input generates an input signal associated with that button. In this regard, a coordinate system may be used to define the respective virtual buttons for inputs incorporated into the virtual user input. For instance, the “A” button may be associated with the position X1, Y1, and the “S” button may be associated with the position X2, Y1, and so forth for the remaining buttons. Therefore, when the user&#39;s finger is located at position X1, Y1, the virtual user input detects the user&#39;s presents at that position and generates an input signal corresponding to the “A” button. 
         [0039]    According to one embodiment, the virtual user input includes an input projector  42 . In the exemplary embodiment depicted in  FIG. 2 , the input detection sensor  44  and input projector  42  are connected via the CPU  26 . The input projector  42  projects the input template  40  onto the surface  28  and the input detection sensor  44  detects input movements or gestures by the user corresponding to selection of button(s) on the input template  40 . The input projector  42  may be pivotable relative to the tool body  18 , and may include a lens  47  for focusing the template  40  on the surface  28 . 
         [0040]    The CPU  26  may be programmed with a coordinate system corresponding to the layout of the input template  40  so as to generate an input template signal corresponding to the positional layout of the template to the input projector  42 . Therefore, if the tool  10  is capable of projecting several templates  40 , the CPU  26  may have several different coordinate systems program therein, and thus, may be capable of generating and communicating several different input template signals to the input projector  42 . For additional information regarding a virtual user input, please refer to U.S. Pat. No. 6,650,318 entitled, Data Input Device, the contents of which are expressly incorporated herein by reference. 
         [0041]    It is contemplated that as the user sequences through the menus or screens projected by the tool  10 , the input template  40  projected by the input projector  42  may change. In this regard, there may be specific input templates associated with specific display screens or modes projected by the tool  10 . For instance, upon the initial start up of the tool  10 , the user may navigate through scroll down menus to select the year, make, and model of the vehicle. However, at a later time, the user may be asked to type in their address to determine local repair shops. Thus, the input template associated with the initial screen, i.e. navigating through a scroll down menu, may include arrows to make the appropriate selection, such as the input template  140  shown in  FIG. 1A . However, the input template associated with a more open ended inquiry, such as the user address, may display a QWERTY pad, such as the input template  40  shown in  FIG. 1 . 
         [0042]    The input projector  42  may include a laser projection system, or other projection systems known by those skilled in the art. The projector  42  may be capable of displaying the input template  40  with a level of clarity needed for complex templates  40 , such as a QWERTY pad. 
         [0043]    The input detection sensor  44  may employ any position detection means known by those skilled in the art. In the exemplary embodiment, the input detection sensor  44  employs infrared technology to generate an infrared plane of light slightly above and generally parallel to the surface  28 . The infrared light is invisible to the user and may be spaced only a few millimeters above the surface  28 . When a user touches a position on the surface  28 , infrared light is reflected in the vicinity of the key and is directed toward the input detection sensor  44 . The detection sensor  44  then makes a real-time determination of the location of the reflected light and communicates that position to a position correlation module  45 , which maps that location back to the input template  44  to generate an input detection signal. In the exemplary embodiment depicted in  FIG. 2 , the position correlation module  45  is shown as being integrated as part of the CPU  26 , although those skilled in the art will readily appreciate that the position correlation module  45  may also be integrated into the detection sensor  44 , or alternatively placed at other locations within the tool  10 . The processing capabilities of the input detection sensor  44 , the position correlation module  45  and the CPU  26  may be capable of detecting multiple reflection events simultaneously and thus can detect multiple key strokes at once. 
         [0044]    In  FIG. 1 , the input template  40  is spaced from the projection field  12  of the primary display. However, it is understood that in other embodiments, the virtual user interface may be more like a touch screen, wherein the user makes selections within the projection field  12  that are detected by the input detection sensor  44 . As such, the user may make selections by tapping or double tapping on particular areas of the projection field  12 . 
         [0045]    The virtual user input described above provides significant versatility and flexibility relative to more conventional built in user input devices on conventional diagnostic tools. For instance, conventional tools may have a limited number of input buttons built in the tool, which may significantly limit the user navigation or user input into the tool. The virtual user input allows a user to make simple selections such as navigating through a scroll down menu, to more complicated actions such as typing their address using a conventional QWERTY pad. Further, because the tool  10  is formed to be self supporting, i.e. to stand, unsupported, on the surface  28 , the user is able to use one or both hands to interact with the virtual keyboard or other display that may be projected onto the surface. Therefore, the overall ease of use of tool  10  is enhanced while at the same time broadening the amount of input which may be received by the tool  10 . 
         [0046]    Although the exemplary embodiment shown in the figures and described above includes a virtual display system and a virtual input system, those skilled in the art will readily appreciate that other embodiments may include one system without the other. More specifically, one embodiment may include the virtual display system without the virtual input system, while another embodiment may include the virtual input system without the virtual display system. 
         [0047]    Additional modifications and improvements of the present invention may also be apparent to those of ordinary skill in the art. Thus, the particular combination of components and steps described and illustrated herein is intended to represent only certain embodiments of the present invention, and is not intended to serve as limitations of alternative devices and methods within the spirit and scope of the invention.