Abstract:
A Computing System and Device Having Interactive Projected Display is disclosed. Also disclosed is a device and system that enables a small handheld device to project a display screen image that is full-sized without the need for auxiliary equipment. The device has an output device that projects a high quality image and an input device that permits the user to interact directly with the projected screen image. The input systems may include a wide variety of tactile input methods, including touching the projected image, gesturing in close proximity to the projected image, and/or using a specialized pointer of mouse to send inputs to the system.

Description:
CLAIM FOR PRIORITV TO PROVISIONAL APPLICATION—35 U.S.C. §111(b)  
       [0001]    This application claims priority to Provisional Patent Application 60/441,269 filed Jan. 21, 2003. 
     
    
     
       BACKGROUND OF THE INVENTION  
         [0002]    1. Field of the Invention  
           [0003]    This invention relates generally to input/output systems for computing devices and, more specifically, to a Computing System and Device Having Interactive Projected Display.  
           [0004]    2. Description of Related Art  
           [0005]    The world of mobile computing has expanded dramatically with the evolution of notebook computers and personal digital assistance (PDA&#39;s) and their ability to now provide more functionality and information, and therefore productivity to users when they are away from their home or office. In fact, many users have replaced their desktop computers with notebook computers, having actually increased their available computing power in doing so. Although PDA&#39;s have also evolved, their input/output limitations (mainly due to display size constraints) have substantially limited their functionality. The strength of the PDA is its extremely compact and convenient size; the strength of the notebook is its power. The problem is that the power applications are coupled with ergonomic size constraints, making even the notebook computer too large to be truly convenient as a mobile device, while the I/O limitations of the PDA have prevented it from becoming a replacement for a PC or notebook computer.  
           [0006]    Several approaches to handheld, portable power computing have emerged, but all with significant tradeoffs to the user. Pans that record and later download what was written into software are small, but limited. Handheld projectors using LED sources can project simple, fixed images, but no motion or interaction. Projection eyewear is an alternative for military or hospital applications, but distractive and unproven in the mainstream.  
           [0007]    What is needed is a device and method of providing a projected display and associated input subsystem that will enable interactivity with the projected application, will overcome these defects in the prior systems and therefore will provide substantial additional utility for projection displays.  
         SUMMARY OF THE INVENTION  
         [0008]    In light of the aforementioned problems associated with the prior systems and devices, it is an object of the present invention to provide a Computing System and Device Having Interactive Projected Display. The device and system should enable a small handheld device to project a display screen image that is full-sized without the need for auxiliary equipment. The device should have an output device that projects a high quality image and an input device that permits the user to interact directly with the projected screen image. The input systems should include a wide variety of tactile input methods, including touching the projected image, gesturing in close proximity to the projected image, and/or using a specialized pointer of mouse to send inputs to the system.  
       
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
       [0009]    The objects and features of the present invention, which are believed to be novel, are set forth with particularity in the appended claims. The present invention, both as to its organization and manner of operation, together with further objects and advantages, may best be understood by reference to the following description, taken in connection with the accompanying drawings, of which:  
         [0010]    [0010]FIG. 1 is a modular depiction of the main functional components of the present invention and their interrelationships;  
         [0011]    [0011]FIG. 2 is a perspective view of one embodiment of the device and system of the present invention;  
         [0012]    [0012]FIG. 3 is a close-up perspective view of the device of FIG. 2;  
         [0013]    [0013]FIG. 4 is a depiction of the functional components of the input portion of the device of FIGS.  1 - 3 ;  
         [0014]    [0014]FIG. 5 is a depiction of the functional components of the output portion of the device of FIGS.  1 - 3 ; and  
         [0015]    [0015]FIG. 6 depicts the interaction between the input and output portions of the present invention.  
     
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS  
       [0016]    The following description is provided to enable any person skilled in the art to make and use the invention and sets forth the best modes contemplated by the inventor of carrying out his invention. Various modifications, however, will remain readily apparent to those skilled in the art, since the generic principles of the present invention have been defined herein specifically to provide a Computing System and Device Having Interactive Projected Display.  
         [0017]    The present invention can best be understood by initial consideration of FIG. 1. FIG. 1 is a modular depiction of the main functional components of the present invention and their interrelationships. From a functional standpoint, at its most basic form, the computing device having an interactive projected display  10  comprises a projection display module  12  and an input module  14 . These two modules coordinate with one another and communicate with external systems via an input/output interface module  16 . The I/O interface module  16  communicates with a computing device  18  via an input/output connection  20 . If we turn to FIG. 2, we can begin to discuss specific physical embodiments of the present invention.  
         [0018]    [0018]FIG. 2 is a perspective view of one embodiment of the device and system of the present invention. In this embodiment of the device  10 A, the computing device  18 A has the projection input/output system of the present invention incorporated within it. The device  10 A here is a modified palm-sized PDA computing device  18 A. The device  10 A is configured to rest on a horizontal surface, such as the tabletop  22  shown, in an orientation that allows the projection display module  12  to project a display image  24  onto the surface  22 . As will be discussed further below, the input module  14  is positioned within the device  10 A such that it can view the projected display image  24  and receive input commands for operating the computing device  18 A by user interaction with the actual display image  24  itself. Even from this introduction to this single embodiment, it should be apparent that the handheld PDA having the interactive projected display provided by the present invention will provide much of the ergonomic utility of the conventional desktop personal computer, without the bulk of that unit. FIG. 3 provides yet additional detail. It should be appreciated that the display image  24  can be projected on a flat surface having any orientation, and that it is not limited to horizontally oriented surfaces.  
         [0019]    [0019]FIG. 3 is a close-up perspective view of the device  10 A of FIG. 2. The device  10 A has a palm-sized housing  26  and a pair of retractable legs  28 A and  28 B. The legs  28  are designed to provide the desired cant to the device  10 A such that the projection display module  12  and input module  14  are aimed at the horizontal surface upon which the device  10 A is resting. These legs  28  can be retracted by simply folded back into pockets formed in the housing  26  in order to provide a very smooth and condensed package for ease and comfort in carrying. Of course, this is only one example of a device and method of deploying the projected display module  12  and input module  14 . Many other concepts are possible, such as swing arm (??), flip-out hinged array (??), calibrated foot (??).  
         [0020]    Although not shown here, essentially the rest of the computing device  18 A is identical to a conventional PDA, such that a user might also be able to interact with the conventional PDA in those circumstances where a projected display and associated input method are not desired.  
         [0021]    [0021]FIG. 4 is a depiction of the functional components of the input portion of the device of FIGS.  1 - 3 . The projection display module  12  of this embodiment comprises three major components: a modulated light source  30 , an image engine  32 , and a lens means  34  for converting the generated raw image into a finished, legible display having mainstream-quality resolution. In other embodiments, other versions of the light source  30  (even non-modulated types) may be used.  
         [0022]    The modulated light source  30  is one or more array(s) of red, green, blue and/or white lights. The lights may be conventional Light Emitting Diodes (LED&#39;s) or laser(s); these two sources provide exceptional light power with low power demand while virtually eliminating the overheating issues characteristic of the prior projectors. The term “modulated” refers to the characteristic of the source  30  of intermittently lighting or scanning each light in repeating form; when a visible light is blinked or scanned at a rate of 60 Hz or more, the light is perceived by the human eye as being constantly on. By scanning or blinking the lights rather than leaving them on continuously, the lights provide greater brightness and further will have improved longevity.  
         [0023]    The image engine  32  may comprise a variety of forms, but in this depiction is a Digital Light Processor, or DLP. The DLP or other image engine  32  cooperates with the modulated light source  30  to reflect the appropriate incident light at the appropriate frequency and of the proper color to create a stable image at the desired orientation to match the chosen projection surface. Depending upon which other elements are selected in the projection display module  12 , there may also be a lens means  34  for further modifying and improving the image being projected on the projection surface. In particular, this lens means  34  is a progressive lens, of the type particularly chosen to adjustably convert a rectangular image into a trapezoid such that it will appear as a rectangle when projected onto the display surface  22 . As is depicted here by solid lines terminating in arrowheads, the Input/Output Module  16  controls not only the modulated light source  30 , but also the image engine  32  in order to create and manipulate the displayed image. Now turning to FIG. 5, we can examine the input side of the system.  
         [0024]    [0024]FIG. 5 is a depiction of the functional components of the output portion of the device of FIGS.  1 - 3 . The input module  14  of this embodiment comprises a special position detector means, such as either a CMOS camera or a CCD camera that has the ability to observe the activity occurring within its view. In particular, the camera would determine where, in a spacial sense, the user has touched the displayed image; the input module  14  takes the observed position and delivers it to the I/O interface module for conversion into a format for use by the computing device as a pointer input. Use of a CMOS or CCD camera for visually conducting surveillance on the detection volume  36  enables the system to detect movement and position in three axes. The detection in three axes provides the system with both movement and position with substantial accuracy; as such, the user&#39;s desired input commands can be more reliably interpreted. Furthermore, the camera may be used to provide the projection display module with feedback in order to fine tune the displayed image based on actual detected image quality.  
         [0025]    In other versions, a position detector having less capability than those previously described may be employed, an example being 2-dimensional detection plus input from a modulated stylus or pointer, such as a device for detecting the location of the tip and/or orientation of a specialized stylus or pointer being used by the user to enter commands and other inputs. Finally, turning to FIG. 6, we can examine the operation of the input and display systems.  
         [0026]    [0026]FIG. 6 depicts the interaction between the input and output portions of the present invention. As shown, the detection volume  36  is an overlay for the projected display image  24  so that as the user interacts with the image  24 , his or her touches and motions are detected. The Input/Output interface module  16 , which comprises the software routines necessary to calibrate the detected command as it is oriented compared to the displayed image.  
         [0027]    By interfacing directly on the displayed image, the user&#39;s interaction with the computing device&#39;s display, the interaction becomes more intuitive, like real painting, writing, drafting, etc. It can be expected to reduce repetitive stress syndrome by allowing a more natural human movement (and larger motions). For example, a user running a spreadsheet program on the computing device having the interactive display system of the present invention will enable the user to see the image of the spreadsheet and then highlight a cell with a pointing device (or by another input method); the instruction to highlight will be detected by the input module and converted to a mouse signal by the I/O interface module for use as an input by the operating system of the computing device. It is expected that many different methods of interacting with the projected image will be used, including physically touching and/or simply gesturing adjacent to the image—collectively, these are referred herein to as tactile interactions with the projected image display.  
         [0028]    Those skilled in the art will appreciate that various adaptations and modifications of the just-described preferred embodiment can be configured without departing from the scope and spirit of the invention. Therefore, it is to be understood that, within the scope of the appended claims, the invention may be practiced other than as specifically described herein.