Electronic computer control for a projection monitor

Abstract: A cursor positioning device (10) for a computer system (18) having a projection display monitor (12) including a screen (14). A light pointer (28) in the form of an elongated housing (34) is positioned with its tip (30) at a selected location on the screen. A light sensor (44) detects the raster scan trace and transmits a timed electrical signal to an interface (26), which determines the coordinates of the selected location for use by a computer (18) in controlling the position of the cursor on the projection screen (14).

Description: FIELD OF INVENTION This invention relates to computer control devices for controlling the position of a cursor and for inputting com puter commands through an interface in a computer system having a projection display monitor of the conventional type which projects an image of data or graphics generated by the computer system onto an enlarged screen in the form of an elongated pointer for use with a projection display monitor and screen. BACKGROUND Computer systems generally incorporate a display monitor unit having a cathode ray tube for providing a visual representation of selected data to a user. A specific point on the display is often indicated to the user by way of a brightly illuminated cursor. In various applications, the cursor may be moved by the user to any desired point on the display, for example, to edit text files or select menu options. In the earlier prior art, the positioning control for the cursor was typically provided by keys which were are manually depressed by the user to incrementally move the cursor across the screen. To overcome the awkwardness of pressing keys multiple times to move the cursor across the screen, other input devices were devised, such as the light pen. The light pen is positioned with its tip pointed toward the display face of a direct view CRT display monitor. The tip of the light pen includes an optical sensor for detecting the raster scan trace as it excites the phosphors in the face of the cathode ray tube. The timing of the detected raster scan signal is translated into positional data, which, in turn, is used by the computer software to control the position of the cursor on the screen. As the user moves the tip of the light pen across the face of the cathode ray tube, the cursor moves along with it, giving the user the direct interactive "feel" of drawing on the CRT face. One disadvantageous characteristic of the light pen is its low resolution. Prior art light pens can sense an area of the display screen only as small as a character, instead of a pixel, or picture element, so that lines drawn on a screen often appear as blobs of light. This is caused primarily by the large size of the optical sensor element compared to the small size of the pixels on the display screen, the persistence of the excited phosphor on the screen, and parallax effects caused by the thick glass of the cathode ray tube face. From U.S. patent 3,917,955 a coordinate determining apparatus of the type used in a desktop microfiche reader is known, which scans the spot of a light pen projected on the viewing screen with a light pen. The screen has a size of a conventional desktop style reader screen, i.e. for an individual reader. The light-pen comprises a hand-held elongated housing including a handle portion, a light sensor located at the tip for detecting a raster scan trace of the projection display monitor at a selected location near the surface of a screen, signal generating means, coupled to the light sensor, for generating a timed electrical signal in response to the detected raster scan trace, interface means, coupled to the computer control device and the computer system, for translating electrical signals into position signals representative of the selected location on the screen, and at least one switch, seperate from the handle portion, for actuating at least one computer controlling function such as SELECT, RETURN, and EXECUTE. The disadvantages of the pens are overcome somewhat by cursor positioning devices such as the "mouse", the joystick, and the graphics input tablet, which provide improved resolution and ease of use. However, these alternative cursor positioning devices do not provide the direct interactive "feel" provided by light pens. Instead, the user manipulates these devices on a table top, for example, and this effects a corresponding movement of the cursor on the display screen. Where there is a need for a large number of users to view displayed data, many computer systems have been adapted to use projection monochrome monitors instead of direct view CRT displays. With this type of monitor, a video image is projected on a screen having a diagonal measurement of three to five feet (90 to 150 cm). Although first used only for the display of video programming, the projection display monitor is becoming a popular computer display device for group viewing situations, such as computer training classes, executive meetings, and conferences. The use of a projection display monitor could be greatly enhanced by a cursor control device that would provide for moving the displayed cursor, selecting items on menus, drawing on the projection screen, and calling up files and display windows, the same way a user of a does with a conventional "mouse" device. It would also be desirable if the user could interact directly with the projected image on the screen, similar to the way a light pen is used with a direct view CRT display unit. In this way, the actions of the user would be readily visable to the viewing group. It would be further desirable if the motion of the cursor could be resolved to the pixel level, making possible the writing or drawing fine lines on the screen. Accordingly, it is an object of the invention to provide a computer control device including a cursor positioning device for a projection monitor and large display screen having a high degree of resolution. A computer control device which meets theses requirements is disclosed in the following and defined by the appended claims. SUMMARY OF THE INVENTION In accordance with the invention, a novel hand-held control device and light pointer is provided for a computer using a projection display monitor and very large screen, whereby direct interactive control of a cursor is obtained. The present invention provides a user with the capability of walking up to the screen, as in a classroom, positioning the tip of the control device in the form of a light pointer on the displayed image, and moving the cursor, selecting menus, drawing figures, and performing other control functions, with a resolution close to one pixel. The invention is set forth in claim 1. In the preferred embodiment, the light pointer of the present invention is a wireless, battery-powered unit, and has a physical appearance not unlike that of a pointer used with a blackboard in classroom situations. The light pointer includes an elongated, cylindrical housing and is provided with a telescoping inner cylinder to permit a user to adjust the length of the housing for moving the tip to any point on the screen without creating shadows. The housing includes a handle portion including a select switch for performing computer control operations and a tip. The tip includes a flexible member and a light sensor for detecting the raster scan trace emitted from the projection tube at a user selected location on the screen. The light pointer contains circuitry for creating a timed electrical signal, in response to the detected raster scan trace, which is representative of the selected location of the tip on or near the screen surface. The light pointer is linked to an interface by means of an FM transmitter/receiver arrangement. The interface circuitry includes a microcontroller which determines the location of the light sensor on the screen by means of the timed electrical signal received from the light pointer. The interface translates the timing of this detected signal into vertical scan line and pixel position data, and transmits this position in the form of X and Y coordinate data to the video display controller of the computer, by a serial bus. The computer, in turn, generates cursor signals adapted for controlling the position of the cursor on the screen of the projection display monitor. In operation, the user holds the light pointer on or near the screen and aims the light sensor at the projection tube, not at the screen. When the tip of the light pointer is rested lightly against the screen at a selected location, the flexible member aligns the sensor perpendicularly to the face of the projection tube so that it will receive the maximum intensity of projected image field from the projection tube. In the office environment, for example, where ten or fifteen people may be present in a small conference room, the light pointer gives the user the capability of calling up files and editing data on the screen, by means of the select switch provided, in a directly interactive manner, while providing commentary to the audience. The projected image on the screen becomes, in a very basic sense, a electronic blackboard. Furthermore, in the projected image, since the raster has been expanded considerably, each pixel element is very close to the size of the light sensor, and very fine movement of the cursor may be effected. This feature is especially useful in writing on the projected image, or drawing representations of graphical data. High resolution of this type is generally not possible with direct view CRT displays using light pen input devices. These and other objects and features of the present invention will be understood from the description to follow, taken in conjunction with the accompanying drawings. DESCRIPTION OF THE DRAWINGS FIG. 1 illustrates in block form the major components of the system embodying the present invention; FIG. 2 is a plan view of the light pointer of the present invention; FIG. 3 schematically shows the proper orientation of the light pointer when in use; FIG. 4 presents a block schematic diagram of the light pointer of the present invention; FIG. 5, presents a block schematic of the interface used with the present invention; and FIG. 6 illustrates the timing diagrams associated with the interface used with the present invention. DESCRIPTION OF THE PREFERRED EMBODIMENT Turning attention first to FIG. 1, a video projection system 10 is shown which uses the present invention. A projection monitor 12 projects images on a screen 14. The screen 14 is oriented vertically, and preferably mounted on a wall. The monitor 12 is a conventional monochrome projection type, employing a projection tube 16, and would preferably be used for projecting images of computer display screens, including alphanumeric characters, graphical data, and computer menus. As such, the projection monitor 12 and screen 14 employed herein are used identically to a direct view CRT display terminal unit employed in a conventional computer system. It is also important to note that the projection monitor 12 uses standard raster scanning, in which the timing of the displayed image data is determined by horizontal and vertical sync pulses. With a projection monitor 12 of the described type, the image size projected on the screen 14 generally has a diagonal dimension of 90-150 cm (three to five feet). This is for the purpose of making the displayed image visable to a large number of viewers, as when the video projection system 10 is used in a classroom environment, a lecture hall, or an executive conference room. However, the principles of the present invention are applicable to rear projection video monitors, which incorporate a projection tube and translucent screen in a single unit and project the image from behind the screen. And Further, although the preferred embodiment employs a monochrome projection monitor 12, color monitors of various types may also be used. The projection monitor 12 receives video and timing signals from a computer 18 by means of a monitor cable 19. The computer 18 is also coupled to a keyboard 20 by means of a serial bus 22. The serial bus 22 carries keyboard control and data signals to and from the computer 18. The serial bus 22 also carries data to the computer 18 from an interface unit 26, which operates with the present invention and will described in more detail further on. By using the configuration described, the projection monitor 12 and keyboard 20 can conveniently be placed on a table top, and the computer 18 can be located some distance away, coupled to the keyboard 20 by the serial bus 22 cable and the monitor cable 19. A light pointer 28, according to the present invention, is shown in FIG. 1, oriented with its tip 30 near the screen 14, within the raster scanned image field 32 emitted from the projection tube 16. The purpose of the light pointer 28 is to detect the individual raster scan trace emitted from the projection tube 16 at a selected location on or near the screen 14 and to provide a timed electrical signal to the interface 26, which is related to the location of the tip 30 on or near the screen. The light pointer 28 is linked to the interface 26 by means of an FM transmitter/receiver arrangement, which will be described. Used with the other elements of the present invention, the light pointer 28 is a versatile cursor control device for the screen 14. The light pointer 28 performs functions equaling those of "mouse" input devices, graphics input tablets, or light pens used with conventional direct view display units. The user is provided with the capability of moving a displayed cursor, selecting menus, drawing figures, and other interactive functions, with a resolution close to one pixel. Turning now to FIG. 2, the light pointer 28 is shown in more detail. The light pointer 28 includes a elongated, cylindrical housing 34, preferably fabricated from a durable, metallic material, to shield the components of the light pointer 28 from magnetic fields associated with the projection monitor 12. The housing 34 separates at collar 36 and includes an inner cylindrical member 37 to provide a telescoping action which permits a user to adjust the length of the housing 34, as desired. In the preferred embodiment, the length of the housing 34 may be varied from (12 to 20 inches) 30 to 50 cm. Ideally, the housing 34 should be long enough to allow the user to select a position on the screen 14 without putting his hands or arms into the image field 32. This minimizes shadows on the screen 14. The housing 34 includes a handle portion 38 for gripping the light pointer 28. A SELECT switch 40, included in the handle portion 38, may be conveniently activated by the user's thumb pressure. It is within the scope of the present invention for additional switches to be included in the handle portion 38 with functions such as RETURN and EXECUTE. These are conventional functions for the manipulation of displayed data or graphics in a computer system having a "mouse" input device. Switch 41 provides power to the light pointer 28. The tip 30 includes a flexible member 42 and a light sensor 44. The light sensor 44 is for detecting the raster scan trace emitted from the projection tube 16. In operation, the user holds the light sensor 44 near the screen 14 at a selected location and aims the light sensor 44 at the projection tube 16, not at the screen 14; therefore, the raster scanned image field 32 is detected as it approaches the screen 14, rather than as it is reflected off the screen 14. The light sensor 44, therefore, detects a focused, high intensity light source. Operating off the reflected image, the light pointer would not be as sensitive. In FIG. 3, the light pointer 28 is shown in the correct operating relationship with the screen 14. The light pointer 28 is held lightly against the screen 14 or slightly away from it. The flexible member 42 functions to align the light sensor 44 generally perpendicular to the face of the projection tube 16 so that it will receive the maximum intensity of the projected image field 32 from the projection tube 16. Turning now to FIG. 4, a block schematic diagram of the light pointer 28 is shown. The circuitry of light pointer 28 is primarily for detecting the individual raster scan trace at the location of the light sensor 44 relative to the screen 14, and for generating a timed electrical signal representative of that location. The timed electrical signal is transmitted to the interface 26, which determines the position of the light sensor 44 in relation to the vertical scan line and pixel position in that display frame. In the preferred embodiment, the light sensor 44 is a photodiode. The light sensor detects the raster scan trace and presents a pulse to the input of an AC coupled, high-frequency amplifier 46. The amplifier 46 has a very high gain level, in order to ensure that it detects the low background level raster scan pulse. The amplifier 46 is provided with an automatic gain control 48. The automatic gain control 48 is needed to compensate for variations in the brightness of the image field 32. It is desirable for the amplifier 46 to function at same output amplitude level, with bright or dark pictures or in bright or dark areas of the screen, without becoming saturated and to ensure uniform operation. The automatic gain control 48 monitors the output of the amplifier 46 by sensing two threshold voltage levels. When the automatic gain control 48 senses a high level output voltage, it decreases the gain of the amplifier 46; when it senses a low level output voltage, it increases the gain of the amplifier 46. A Schmitt trigger 50 is used to square up the edges of the amplified analog pulse received from amplifier 48. The output of the Schmitt trigger is a logical low until the input signal reaches a threshold level, at which time the output goes high and remains high. The light pointer 28 is wireless, and an FM transmitter 52 and antenna 54 is used to transmit the amplified, squared raster scan pulse, in the form of a timed electrical signal to the interface 26. The FM transmitter 52 was selected because the time delay introduced in FM transmission is of a fixed value, and this delay is easily compensated for by the software in the computer 18. Power for the light pointer 28 provided by battery supply 56. The power switch 41 controls the battery supply. A select switch 40 for selecting and manipulating data is coupled to the transmitter 52. Turning now to FIG. 5, a block schematic diagram of the interface 26 is shown. The interface 26 is contained on a circuit card in the projection monitor and includes the circuitry for determining the position of the light sensor 44 on the screen 14. A microcontroller 60 (Motorola type MC68701) and associated circuitry control the interface between the light pointer 28 and the serial bus 22. The microcontroller 60 detects the timed electrical signal transmitted from the light pointer 28, translates the timing of this detected signal into vertical scan line and pixel position data, and finally transmits this position in the form of X and Y coordinate data to the video display controller of the computer 18, by the serial bus 22. This occurs 60 times per second. The microcontroller 60 receives vertical sync 62 and horizontal sync 64 inputs from the video display controller in the computer 18, which are also presented to the display circuitry of the projection monitor 12. As is well known to those skilled in the art, each vertical sync pulse starts a new frame of displayed data in projection monitor 12, and each horizontal sync pulse starts a new scan line. This relationship can be appreciated by considering the first two timing signals illustrated in FIG. 6. The detected signal is received by an FM receiver 66 and antenna 68 and amplified through an amplifier 70. The leading edge of the detected signal indicates the location of the light sensor 44, as shown in the third timing signal of FIG. 6. The microcontroller 60 receives the detected signal and determines the frame and vertical scan line where the light sensor 44 is located by means of the vertical sync and horizontal sync pulses. However, pixel position is more difficult to determine, firstly, because there are no pixel timing signals coming from the video generator board in the computer 18, and secondly, because the frequency of the pixels is faster than the microcontroller 60 can count. The microcontroller 60 determines pixel position in the scan line by means of a phase lock loop arrangement which functions as a pixel counter, dividing each scan line into 1024 positions. The phase locked loop includes the pulse width control output 72 of the microcontroller 60, an integrator 74, a voltage controlled oscillator 76, a ten bit counter 78, and a return loop 80. The voltage controlled oscillator 76 operates continuously at approximately 20 MHz. The output, or VCO clock, is presented to the ten bit counter 78. The output pins (Q0 - Q9) of the counter 78 are connected to a latch 82, which will be described. The highest order bit (Q9) is also presented to the microcontroller 60 through the return loop 80. At a count of 1024, the Q9 output of the counter 78 goes high. The microcontroller 60 compares the horizontal sync pulse with the Q9 output and matches the timing of the two signals by varying the duty cycle of output 72. The output 72 signal is presented to integrator 74, which outputs a variable DC signal that controls the frequency of the voltage controlled oscillator 76. This phase lock loop arrangement ensures that the leading edge of each horizontal sync pulse will be synchronized with the leading edge of the Q9 output of counter 78. Therefore, every time a horizontal sync pulse occurs, starting a new scan line, the counter 78 accurately increments through 1024 pixel positions for that scan line. This provides a very high resolution of pixel position. This relationship is illustrated in the four bottom timing diagrams in FIG. 6. At the same time the detected raster signal is received by the microcontroller 60, an RS flip-flop 84 sets the latch 82, which receives the outputs (Q0-Q9) of the counter 78. The latch 82 holds pixel position of light sensor 44 in the scan line. The RS flip-flop and latch 82 are reset at the start of the next frame by the the vertical sync pulse. The vertical scan line and pixel position, in the form of X and Y coordinate data, are transmitted to the video display controller of the computer 18 over the bus 22. The computer 18 provides means for generating cursor control signals adapted for controlling the position of the cursor in response to the position signals received from the interface 26. In operation, the user holds the tip of the light pointer on or near a selection and aims the light sensor at the projection tube. When the tip of the light pointer is rested lightly against the screen at a selected location, the flexible member aligns the sensor perpendicularly to the face of the projection tube so that it will receive the maximum amount of intensity of the image field from the projection tube. In a classroom or executive office environment where a number of persons may be viewing the projected computer display, the user has the capability of calling up files and editing data on the screen, by means of the select switch provided, in a directly interactive manner, while providing commentary to the audience, or by direction from viewers in the audience. The projected image becomes, in a very basic sense, the computer display equivalent of an electronic blackboard. Furthermore, in the projected image, since the raster has been expanded considerably, each pixel element is very close to the size of the light sensor, and very fine movement of the cursor may be effected. High resolution is generally not possible with direct view CRT displays using light pen input devices. In a conventional direct view video display monitor with a standard 12 inch diagonal screen having a resolution of 800 x 300 pixels, the width of the screen is approximately eight inches, and the diameter of each pixel is therefore .01 inches (0.25mm). When the screen size is expanded, as in the present invention, to an image area having a five foot diagonal dimension, the width of the projected image is approximately four feet. With a resolution of 800 dots per inch, each pixel now has a diameter of approximately .125 inches, which is also the approximate size of the light sensor. The high pixel resolution of the present invention makes it possible for a user to create fine lines on the projected image, as in writing or drawing. The closer the light pointer is held to the screen, the greater the accuracy, because the image field has been expanded to its maximum area. However, the light pointer does not require actual contact with screen to function properly. Still, it is desirable to keep the light pointer close enough to the screen to minimize shadows on the screen from the light pointer housing. Shadow effects caused by the operators hands or arms are eliminated by adjusting the length of the pointer housing so that all positions of the screen may be selected without the hands of the user intruding in the image field. In view of the above, it will be seen that the several objects of the present invention are readily achieved and other advantageous results attained.

Claims: A computer control device (28) for controlling the position of a cursor and for inputting computer commands in a computer system (18) having a projection display monitor (12) of the conventional type which projects an image of data or graphics generated by the computer onto an enlarged screen (14) having a diagonal dimension of 90-150 cm (3 to 5 feet) for convenient viewing by groups, comprising: a hand held elongated housing (34) having a length of 30-50 cm (12 to 20 inches) and including a handle portion (38); a light sensor (44) located at a tip of the elongated housing for detecting a raster scan trace of the projection display monitor at a selected location near the surface of the screen; signal generating means (46), coupled to the light sensor (44), for generating a timed electrical signal in response to the detected raster scan trace; interface means (26), coupled to the computer control device (28) and the computer system 18, for translating electrical signals into position signals representative of the selected location on the screen (14); means for generating cursor signals (18) adapted for controlling the position of a cursor on the screen (14) in response to the position signals; and a least one switch (40), within the handle portion (38), for actuating at least one computer controlling function such as SELECT, RETURN, and EXECUTE, whereby the position of the cursor on the screen remains proximate to the position of the light sensor (44) during movement to a second selected location near the surface of the screen. The computer control device according to claim 1, wherein the light sensor (44) is a photodiode included in the tip (30) of the hand-held elongated housing (34). The computer control device according to claim 2, wherein the elongated housing (34) includes a telescoping inner member (37) for varying the length of the housing. The computer control device according to claim 2 or 3, wherein the tip (30) includes a flexible member (42) for orienting the light sensor (44) toward the projection monitor (12) when the tip contacts the screen (14). The computer control device according to any of claims 1 to 4, wherein this and the interface means (26) are coupled by means of an FM transmitter (52) in the hand-held elongated housing (34) and an FM receiver (66) in the interface means (26). The computer control device according to any of claims 1 to 5, wherein the signal generating means (46) includes an automatic gain control (48) to compensate for variations in the brightness of the image field. Use of a computer control device according to any of claims 1 to 6 for a high resolution cursor having a resolution close to one pixel on a screen onto which a projection display monitor (12) of the conventional type projects an image of data or graphics having a diagonal dimension of 90 - 150 cm ( 3 to 5 feet) generated by a computer system (18).

Inventors: DRUMM DONALD E, DRUMM, DONALD E.
Applicants: WANG LABORATORIES, WANG LABORATORIES INC.
Application year: 1988
Main classification: G06K11
IPC codes: G06F3, G09G1, G09G5