Apparatus and method for integrating pointing functions into a computer keyboard

Abstract: A device providing pointing device functions in a keyboard (11) without requiring the keyboard operator to remove any fingertip from the keys. A computer keyboard key switch mounting plate (10) is supported for horizontal displacement against a resistive force. A transducer (27) for measuring the force exerted in the plane of the keyboard key tops (16) is attached between the keyboard case (8) and the key switch mounting plate (10). The direction and magnitude of the force can be measured and encoded so they may be used to emulate the signals generated by a pointing device. The operator may elect a pointing device mode by merely applying sufficient force along the plane of the surface of the key tops, thus switching from a keyboard mode to a pointing device mode, without moving the fingers from a typing position.

Description: Background of The Invention The present invention relates to keyboard operated computing systems. Specifically, an apparatus is described which supports a control function such as a pointing function typically performed by an auxiliary device to be integrated into a keyboard. This device is actuated by exerting a lateral force on the surface of the keyboard key tops. Keyboard operated computing systems have supported rapid entry of alpha numeric data by providing an efficient tool for this operation to data entry personnel. Computer operations in a graphical environment provided by some computing systems are advantageously manipulated by auxiliary pointing devices which are used to move a cursor from one location on a display to another. In such environment, pointing devices such as "mice" permit screen displayed objects to be identified for some subsequent operation. The combined use of keyboard data entry systems and pointing devices introduce some inefficiency since the user is required to move his hands from the typing position to a remote, printing-device-operating position. If many pointing operations are required, the interruption to typing operations seriously degrades the data input efficiency of the keyboard. One approach to making the pointing function more efficient has been to introduce more keys to the keyboard which can be used for cursor manipulation. This uses keyboard space at the expense of implementing other functions. Even with additional keys (usually located on the right side of the keyboard) the keyboard operator is required to remove one hand from the "home" position when shifting from a keystroke operation to a pointing operation, thus reducing typing efficiency. Incorporation of mouse control features in keyboard devices has been described in various references. In publications entitled "Mouse/Keyboard Concept Incorporating Unique Devices For Control CRT Display Cursors", IBM TDB, Vol. 27, No. 103, March 1985, and "An Integrated Mouse and Keyboard" IBM TDB, Vol. 31, No. 8, January 1989, page 230, the implementation of a mouse on the underside of the base of the keyboard is suggested. Movement of the keyboard over a supporting surface could then be encoded into mouse signals for positioning a cursor. This approach, however, has numerous disadvantages. Among these are a requirement for a larger work space to accommodate movement of the keyboard in four coordinate directions. Additionally, moving the keyboard is physically demanding, and when moved, the keyboard is no longer optimally placed for typing. U.S. Patent No. 4,680,577 describes a keyboard which provides at least one key which may be rocked or flexed laterally in addition to being depressed as a conventional keystroke. The rocking motion is encoded to position a cursor on a CRT. The patent suggests the key implementation for two of the "home" keys, such as F or J. The additional problem of emulating mouse buttons is not addressed by this patent, nor is that of inadvertent depression of the pointing key, nor is that of pointing when no finger is on either of these keys. Patent abstracts of Japan Vol. 8, No. 252 (p. 314, 1689), 17th November 1994 and JP-A-59/123 916 discloses keyboard systems for cursor operation wherein the keyboard is mounted on a central post and the cursor operation is performed by moving the keyboard in a longitudinal and lateral direction around the actuator. A sensor converts the movement of the actuator that tilts according the oscillation of the keyboard to a signal that controls direction of the cursor. Disclosure of The Invention It is a specific object of this invention to implement a computer selectable function by sensing a lateral force applied in the plane of the tops of the keys of a keyboard by the normally positioned fingertips of the user's hands. It is another object of this invention to implement a pointing function on a computer keyboard by sensing a lateral force applied in the plane of the tops of the keyboard keys. It is a more specific object of the invention to implement pointing functions on a standard computer keyboard without changing the number or function of keys in existing keyboard designs and without requiring the keyboard user to move from the positions reached in the normal course of typing. These and other objects of the invention are provided by a keyboard as defined in claim 1 which is implemented with a lateral force detecting device for determining the magnitude and direction of a force which is applied to a surface of the keyboard keys. The sensed force may then be used as a control signal for a computer, such as a pointing function. The pointing function, for example, could position a cursor to a desired position on a CRT. Alternatively, a function may be selected by assigning a function to a given range of forces. Whenever the operator supplies the requisite force, the function is selected by the on-board microprocessor. The invention may be implemented using a conventional keyboard having a standard key layout and the standard "dishing" of the key tops. The force needed to activate the sensing device may be applied without physically demanding effort since sensor devices which measure small forces are a well-known art. Additionally, the presence of a processor within the keyboard allows the keyboard to make distinctions between lateral forces arising from the user's intent to move the cursor and lateral forces applied inadvertently at the time of keystroke. Each of these events have distinctive force-timing signatures. The function selected may be a pointing function such as positioning a cursor on a CRT display. In the preferred embodiment of the invention, a force applied to the surface of the key tops, in the plane normal to a keystroke, which also exceeds a threshold force is decoded as a control signal. In this instance the control signal is a request to position the cursor. The operator may supply a sufficient level of force to the key tops in the direction of a choice to position the cursor. The cursor is positioned at a location which is a function of the magnitude of the applied force, the direction of the force, and the duration of the applied force. The pointing function may be supplemented with a character search feature which permits the operator to position the cursor on a chosen character. Using this feature, the operator first coarsely positions the cursor in the vicinity of the chosen character. The character is then selected by striking the key representing this character. The computer enters a search routine upon detection of the keystroke, and searches for the desired character in the display memory. Once the location of the character is determined, the computer may then accurately position the cursor with respect to this character. The pointing feature may also be supplemented with a mouse button emulation feature, again using existing keys on the keyboard. The mouse buttons may be simulated by detecting two or more simultaneously depressed keys as a mouse button. The preferred embodiment of this feature senses the depression of any two or more keys to the right of the center of the keyboard as the actuation of the right mouse button, and the simultaneous depression of any two or more keys to the left of center as actuation of the left mouse button. Operation of mouse-driven user interface features of applications or the operating system is then possible from the keyboard. Brief Description Of The Drawings Fig. 1 illustrates a keyboard data entry system incorporating control function apparatus such as pointing apparatus in accordance with the present invention. Fig. 2 illustrates how the control function apparatus such as the pointing apparatus of Fig. 1 is implemented within the keyboard. Fig. 3 is a schematic showing how the pointing apparatus may be implemented in accordance with a preferred embodiment of the invention. Fig. 4 is a state diagram demonstrating how the operations performed by a user on the keyboard change the operating state of the keyboard so that it can be used as either a keyboard or a pointing device. Fig. 5 is a flow chart illustrating the software which implements the function of the pointing device of Figs. 1 and 2. Figs. 6A and 6B illustrate the software in the keyboard microprocessor for detecting and implementing pointing operations, as well as supplying normal keyboard operation. Fig. 7 illustrates an addition to the computer keyboard device driver permitting precise cursor location in response to a selected character being struck on the keyboard during pointing operations. Best Mode For Carrying Out The Invention Referring now to Fig. 1, there is shown a keyboard operated computer system. The system includes a keyboard 11 implemented in accordance with this invention and connected to a computer 12. The data entry from keyboard 11 is displayed on a CRT display 13 during the normal course of operation of an application program. The keyboard 11 has a layout of keys which is an industry standard. The keyboard 11 is shown to have a mouse output cable 17 a keyboard output cable 18 as well as a standard encoded output cable 6 to the computer 12. Mouse ports are available on most personal computing systems. Similarly, many application programs have been written to take advantage of pointing and button pressing information supplied through that port. Further discussion of their interface is not necessary. Using the pointing function provided by a preferred embodiment of this invention, it is possible for the operator who is utilizing an application displayed on the CRT display 13 to move the cursor from one position to another. This movement may be accomplished by applying a force in the plane of the keyboard key tops 16 in a direction corresponding to a desired direction of movement for the cursor. The amount of displacement of the cursor is proportional to the amount of force applied (within design limits) and the time period over which the force is applied in the plane of the keyboard 11 key top surface 16. Referring now to Fig. 2, there is shown how a force applied in the plane of the keyboard key tops 16 may be detected and measured as control signals for subsequent processing into codes which are understandable to a computing system. As Fig. 2 illustrates, it is possible for the keyboard operator to impart a force by pressing the slightly dished keys 16 in a direction corresponding to a desired movement direction for the cursor. The key switch mounting plate 10 is resiliently mounted in the keyboard frame or case 8 and is supported by flexible posts 20 at its distal corners, and a captured bearing 21 at its proximal corners, as seen from the user's point of view. Thus, the slight amount of force imparted by the finger disposed over a key will cause flexing of the posts 20, permitting the keyboard surface 10 to move slightly on the captured bearings 21. This support arrangement can be seen to be adequate to support the switch mounting plate against forces applied in the normal direction during key actuation. It can also be seen that if the stiffness of the posts is correctly chosen, small but detectable displacements of the key switch mounting plate 10 with respect to the keyboard case 8 will result from a user applying force to the key tops in any direction in the plane of the key tops. In the illustration, this movement is in the direction of post 20. Post 20 will be slightly deflected as a consequence of these movements. The proximal corners of the keyboard surface 10 will slide over the captured bearing 21. Despite the loose attachment of the key switch plate, there is no danger of its loss as it is held captive between the bearing surface 21 and a keyboard top bezel 24. Keyboard top bezel 24 is shown as part of a conventional wrap-around chassis, capturing both ends of the key switch mounting plate surface 10. It is to be appreciated that other resilient mountings, such as springs or membranes, may be utilized in the practice of the invention. Attached to the key switch mounting plate 10 bottom surface is a magnet 25, which will also move when the key switch mounting plate 10 moves. The magnet 25 is disposed over an array of Hall sensors 27, mounted on the keyboard case 8, which can transduce the variations in magnetic field intensity caused by the displacement of the magnet 25 into functionally corresponding changes in their output current. It is to be assumed that these Hall devices are equipped with current to voltage conversion. The array of Hall sensors 27 are arranged as differential pairs so that the orthogonal components of the displacement can be translated into voltage magnitudes by differential amplifiers 30 and 31 in Fig. 3, and encoded into binary number values by A/D converters 33 and 34. These numerical values may, in turn, be used by the keyboard processor 35. It is to be appreciated that other transducers such as strain gauges attached to the resilient mounting or keyboard mounting plate, may be utilized in the practice of the invention. The sensed strain in the resilient mounting or keyboard mounting plate could be utilized to produce a control signal such as a pointing command signal to the keyboard processor 35 from application to the computer 12. Sensing the strain, also contemplates the situation where the keyboard mounting plate is rigidly mounted to the keyboard case. The foregoing apparatus may be used as a conventional keyboard as shown in Fig. 1. The operator inputs text as usual via the keyboard 11 which may be displayed on the CRT display 13 by the application receiving the keystroke data. Control information such as commands or data are entered by the generation of a control signal through the application of a force in the plane of the keyboard key tops as described relative to Fig. 2. By way of example, control information in the form of pointing information is now described. To enter the pointing mode, wherein data in the form of, for example, mouse data, is supplied to the application program, a force is applied in the plane of the keyboard key tops of Fig. 2, resulting in a displacement of the key switch mounting plate 10 of a magnitude related to that force. This displacement is also exerted upon the magnet 25 of Fig. 3. A control signal is thus produced from Hall sensor array 27 in the form of a change in output voltage. The common mode of the output voltage of each of the differential pairs of Hall sensors of Fig. 3 is rejected by operational amplifiers 30, 31 leaving only component voltages arising from movement in the axis of that pair. This voltage is converted into microprocessor readable digital numerical quantities by A/D converters 33, 34. These quantities are used by a program executing on microprocessor 35 to determine which control function has been called for by the user. In this instance, to determine whether or not a pointing operation has been performed by the user. In the event that that software was providing keystroke information to the application program executing in the computer 12 of Fig. 1, the program executing in microprocessor 35 of Fig. 3 will respond to these quantities by changing its flow of control to cause pointing information to be sent to the aforementioned application. The operations performed on the basis of the signal level are accomplished with electronic circuitry 28 of Fig. 2 to be described with respect to the state diagram of Fig. 4, associated with the on-board keyboard microcomputer. Once the user has complete sending pointing information, it is possible to return to the text mode by entering a space bar depression, or other (possibly user-defined) keystrokes. The foregoing function of developing pointing data makes use of the detection of a force applied to the key top surfaces for switching to the pointing mode. It is possible, using the principles of the present invention, to select other functions in addition to pointing upon the sensing of a force in the direction of the plane of the key top surfaces. These other functions can be similarly encoded wherein the direction of the force, and duration and magnitude of the force may be used to initiate other functions in the computer. It is also possible to build keyboards with integrated pointing device capabilities based on the principles of this invention which utilize techniques other than those described herein for the suspension of the key switch mounting plate and the measurement of the force thereon, without departure from the spirit of the invention. It is also possible, and advisable in certain instances, to use the foregoing embodiment in connection with a mouse function. The pointing accomplished by the apparatus shown in Figs. 1 and 3 is advantageous in that a typist/computer user need not move fingers from the text entry position to supply pointing information to the computer application program. In conventional pointing device systems, a separate pointing device is used, requiring data entry persons to move their hands, or (at best) some fingers, from the text entry position to a dissimilar pointing device operating position. To take advantage of the foregoing feature, permitting the hands to remain on the keyboard, it is necessary to provide a means to simulate the mouse button functions on the keyboard and pointing system of Figs. 1 and 2. These functions may take the form of detecting while in the pointing mode, when more than one key in a defined group of keys such as keys on either side of the centerline 19 have been simultaneously pressed. Thus, to operate a mouse button, the operator may consider the right and left hand sides of the keyboard as two distinct mouse buttons. During operation, when it is desired to send information to the application in accordance with conventional mouse button control, the user need only be certain that two keys be depressed on either side of the keyboard at substantially the same time to signal the program executing in the keyboard processor that the signal associated with closure of a mouse button should be sent to the application software. Associated with the keyboard is an array of keyboard switches 36 which are scanned in the conventional manner by virtue of X and Y signal buses connected to the keyboard array 36. These keyboard buses 38 and 39 will allow detection of key depressions and identification of which of the keys may have been selected. The optional embodiment wherein mouse buttons may be emulated by the simultaneous depression of at least two keys on either side of the keyboard 11 may be used to simulate the closures of conventional first and second mouse buttons. This, along with data encoding pointing operations in the manner of a conventional mouse, supply the signal provided on a second cable 17 to the mouse input port of the computer 12. The keyboard microcomputer 35 provides standard keyboard encoded signals on cable 18 to the computer 12. In the case that the computer 12 has no mouse port, the keyboard microprocessor may output the control signals generated by forces applied in the plane of the key tops as cursor key strokes. This encoded information would be supplied to computer 12 by the keyboard connection 18. It is clear that the keyboard microcomputer 35 can distinguish the multiple key depressions sensing the operation of a mouse button and encode the same as a mouse operation. The keyboard microcomputer 35 can distinguish between forces applied to the keyboard, which are intended to be pointing commands from an inadvertent force which may have been applied to the keyboard surface 10, while entering a normal keystroke by examining both the time/magnitude profile of the force, and its coincidence with a keystroke. With the embodiments shown, it is possible to provide a search mode to accurately position a coarsely positioned cursor 9 with respect to a text character on the CRT display 13. As shown in Fig. 1, the cursor can be positioned by supplying positioning information to the application software. It is assumed by way of this example that the application presents a text mode interface, and thus that the keyboard provides positioning information in the form of cursor move key codes. In order to position the cursor 9 in coincidence with a letter of text, the cursor is first positioned near the desired character, following which a search may be triggered. This search may be started by a single key depression corresponding to the displayed alpha numeric character at the desired position for the cursor 9. Thus, if the operator had located the cursor 9 in the position between the S and A of the first line of text, by depressing the letter I, the computer may begin a search procedure to look at all the positions in the vicinity of the cursor in the text memory for the letter I. As memory locations nearby contain two letters I, the computer would identify the closest memory location having the letter I, i.e., the first letter of the word "is", and position the cursor 9 in coincidence with the closest found letter I. This would then permit a subsequent keystroke to overtype the letter I or insert a character before the I, in accordance with the state of the keyboard (insert or overwrite). In this example it is essential that the user position the cursor closer to the particular "I" desired than to any other "I". Clearly, software may be written which deals with equidistant target characters. This search routine may be employed with or without the mouse function. To leave the pointing function and search function, it is possible to hit the space bar, which will be decoded as a request to leave the pointing mode and reenter a text only mode. The search routine is not available in the text only mode. The various modes of operation for the embodiments described are summarized in the state diagram of Fig. 4. These modes of operation include a keyboard state 40 which the machine assumes after being powered up. A force or push given to the keyboard key tops 16 puts the device in a control mode such as the pointing mode 41, in which the push is converted to pointing information. A particular control mode is implemented by the keyboard microprocessor software. When in the pointing mode, all subsequent forces applied to the surface of the key tops will be converted to pointing information. If the user wishes to indicate either the right or left mouse button function 43, 44, a pair of keys on the right or left of the keyboard centerline will be concurrently or simultaneously depressed. Once the simultaneous depression has been detected as a mouse command, the system automatically returns to the pointing mode after a short time out period, so the subsequent release of the keys located on the right or left of the keyboard will be detected as a mouse button release. Thus, pointing information can continue to be collected while the mouse buttons are depressed. This supports the mouse "drag" operation common on "pull-down" user interfaces. To leave the mouse mode or pointing mode, it is only required that the space bar be depressed. When in the pointing mode, and a single character is depressed on the keyboard, the search mode is entered in state 42 to look for a character in the vicinity of the positioned cursor. Once that character is located, the cursor is moved to the character position, and the keyboard state 40 is re-entered. This permits text composition to continue once the character is located, and the cursor is moved to that location. In the event the character is not found within some preset time period or distance, the cursor is left where it is and the keyboard state 40 is re-entered. In implementing the foregoing embodiment of the invention, both the keyboard microprocessor 35 as well as the computer 12 microprocessor, must be programmed accordingly. Figs. 6A and 6B represent the programming steps implemented in the keyboard microcomputer 35. Fig. 7 illustrates a fragment of a program in the computer 12, necessary for integrating the screen character search into the computer keyboard handling program, for accomplishing a search for a character in the vicinity of the cursor. Fig. 5 illustrates the overall program architecture in the keyboard microprocessor 35 of Fig. 3 for implementing these functions. Referring now to Fig. 5, there is shown the overview organization of the software in the keyboard microprocessor 35, which permits implementation of the foregoing control functions such as pointing, mouse and search functions. Following power up 50 of the computer 12 and keyboard 11 of Fig. 1, a power on self-test routine is executed in 51, as is conventional in computer processing systems, such as personal computers. Upon successful completion of the self-test, the mode is set in block 52 as the keyboard mode. To begin the keyboard mode, initialization data is loaded in step 53 from the computer 12, which identifies parameters for the mouse, such as threshold, and whether mouse data or cursor key codes are to be used to provide positioning information to applications. The loaded data is then used to initialize the keyboard microprocessor 35 of Fig. 3 in step 54 in accordance with this selected data. At this point, the keyboard may be used to enter either text in the conventional keyboard entry mode or text composition mode or in any of the foregoing control functions such as pointing or mouse modes. If a keyboard event is detected at step 55, that event is processed, as shown in Figs. 6A and 6B When either a key depression occurs in the keyboard entry mode or a lateral force is applied to the surface of the keyboard key tops in the control function mode, the event enables processing of the event in step 56. Step 56 comprises a series of steps, as shown in Figs. 6A and 6B, which encodes and transfers the event to the computer as either a keyboard entry mode function or a control mode function such as a cursor move key depression, a keystroke or mouse data stream. Following the processing of an event in step 56, the decision block 57 determines whether or not any new parameters have been loaded by the host which require reinitialization. In the simplest case it is assumed that there have been no new parameters during one session of use of the device. Referring to Fig. 6A, there is shown a flow chart illustrating the program steps executed by the keyboard microprocessor 35 to process a keyboard event and encode the same. The user's actions on the keyboard cause an event 60 which may either be a keyboard mode or a control mode. The event handling routine begins by determining whether or not the keyboard is in the keyboard mode. If the device is in the keyboard mode, decision block 61 causes the flow of control to pass to decision block 65. This determines whether or not a keystroke has been made. The other possible event is the control mode which is entered in response to the application of a force of a predetermined level in the plane of the key top surface. If such force is not detected, or is detected coincident with a keystroke, the keystroke is encoded in step 68, and sent to the PC in step 69. Each such keystroke provides the basic text composition of the prior art. Following transmission of the keystroke 69, the event handling routine exits 70. This is the exit point of the process block routine 56 of Fig. 5. Assuming a new event has caused the event handler routine to be entered, and that the keyboard is in the keyboard mode, decision block 61 again causes the flow of control to pass to decision block 65. If a force is detected on the surface of the keyboard, then decision block 65 causes the flow of control to pass to decision block 66. Decision block 66 determines whether or not this is above a threshold for operation of a control mode such as the pointing mode. Assuming that it is above the threshold, the pointing mode is entered in step 67 by changing an item in the data structure maintained by the keyboard microprocessor from the condition which indicates keyboard mode to the condition which indicates pointing mode. If the event is not above a predetermined level such as the required threshold, set at initialization 54 of Fig. 5, the event handling routine is exited at 67a. Once in the pointing mode, control passes via decision block 61 and is routed to decision block 63 as the keyboard is now in the pointing mode and not in the keyboard mode. Decision block 63 routes control to step 71, since a keystroke has not been detected, wherein each of the analog to digital converters 33, 34 of Fig. 3 is read. This provides a reading indicative of the amount of force in each of two coordinate directions detected by the Hall devices in the hall sensor 27. Assuming that the mouse mode has not been selected, as determined in decision block 72, these readings are added to cumulative totals of X and Y force measurements in step 77, X and Y denoting each of the directions in which the pair of differential Hall devices are oriented. In decision block 78, it is determined whether or not the cumulative amount of force over time exceeds that of a threshold or predetermined level. If so, the value is encoded in step 79. The encoded displacement along the axis X is sent in 80 to the PC keyboard port in the form of cursor movement keystroke codes as the mouse mode has not been set. The portion of the accumulated X value is subtracted in step 81 from the cumulative total to establish a new, correct cumulative X. Control is then passed to decision block 85 to deal with the cumulative Y count is the same way. Control would have also been passed to decision block 85 if the cumulative X count had not exceeded the threshold as determined at decision block 78. A similar encoding of force detected along a Y axis is affected. In decision block 85, the cumulative total of force measured along the axis defined by the orthogonal pair of Hall devices shown in Figs. 2 and 3 is compared against a threshold or predetermined level. If this threshold is exceeded, the result is encoded in step 82 and sent to the PC in step 83. The encoded quantity is then subtracted from the cumulative total in step 84, and the event handler is then exited in 86. If the Y threshold value was not exceeded in decision block 85, the event handler is likewise exited at step 86. Thus, each force measurement while in the pointing mode is encoded as cursor movement keystrokes, identifying the amount of displacement in two orthogonal directions for the cursor. Returning to decision block 72, had the mouse mode been set to ON during the keyboard initialization, control passed at this point to step 73 to encode the content of the cumulative X and Y counts as a mouse data stream format datum. This datum is routed to the mouse port of the PC at step 75 and the event handler is exited at 76. Referring now to Fig. 6B, there are shown additional steps executed by the keyboard microprocessor 35 when executing the event handler in the pointing mode to effect a simulation of two mouse buttons, or send a message requesting a search for a nearby character, or to effect a return to the keyboard mode. Assume for this example that the user has depressed one or more keys. If one key is depressed which is the space bar, then decision block 89 routes the control flow of the program to function 94 which takes the system out of the control mode, in this instance the pointing mode and returns it to the keyboard mode. Following this mode change, the event handler returns control as shown in block 95. In the event that the keystroke or strokes effecting the program control flow at decision block 89 is a character key other than the space bar, decision block 88 determines whether a single key or multiple keys were depressed. If a single key was depressed control flow is routed to block 90 and an escape code message is sent to the PC in step 90. After this message is sent, the event handler is exited 91 in the familiar manner. The escape code message is received by the keyboard interrupt handler of the PC, and contains the character to be searched for among the displayed text. The keyboard interrupt handler in the PC can be conventional except insofar as its behavior when the escape message is received. Refer briefly to Fig. 7 which shows the additional program flow control needed to process keyboard streams containing escape messages. As will be evident with respect to Fig. 7, the computer 12, upon receiving this message, conducts a search 117 to locate a character identified by the keystroke, within the display memory, which is closest to the coarsely positioned cursor. This search can be performed by any of several methods commonly known to those skilled in the art. Having completed the search, this routine reaches decision block 118 where, if the search is successful, the move cursor routine 119 positions the cursor. If the search is unsuccessful, the keyboard buffer 120 is flushed of the escape sequence without any cursor repositioning. The remainder of the keyboard interrupt handler may then execute according to its control flow. Returning to decision block 99 of Fig. 6B, it is determined the system is in the mouse mode. In this instance control flow is routed to decision block 100, where the decision is made whether or not most of the depressed keys are on the left or right of the centerline, thereby identifying whether or not a left or a right mouse button has been selected. These determinations result in commands being sent to the computer, assuming the mouse mode is ON. In step 101, a left mouse button command is sent to the PC mouse port and in step 103, a right mouse button command is sent to the PC mouse port. In either case, the event handler is exited in the familiar manner in step 102 or step 104. If at 99 the keyboard were not in mouse mode, the multiple key depression would represent a user error and would result in an exit with no action taken. It should be clear to those skilled in the art that the rudimentary functions described herein can be easily expanded to provide more sophisticated pointing device functions, such as "double clicks", mice with more than two buttons, and dragging functions. These elaborations should not be viewed as departures from the spirit of this invention. Thus, it can be seen that by using the foregoing apparatus it is possible to provide for efficient keyboard operation using standard keyboard entry, as well as control function entry such as pointing and mouse functions, without incurring major inefficiencies. Operators may thus operate keyboards without moving their hands from the standard typing position, and yet have pointing functions immediately available as if a mouse were in hand, without great physical exertion and without disturbing the efficiency of typing through the keyboard. There has now been described with respect to several embodiments, apparatus which establishes a different control function for a keyboard by sensing the presence of a lateral force having a given or predetermined range of magnitudes. This may be implemented as one of many control functions or pointing functions such as a cursor movement or mouse function, permitting mouse functions to be emulated without additional keys or unfamiliar manual operation. One embodiment of the invention is a keyboard comprising: a keyboard case; and a keyboard mounting plate including a plurality of keys, with said keyboard mounting plate being resiliently mounted on said keyboard case such that the application of a lateral force to any one of said plurality of keys produces a lateral movement of said keyboard mounting plate with respect to said keyboard case. The combination described as the first embodiment may further include a sensor for producing a control signal in response to sensing the lateral movement of said keyboard mounting plate; and a computer coupled to said sensor, which is responsive to said control signal for executing a predetermined control function. In the first embodiment, the said control signal may be one of a command signal and a data signal and the said command signal may be a pointing command or mouse command signal. The first embodiment may further include means responsive to the concurrent vertical depression of any two of said plurality of keys belonging to a first predefined group of keys as a first pointing command signal and the concurrent vertical depression of any two of said plurality of keys belonging to a second predefined group of keys as a second pointing command signal. A second embodiment of the invention is a keyboard computer system comprising: a keyboard case; resilient mounting means connected to said keyboard case; a keyboard mounting plate including a plurality of keys, with said keyboard mounting plate being connected to said resilient mounting means such that the application of a lateral force to any one of said plurality of keys produces a lateral movement of said keyboard mounting plate with respect to said keyboard case; a sensor coupled to one of said resilient mounting means and said keyboard mounting plate for producing a control signal in response to sensing lateral movement; and a computer coupled to said sensor, which is responsive to said control signal for executing a predetermined control function. The second embodiment may further include a display device on which change in indicia are manifested in response to the execution of the predetermined control function by said computer. In the second embodiment said control function may be a pointing function or a mouse function. The second embodiment may further include means responsive to the concurrent vertical depression of any two of said plurality of keys belonging to a first predetermined group of keys as a first mouse button command and the concurrent vertical depression of any two of said plurality of keys belonging to a second predetermined group of keys as a second mouse button command. A third embodiment of the invention is a keyboard and computer system for user entry of text and control functions comprising: a keyboard case; resilient mounting means connected to said keyboard case; a keyboard mounting plate including a plurality of keys and a space bar, each of which is vertically displaceable in response to the application of a vertical force by a user, with said keyboard mounting plate being connected to said resilient mounting means such that the application of a lateral force to any one of said plurality of keys produces a lateral movement of said keyboard mounting plate with respect to said keyboard case; a first sensor coupled to one of said resilient mounting means and said keyboard mounting plate for producing a control signal in response to sensing lateral movement; a second sensor coupled to said plurality of keys and space bar for producing a different coded keyboard signal indicative of a character or command in response to the vertical depression of each different one of said plurality of keys and said space bar; a computer coupled to said first and second sensors, which are responsive to said control signal for executing a predetermined control function, and which is responsive to each of the different coded keyboard signals for producing decoded keyboard signals; and a display device coupled to said computer, on which characters are displayed in response to the decoding of keyboard signals by said computer, and on which other indicia is manifested in response to the execution of said predetermined control function by said computer. A fourth embodiment of the invention is a method of operating a keyboard and computing system including a keyboard mounting plate resiliently mounted on a keyboard case, with said keyboard mounting plate including a plurality of keys and a space bar, each of which is vertically displaceable in response to the application of a vertical force by a user to produce keyboard signals when in a keyboard mode of operation, with lateral movement of said keyboard mounting plate relative to said keyboard case being produced in a response to the application of a lateral force to any one of said plurality of keys and space bar by the user for producing control signals when in a control mode of operation, for providing the keyboard signals to a computer when in the keyboard mode of operation and the control signals to the computer when in the control mode of operation, said method including the steps of: beginning operation in the keyboard mode of operation; switching to the control mode of operation in response to sensing the application of a lateral force greater than a threshold level to at least one of the keys and the space bar; and returning to the keyboard mode of operation in response to the application of a vertical force to a predetermined one of the keys or space bar. A fifth embodiment of the invention is a keyboard comprising: a keyboard case; and a keyboard mounting plate including a plurality of keys, with said keyboard mounting plate being resiliently mounted on said keyboard case by resilient mounting means such that the application of a lateral force to any one of said plurality of keys produces a strain in one of said keyboard mounting plate and said resilient mounting means. The fifth embodiment may include a sensor for producing a control signal in response to sensing the strain in one of said keyboard mounting plate and said resilient mounting means; and a computer coupled to said sensor, which is responsive to said control signal for executing a predetermined control function. In the fifth embodiment a said control signal may be one of a command signal and a data signal and said command signal may be a pointing command or a mouse command signal. The fifth embodiment may include means responsive to the concurrent vertical depression of any two of said plurality of keys belonging to a first predefined group of keys as a first pointing command signal and the concurrent vertical depression of any two of said plurality of keys belonging to a second predefined group of keys as a second pointing command. A sixth embodiment of the invention is a keyboard computer system comprising: a keyboard case; resilient mounting means connected to said keyboard case; a keyboard mounting plate including a plurality of keys, with said keyboard mounting plate being connected to said resilient mounting means such that the application of a lateral force to any one of said plurality of keys produces a strain in one of said keyboard mounting plate and said resilient mounting means; a sensor coupled to one of said resilient mounting means and said keyboard mounting plate for producing a control signal in response to sensing a strain in one of said keyboard mounting plate and said resilient mounting means; and a computer coupled to said sensor, which is responsive to said control signal for executing a predetermined control function. The sixth embodiment may include a display device on which change in indicia are manifested in response to the execution of the predetermined control function by said computer. In the sixth embodiment, said control function may be a pointing function or mouse function. The sixth embodiment may include means responsive to the concurrent vertical depression of any two of said plurality of keys belonging to a first predetermined group of keys as a first mouse button command and the concurrent vertical depression of any two of said plurality of keys belonging to a second predetermined group of keys as a second mouse button command. A seventh embodiment of the invention is a keyboard and computer system for user entry of text and control functions comprising: a keyboard case; resilient mounting means connected to said keyboard case; a keyboard mounting plate including a plurality of keys and a space bar, each of which is vertically displaceable in response to the application of a vertical force by a user, with said keyboard mounting plate being connected to said resilient mounting means such that the application of a lateral force to any one of said plurality of keys produces a strain in one of said keyboard mounting plate and said resilient mounting means; a first sensor coupled to one of said resilient mounting means and said keyboard mounting plate for producing a control signal in response to sensing a strain in one of said keyboard mounting plate and said resilient mounting means; a second sensor coupled to said plurality of keys and space bar for producing a different coded keyboard signal indicative of a character or command in response to the vertical depression of each different one of said plurality of keys and said space bar; a computer coupled to said first and second sensors, which are responsive to said control signal for executing a predetermined control function, and which is responsive to each of the different coded keyboard signals for producing decoded keyboard signals; and a display device coupled to said computer, on which characters are displayed in response to the decoding of keyboard signals by said computer, and on which other indicia is manifested in response to the execution of said predetermined control function by said computer. An eighth embodiment of the invention is a method of operating a keyboard and computing system including a keyboard mounting plate resiliently mounted on a keyboard case, with said keyboard mounting plate including a plurality of keys and a space bar, each of which is vertically displaceable in response to the application of a vertical force by a user to produce keyboard signals when in a keyboard mode of operation, with a strain being produced in one of said keyboard mounting plate and said resilient mounting means in a response to the application of a lateral force to any one of said plurality of keys and space bar by the user for producing control signals when in a control mode of operation, for providing the keyboard signals to a computer when in the keyboard mode of operation and the control signals to the computer when in the control mode of operation, said method including the steps of: beginning operation in the keyboard mode of operation; switching to the control mode of operation in response to sensing a strain in one of said keyboard mounting plate and said resilient mounting means as the result of the application of a lateral force greater than a threshold level to at least one of the keys and the space bar; and returning to the keyboard mode of operation in response to the application of a vertical force to a predetermined one of the keys or space bar. A ninth embodiment of the invention is a device for positioning a cursor on a display screen of a computing system comprising: a computer keyboard supported for horizontal displacement against a resistive force, said keyboard permitting text entry of data; a frame supporting said keyboard, including a means for measuring a manually exerted force in a plane of said keyboard including the direction and magnitude of said force; and, encoding means coupled to said measuring means for encoding said measured force into a direction of movement for said cursor, and a displacement for said cursor, whereby said computing system may position said cursor with respect to keyboard entered text in response to a force applied in a plane of said keyboard. In the ninth embodiment said computing system may be programmed to execute the steps of: interpreting a unique keystroke following positioning of said cursor; entering a character identification subroutine for determining the location of a displayed character adjacent said cursor which matches said word processing keystroke; and moving said cursor into alignment with said displayed character, whereby said character is positioned for editing with a subsequent keystroke operation. In the ninth embodiment said means for measuring may be an array of Hall effect devices for sensing a change in position of a magnet affixed to said keyboard. In a computer display system for positioning a cursor to a character of a line of displayed text; a tenth embodiment of the invention is a method for accurately locating said character of text comprising: manually positioning a cursor of said display in proximity of said character; selecting from a keyboard a keystroke corresponding to said character; initiating a search for the location of a character adjacent said cursor, corresponding to said keystroke; and moving said cursor into alignment with a located character, whereby said character is positioned for editing. The tenth embodiment may further comprise disabling positioning of said cursor in response to a subsequent unique keystroke command initiated by said keyboard. The tenth embodiment said initiating a search step may comprise the substeps of: examining character memory locations of text memory having addresses corresponding to text identified by said cursor position; and identifying the memory location closest to said cursor position having a character identified by said keystroke. In the tenth embodiment said cursor may be positioned at a location identified by said closest memory location address. An eleventh embodiment of the invention is a device for positioning a cursor on a computer driven display screen comprising: a data entry keyboard having a plurality of keys which are encoded to supply text information to said computer for display; a base supporting said keyboard for limited movement in a plurality of directions against a biasing force; a detector means for detecting the movement of said data entry keyboard with respect to said base, and resolving said movement into a direction of movement and displacement; and encoding means for converting a signal from said detector means into a cursor positioning command moving said cursor in a direction and distance identified by said direction of movement and displacement. In the eleventh embodiment, the keyboard may be supported at one end to said base by resilient post means, and at an opposite end by a tangential surface which permits sliding movement of said opposite end. In the eleventh embodiment said base may include end sections which capture said keyboard with said tangential surface and said flexible post. In the eleventh embodiment said detector means may comprise comprises: a magnet connected to move with said keyboard displacement; and an array of Hall effect devices supported on said base for encoding positional changes in said magnet position. In the eleventh embodiment said base may include upstanding flexible post means supporting at one end thereof said keyboard, and at a second end thereof, a bearing surface for supporting a second opposite end of said keyboard for sliding movement when said post means are flexed, and said base may include first and second end sections which captivate said keyboard with said post means and said bearing surface. A twelfth embodiment of the invention is a device for emulating mouse functions for a computer driven display system comprising a keyboard having a processor for encoding keystrokes into digital data characters for display by said display system, said processor including programming steps for detecting multiple simultaneous keystrokes which occur in a given location on said keyboard, and for generating a command from said processor indicating a mouse button mode has been selected in response to said detection. In the twelfth embodiment wherein said keyboard processor may be programmed to decode subsequent keystrokes in said given location as a mouse button closure. In the twelfth embodiment said keyboard processor my detect multiple simultaneous keystrokes in a second location, and generates a command which indicates that a second mouse button mode has been selected. In the twelfth embodiment subsequent keystrokes in said second location may be decoded by said keyboard processor as a second mouse button operation. A thirteenth embodiment of the invention is a method for providing cursor pointing instructions to a computer driven display system comprising: supporting a data entry keyboard for movement with respect to a base support in response to a manually exerted force applied along the plane of said keyboard; detecting movement of said keyboard; encoding detected movement of said keyboard as a cursor positioning command; and positioning said cursor in response to said cursor positioning command. In the thirteenth embodiment said encoded movement may represent the magnitude and direction of an applied force. In the thirteenth embodiment said supporting step may comprise supporting said keyboard at one end with at least one resilient flexible post for movement in said plane, and supporting an opposite end for sliding movement over a tangentially supporting member. In the thirteenth embodiment said encoded movement may include the magnitude of the force and time said force is applied. In the thirteenth embodiment said step of detecting movement of said keyboard may comprise; supporting a magnet to said keyboard for displacement with movement of said keyboard; supporting an array of Hall devices on said base support in proximity to said magnet; and combining signals from first and second pairs of said Hall devices to provide a position indicating signal representing the displacement of said keyboard. The thirteenth embodiment may further comprise digitizing said position indicating signal into said cursor position command. The thirteenth embodiment may further comprise determining when position indicating signals do not exceed a predetermined threshold; and inhibiting movement of said cursor when said position indicating signals do not exceed said predetermined threshold.

Claims: Keyboard comprising a keyboard case (8); a key switch mounting plate (10) including a plurality of keys, with said key switch mounting plate (10) being resiliently mounted on said keyboard case (8) such that the application of a lateral force to any one of said plurality of keys produces a lateral movement of said key switch mounting plate (10) with respect to said keyboard case (8); a sensor (27) for producing a control signal in response to sensing said lateral movement of said key switch mounting plate (10) with respect to said keyboard case (8); and a microprocessor (35) coupled to said sensor (27) which is responsive to said control signal and executes a predetermined control function on detection of said control signal. Keyboard according to claim 1, wherein said control signal is one of a command signal and a data signal. Keyboard according to claim 2, wherein said command signal is a pointing command signal. Keyboard according to claim 3, wherein said pointing command signal is a mouse command signal. Keyboard according to claim 3 including means responsive to the concurrent vertical depression of any two of said plurality of keys belonging to a first predefined group of keys to produce a first pointing command signal; and means responsive to the concurrent vertical depression of any two of said plurality of keys belonging to a second predefined group of keys to produce a second pointing command signal. Keyboard according to claim 1, wherein means for resiliently mounting said key switch mounting plate (10) on said keyboard case (8) comprise flexible posts (20) supporting at one end the key switch mounting plate (10); and a bearing (21) for supporting a second opposite end of said key switch mounting plate (10) for sliding movement when said flexible posts (20) are flexed. Keyboard according to claim 1 wherein said sensor (27) comprises a hall sensor; and a magnet (25) is mounted underneath the said key switch mounting plate (10) in close proximity to said hall sensor. Keyboard according claim 1, wherein said sensor (27) comprises a strain gauge. Keyboard according to claim 1, wherein said lateral movement can be in the direction of the x-axis, the y-axis or a combination of both axes. Method for using the keyboard (11) described in any of claims 1-8 in a computer system, said computer system additionally comprising a computer (12) and a display device (13), wherein such method comprises the following steps: a keyboard mode of operation during which text is entered into said computer (12) from said keyboard (11) at a given location set by a cursor (9) for display on said display device (13); switching (66) to a control mode of operation on detection of a lateral force greater than a set threshold level to the said key switch mounting plate (10) of said keyboard (11); moving the said cursor (9) to a new location dependent on the direction and duration of application of said lateral force; detecting the application of a vertical force to keys mounted on said key switch mounting device (10); and returning (89) to said keyboard mode of operation in response to the detection of the application of a vertical force to a predetermined one of said keys mounted on said key switch mounting plate (10). Method according to claim 10, wherein the step of detecting the application of a vertical force to keys mounted on said key switch mounting device (10) further includes the following steps: analysing to which of said keys said vertical force has been applied; and carrying out a function in response to said application of said vertical force to said analysed key. Method according to claim 11, wherein said routine comprises searching (88), if said vertical force has been applied to only one of said keys, for the nearest occurrence in the text of the character corresponding to said key to which said vertical force has been applied. Method according to claim 11, wherein said routine comprises detecting (99), if said vertical force has been applied to more than one of said keys and if said computer (12) is in mouse mode operation, whether the majority of the keys to which said vertical force has been applied are on the left hand side of said keyboard (11) and, if so, sending to said computer (12) from said microprocessor (35) the same signal that would hav been sent by the activation of the left hand button of a mouse, otherwise, sending from said microprocessor (35) to said computer (12) from said microprocessor (35) the same signal that would have been sent by the activation of the right hand button of a mouse.

Inventors: COMERFORD LIAM DAVID, LAIBINIS JOSEPH JOHN, COMERFORD, LIAM DAVID, LAIBINIS, JOSEPH JOHN
Applicants: IBM, INTERNATIONAL BUSINESS MACHINES CORPORATION
Application year: 1991
Main classification: G06K11
IPC codes: G06F3, H03M11