CURSOR CONTROL DEVICE WITH AUXILIARY CONTROL MODE

Abstract: Utility for use with devices intended for positioning and control of PC cursors and other objects in two or three dimensions, where the device incorporates a control module that can move within a defined range (37) and instigate congruent motion of cursor and object as the normal control mode; where the utility physically defines fringe zones (34) within the control module's mobility range where movements generate vectors (VB, VC) that are used to control an auxiliary, sustained motion of cursor or object.

Description: Cursor Control Device with Auxiliary Control Mode The described invention represents a cursor control device intended for positioning and control of PC cursors and other objects in two or three dimensions, comprising a control module that can move within a defined range and instigate congruent motion of cursor and object as the normal control mode, where the mobility range has a physically defined fringe zone where movements of the control module generate vectors that are used to control an auxiliary, sustained motion of cursor or object. The most popular devices used for positioning and control of cursors and other graphical symbols and objects on the PC screen are mice, trackballs, trackpoints, joysticks and touch pads. Mice and trackballs are operated by hand and thumb, respectively, of which none are especially trained for precise movement. Other systems that utilise finger or hand control are described in U.S. Pat. 4,736,191; U.S. Pat. 4,680,577; PCT/US89/05662; EP A3 0,295,368; EP A1 0,640,937; U.S. Pat. 4,719,455; PCT/JP89/01148; PCT/CA90/00022; U.S. Pat. 4,935,728 and EP A3 0,556,936. This inventor has developed control devices previously described in PCT/NO94/00113, PCT/NO96/00077 and in PCT/NO98/00233, where the control module comprises a member that may be gripped by fingers or hand (control stick) , this member being attached to a plate (guide plate) . Devices based upon the stick-and-plate configuration satisfy many of the requirements of an ideal cursor control device. One important reason is that they may be handled according to writing or drawing motions and thereby utilise the precise steering abilities of hand, thumb and index finger in combination. The device described in PCT/NO96/00077 utilises an optoelectronic sensor system. Here, lasers attached to the control module will direct light beams towards reference planes containing sensor matrixes or address pixels. The spots where light beams hit the reference plane (or planes) determine the position and spatial conformation of the control module. This concept may be used for control of objects both in two and three dimensions. A different sensor system is employed in PCT/NO98/00233. Instead of using concentrated light beams to determine the posi tion of the control module, diode lasers are here used to detect Ji.0ve2ne.nt. Each time the control module is moved relative to a reflector plane containing grid patterns (consisting of parallel stripes) , laser beams will traverse the stripe sets and create reflected light pulses. The pulse frequency and duration of the pulse trains will give information about speed, direction and extension of movement. The reflected pulses are detected by photosensors, and signals being generated are used to control screen cursors or other objects. Because the mobility range of the control module is considerably less than the screen area, the device must either rely upon a high response/signal ratio (with an accompanying low precision) , or be equipped with utilities that provide extended positioning and motion control, e.g. instigating a sustained motion. The mouse extends the motion of screen cursors by being lifted and repositioned on the tabletop. The same result is obtained with the touch pad by lifting and repositioning fingers on the pad. The joystick and trackpoint enable unlimited movement, with speed and direction being controllable as a result of force applied to the stick in a certain direction (hereafter called "vectorial" motion control) . The stick-and-plate concept as formerly described provides a congruent movement of cursor and object when the control module is moved in the X-Y plane. Because this X-Y movement is restricted to a defined area (the mobility range) , different utilities have been employed to extend its motion control. Switch functions attached to the stick may interrupt signal transmission and allow the control module to be re-positioned after reaching the border. Other devices utilise stress sensors coupled to the stick or guide plate, providing possibilities of a similar, unlimited movement as the joystick and trackpoint (PCT/NO94/00113) . An alternative embodiment is described in PCT/NO96/00077) , where optical sensors are employed to obtain vectorial motion control Other devices utilise stored position or motion information retrieved by switch functions to enable continuous movement. This principle may be exemplified by EP Al 0,539,599, which utilises a dome-shaped control module that is handled in the same way as a trackball. The device incorporates a magneto-electronic system for signal generation. When the dome slider is brought to the limit of its mobility range, a switch function is activated and a motion vector is fetched from the device's processor memory. This vector is based upon the movement of the dome slider immediately before the switch was activated. The vector is generated continuously according to the movement of the dome slider, and stored vectors are substituted with new at a given frequency. The extended motion control of the cursor is based upon this vector. Said patent description is also mentioning use of stress sensors for initiating sustained motion. The concept as described in EP Al 0,539,599 and similar technical embodiments have several weaknesses. Firstly, the vector presently stored in the processor memory does not necessarily describe the continuous movement that the user intends to initiate when the switch is activated. Secondly, the device does not respond when the user tries to adjust the direction of movement when the dome slider is pushed against the border. This inventor has surprisingly discovered that the stick- and-plate concept as described in PCT/NO96/00077 and PCT/NO98/00233 provide an excellent foundation for a vector based control mode that may be utilised for a precise, sustained motion control. An important prerequisite is that this concept allows establishment of fringe zones within the mobility range that can be defined by addresses or by physical marks that can be detected by a sensor system. Both systems utilise light beams to generate position- or motion-signals, and a certain part of the total area where light beams may hit the sensor matrix or the reflector plane is defined as the fringe zone. If the mobility range of the control module is circular, the fringe zone is defined as constituting the area outside a circle located at a certain distance from the outer limit of the mobility range. By using fringe zones delimited by physical marks or specific addresses, one is permitted to define exactly where (or exactly when) a light beam enters the zone. This point defines the origin of the vector. The vector's end point coincide with the point where the beam strike the reference plane (or reflector plane) when the module is pushed against the outer border of its mobility range, or the end point may change continuously if the laser beam is moved within the fringe zone. The same origin will apply for all vectors being generated, as long as the laser beam is moved within the fringe zone. When the control module and its accompanying laser beam is moved out of the fringe zone, the device returns to congruent motion control (normal mode) . The device utilising position based cursor control according to PCT/NO96/00077 employs addresses on the reference plane to define the fringe zone, while the device generating control signals on the basis of movement of the control module (PCT/NO98/00233) will contain a physical mark on its grid that identifies a fringe zone borderline, or the whole fringe zone. A prerequisite is that the fringe zone pattern may be "read" and interpreted as different from the remaining grid pattern by the photosensor system. Devices employing other sensor systems may use similar utilities for defining a fringe zone, particularly devices using capacity, inductivity, conductivity, pressure and optical means to detect motion or define the position of a control module. Use of utilities as described above implies that the transition between congruent and vectorial motion control is automatically initiated without switches or stress- sensors being activated, and the transition will therefore be unnoticeable to the user. When the control module is pushed against its mobility border, the cursor will continue to move according to the defined motion vector, with the possibility of changing both direction and speed. By using said utility, an extended motion control is achieved by using the same sensor system. The width of the fringe zone may vary within wide limits. When employing a position based motion control according to PCT/NO96/00077, the user may alter this width. With devices utilising motion based control, a permanent fringe zone will be established during manufacturing of the device. However, utilising different marks or grid patterns to define fringe zone borders may allow establishment of several fringe zones. The width of the fringe zone will typically represent 1-5% of the diameter of the mobility range. Preferred embodiments and their use will now be described by examples with reference to accompanying figures, where: Fig. 1 shows in perspective a control module that may be used as part of a device where the invention is applied. Fig. 2 shows in perspective the control module according to Fig. 1 when incorporated in a computer chassis. Fig. 3 shows a control device incorporated in a portable computer. Fig. 4 is a vertical section of part of the control device according to an embodiment utilising laser beams and an addressable photosensor matrix for assessment of position and spatial conformation of the control module. Fig. 5 shows a section of the control module illustrated in Fig. 4, where laser beams utilised for determination of positions are indicated. Fig. 6 indicates where laser beams may hit the sensor matrix, with an indication of a fringe zone. Fig. 7 is a vertical section of part of the control device according to an embodiment utilising laser beams and a reflector plane containing non-reflecting grids for determination of movement in the X-Y plane. Fig. 8 illustrates a reflector plane containing two sets of grids (stripe grids) . Fig. 9 shows an employed arrangement of light source (diode laser) , optics and photosensor associated with a device as illustrated in Fig. 7. Fig. 10 shows a section of a grid where reflecting and non-reflecting stripes have different width, and signals generated from a photosensor when light beams traverse the grid in opposite directions. Fig. 11 illustrates a circular grid consisting of parallel stripes that are being used for detection of movement along the X-axis, and which incorporates a circular pattern defining the inner borderline of the fringe zone. Fig. 12 illustrates a magnified section of the X-grid, where a pattern used to define the inner borderline is indicated together with three alternative paths taken by the laser beam when crossing the border. Fig. 13 shows signals generated by the X- and Y- detectors when laser beams are moved along three different paths according to Fig. 12. Fig. 14 shows a magnified section of the X-grid, where an alternative and preferred pattern is used to define the inner borderline of the fringe zone, and where two alternative paths taken by the laser beam when crossing the border are shown. Fig. 15 shows signals generated by the X- and Y- detectors when laser beams are moved along two different paths according to Fig. 14. Fig. 16 shows a vertical section of a control device incorporating a capacitance-based sensor. Figs. 17A and 17B show details of the capacitance sensor. Fig. 18 shows the mobility range of the control module according to Fig. 16, indicating the fringe zone. Fig. 19 illustrates a sequential, composite movement of the laser beam within and outside the fringe zone, in addition to vectors being generated as a consequence of this movement . Fig. 20 illustrates a composite movement of the laser beam within the fringe zone, with co-ordinates and angles used to describe two vectors. A more detailed description of different parts of the device and their function are presented in the following: Figs. 1, 2 and 3 illustrate the main components of one type of control devices that may utilise the invention, comprising a control stick 2 and a circular guide plate 3 that are incorporated in a computer chassis 4. When in use, the control stick is held between thumb and index finger, or a fingertip is put on top of the stick to obtain the intended movement. Figs. 4, 5, and 6 illustrate components of a device that utilises a position based sensor system. Light beams generated by three diode lasers 5, 6 and 7 are directed towards a reference plane 8 incorporating a sensor matrix 9 (e.g. a CCD chip). Light spots appearing on the surface are indicated in Fig. 9 at 11, 12, 13 and 14. When the control module is moved, the position of the light spots change. Their position on the sensor matrix provides information about the position and spatial orientation of the control module, which again may be used to control cursors or other objects in two or three dimensions. Light spot 14 is used for tracking the movement of guide plate 3. The mobility range of this light spot is indicated in Fig. 6 as the area within circle 15. As basis for generating a motion vector an inner fringe zone border 16 is established by means of addresses. Movements of the light spot into the fringe zone 17 between the circles 15 and 16 will generate a continuous motion until the light spot leaves the fringe zone, whereupon congruent motion control is resumed. With this particular embodiment, the position of the inner fringe zone border is defined by set of addresses. This implies that the user may change the position of the border and thereby define where vectorial motion control is to be initiated. The invention may also be used in conjunction with motion based signal generation. The device described in PCT/NO98/00233 employs light beams emitted by two laser/sensor units (18 and 19, Fig. 7) . The beams are directed towards a reflector plane 20 containing grids 21, 22 that consist of non-reflecting stripes (Fig. 8) . When the control stick 2 and guide plate 3 are moved in the horizontal plane, the grids will move relative to the impinging laser beams and cause pulse formed light reflections. The light pulses are detected by photosensors, generating signals that provide information about the control module's motion, which again may be used to control PC cursors and other virtual or physical objects. In Fig. 7, the reflector plane 20 with grids is localised on the underside of the guide plate 3. Two diode lasers are incorporated in compact detector units 18, 19 together with photosensors and necessary optics, and these units are attached to the bottom of the detector chamber. Fig. 8 illustrates the reflector plane 20 with two separate grids; grid 21 is used to detect movement along the Y-axis (Y-grid) and grid 22 is used for detection of X-movement (X-grid) . The non-reflecting (and reflecting) stripes of grid 21 are oriented at right angles to the Y- axis, while the stripes of grid 22 are oriented at right angles to the X-axis. Fig. 9 shows details of one of the detector units 18, which is similar to the reading units used for CD- players, CD-ROM, etc. It incorporates a diode laser 27, a prism 25, a focussing lens 24, a focussing coil 23 and a photodetector 26. The path of the laser beam is indicated. For simplicity -reasons, the beam geometry is omitted. Fig. 10A shows a "polarised" grid pattern that utilises non-reflecting (31, 32) and reflecting (29, 30) stripes of unequal width. Fig. 10B is a cross section of the reflector plane 20, illustrating how laser engraving may create non-reflecting (31, 32) and reflecting stripes of unequal width. When laser beams are traversing this grid pattern, the photosensor will generate a pulse train that is characteristically different in +X and -X direction (Fig. IOC) . In +X direction a pulse of medium length (M) will immediately precede a short pulse (S) , while the opposite is true when moving in -X direction. This kind of grid pattern permits the use of one single photosensor for each axis, in addition to simplified detector optics. Fig. 11 illustrates the physical impression of an inner fringe zone borderline 35 on the X-grid. The fringe zone 34 is localised between the inner 35 and outer 33 borderline, the latter encompassing the mobility range of the laser beam. Contrary to position based control devices that may define the fringe zone by means of a set of addresses, a physical delimitation is needed by motion based devices. The inner borderline may be created by means of a modification of the grid pattern, which implies that reflected light pulses would change character when the laser beams cross the borderline. In Fig. 12 this is illustrated by the X-grid incorporating a ring 35 of non-reflecting stripes 36. This creates a dense pattern of stripes that will yield light reflections that are shorter and weaker than reflections stemming from other parts of the mobility range. Fig. 12 indicates three di-fferent paths of a laser beam traversing the X-grid, starting at A and thereafter moving to either B, C or D. In Fig. 13 signals generated by the alternative paths are presented, as associated with the X- and the Y-grid. Fig. 13A shows signal strength as a function of time for the path A-B, the signal associated with the X-grid is constant as long as the movement is parallel to the stripe set. This is. indicated at S c , representing the signal used for congruent motion control. When the laser beam traverses the inner borderline the signal changes to S x , establishing T x as the instant when the laser beam enters the fringe zone 34. After that, the signal S v is used for vectorial motion control. In a similar way, the signal associated with the Y-grid will change character when the inner border is crossed. Because the laser beam will move at a right angle to the Y-stripes when moving from A to B, the signal frequency (Sc and S v ) will show maximum value. Figs. 13B and 13C show, similarly to Fig. 13A signal strength as a function of time for the A-C and A-D paths. In Fig. 13B the laser beam moves approximately 45° relative to both grids, while the path in Fig. 13C is parallel to the Y-grid. Fig. 14 illustrates an alternative borderline 35. Here, the non-reflecting stripes 36 are applied as concentric circles upon the two grids. Thus, crossing the borderline generates same signal from the X- and Y-grid. The two paths A-B and A-C in Fig. 14 illustrate this, with associated signals shown in Fig. 15A and Fig. 15B. A different sensor system is employed in the device shown in Fig. 16. Here, the sensor constitutes a capacitor consisting of a circular plate 38 that can be moved relative to a second plate- 39, which is split in four sectors (Figs. 17A and 17B) . By moving the upper plate 38 by means of the stick 2, the capacitance established between 38 and the four segments 39 at any time can be used to determine the position of the control module in the X-Y plane. It is therefore possible to define a fringe zone (Fig. 18) between the outer limit of the mobility range 43 and a specified inner borderline 44, which is defined by a set of addresses. Important properties of the invention are that it allows precise, unlimited motion control, and that both direction and speed may be altered when operating the module in the fringe zone. This is illustrated in Figs. 19 and 20. Fig. 19 illustrates movements of a laser beam relative to one of the grids, starting at A, crossing the inner borderline at X, then moving towards the outer border B, and following the periphery to C, D and E. All vectors ( V B , V Cr V D and V B ) being generated when the laser beam is moved within the fringe zone (between 33 and 35) refer to the crossing point X as origin. This permits a rapid and simple correction of speed and direction by moving the control module an its associated laser beam clockwise or counter-clockwise along the outer border of the mobility range. When the laser beam is moved out of the fringe zone at Y, the vectorial motion control discontinues and the control along the stretch Y-F-Z will be in congruent mode. When the laser beam once more is moved into the fringe zone at Z and moves towards G, a new motion vector V G is generated that will have Z as origin. Fig. 20 illustrates how properties of the motion vector (direction and speed) may be calculated. The vector's angle α when moving the control module in the direction X-3 is determined as follows: The length of the vector denotes the speed, and is determined by the speed of motion between X and B. For position based control devices according to Fig. 4, the speed is simply calculated on basis of the duration when moving the laser beam from X (XχY x ) to B (X B Y B ) . and the distance between the addresses X X Y X and X B Y_ . - Based upon these data, an average speed along the X- (V BX ) and Y- axis (V B γ) may be calculated. The resulting speed being described by the vector is therefore: For motion based control systems according to Fig. 7, the speed will be determined by the average pulse frequency (f) associated with reflections from the two grids during movement from X to B. For simplicity reasons, the speed established by the vector is expressed as: V B = f 2 +f C is a constant that is used to transform pulse frequency to speed of motion. When the control module is moved, e.g. to change the direction of movement initiated by the vector, the laser beam moves, e.g. from B to C. The new angle β may then be calculated as follows: One may decide whether the speed determined by the new vector Vc is to be based upon the speed between B and C, or if the new speed shall constitute an average for the whole movement X-B-C. The mathematical expressions for all alternatives are relatively simple. The utility of the invention is hitherto demonstrated on the basis of control devices that use opto-electronic and capacitance based sensors. In principle, every cursor control unit that utilises control modules with limited mobility may use the invention, provided that the position of the control module can be determined exactly, and that it is possible to define fringe zones as described above. Such alternative embodiments will be obvious to people skilled in the art.

Claims: Patent claims 1. Utility for use with devices intended for positioning and control of PC cursors and other objects in two or three dimensions, where the device comprises a control module that is limited in its mobility to a defined area (mobility range) and incorporates sensors for determining position or speed and direction of movement of said control module; where position, speed and direction of movement are used to generate signals that control said cursor or object; characterised in that the utility physically defines fringe zones within the control module's mobility range; where movements of said module change the outcome of the device's signal generation; where position or motion signals that are generated when the module is moved into and within the fringe zone are used for a continuous calculation of vectors controlling a sustained motion of cursor or object; where a subsequent movement of the control module out of the fringe zone induces the device to revert to a normal, congruent motion control. 2. Utility for use with devices intended for positioning and control of PC cursors and other objects in two or three dimensions, where the device incorporates a control module comprising a control stick (2) that may be gripped by fingers or hand, which is attached to a guide plate (3) ; the guide plate is movable in all directions in the X-Y plane by means of the stick; where movements of the control module are detected by means of a suitable sensor system; where the device further incorporates switches that are associated with the stick or localised elsewhere on the device as well as a system for interpretation of the electronic signals that sensors and switches generate and transform them to signals that are used to control position, orientation, speed and direction of movement and other properties associated with said cursor or object; characterised in that the utility physically defines fringe zones within the control module's mobility range; where movements of said module change the outcome of the device's signal generation; where position or motion signals that are generated when the module is moved into and within the fringe zone are used for a continuous calculation of vectors controlling a sustained morion of cursor or object; where a subsequent movement of the control module out of the fringe zone induces the device to revert to a normal, congruent motion control. 3. Utility for use with devices intended for positioning and control of PC cursors and other objects in two or three dimensions; where the device incorporates a control module comprising a control stick (2) that may be gripped by fingers or hand, which is attached to a guide plate (3); the guide plate is movable in all directions in the X-Y plane by means of the stick; where movements of the control module are detected by opto-electronic means by use of light sources, reflector planes and photosensors that are attached to the control module or to stationary parts of the device in such a manner that they move relative to each other when the control module is moved, whereby light beams traverse non-reflecting grids on the reflector plane and cause pulse formed light reflections that are detected by photosensors; where the device further incorporates switches that are associated with the stick or localised elsewhere on the device as well as a system for interpretation of the electronic signals that sensors and switches generate and transform them to signals that are used to control position orientation speed and direction of movement and other properties associated with said cursor or object; characterised in that the utility defines fringe zones within the control module's mobility range in the form of physical tracks or alterations of the grids that define the inner borderline of, or the entire fringe zones; where movements of said module change the outcome of the device's signal generation; where position or motion signals that are generated when the module is moved into and within the fringe zone are used for a continuous calculation of vectors controlling a sustained motion of cursor or object; where a subsequent movement of the control module out of the fringe zone induces the device to revert to a normal, congruent motion control. 4. Utility according to claim 3, characterised in that the physical tracks or alterations are represented by grid patterns that are different from the rest of the grid, causing reflected light pulses that are different from the pulses generated from other parts of the grid. 5. Utility for use with devices intended for positioning and control of PC cursors and other objects in two or three dimensions; where the device incorporates a control module comprising a control stick (2) that may be gripped by fingers or hand, which is attached to a guide plate (3) ; the guide plate is movable in all directions in the X-Y plane by means of the stick; where movements of the control module are detected by opto-electronic means by use of light sources and reference planes that are attached to the control module or to stationary parts of the device in such a way that they move relative to each other when the control module is moved, whereby the points where the light beams hit reference planes can be localised and provide position information that may form the basis for a definition of the control module's position and spatial conformation and which may form a basis for control of said cursor or object; where the device further incorporates switches that are associated with the stick or localised elsewhere on the device as well as a system for interpretation of the electronic signals that sensors and switches generate and transform them to signals that are used to control position, orientation, speed and direction of movement and other properties associated with said cursor or object; characterised in that the utility defines fringe zones within the control module's mobility range in the form of specific addressable elements on the reference plane; where movements of said module change the outcome of the device's signal generation; where position or motion signals that are generated when the module is moved into and within the fringe zone are used for a continuous calculation of vectors controlling a sustained motion of cursor or object; where a subsequent movement of the control module out of the fringe zone induces the device to revert to a normal, congruent motion control. 6. Utility according to claim 5, characterised in that the addressable elements are photosensitive elements of a photosensor matrix. 7. Utility according to claim 5, characterised in that the addressable elements are pixels containing position information. 8. Utility according to claims 1-7, characterised in that vectors that are generated when the module is moved into and within the fringe zone are characterised by an origin, which is identical to the point where the module crosses the fringe zone's inner borderline; where the direction and extension of the vector at any instant are calculated with reference the module's position relative to the origin.

Inventors: PEDERSEN STEINAR, PEDERSEN, STEINAR
Applicants: PEDERSEN STEINAR, PEDERSEN, STEINAR
Application year: 1998
Main classification: G06K11
IPC codes: G05G9, G06F1, G06F3