GRAPHIC DATA DISPLAY SYSTEM

Abstract: A computer based graphic editor has the capability of recognizing as a single graphic object a plurality of unconnected freehand strokes such as a signature. This makes possible editing a document with a signature, for example, without the various parts of the signature becoming separated and no longer being a viable entity. A cursor pointing device, such as a mouse with a button, is used to enter the plurality of unconnected strokes. Initially, the first point p₁ at the beginning of a stroke which is the first stroke of a plurality of unconnected strokes is read and stored with the visible attribute. As long as the mouse button is pressed, the position of the cursor is monitored and lines drawn from each successive point to the next point p₂ with each point p₂ being stored with the visible attribute. When the mouse button is released, the last read point position p₂ is stored with the invisible attribute. When the mouse button is pressed again, the first point p₁ of the next stroke is read and stored with the visible attribute, and the process repeated. When the mouse button is again pressed and released, the ending position of the previous stroke p ⊘ , the starting position of the current stroke p₁ and the ending position of the current stroke p₂ are compared and, if p₁ and p₂ are within a tolerance range and there exist no other points between p₁ and p₂ and if p₁ and p ⊘ are within the tolerance range, then the termination of the signature is detected.

Description: The present invention generally relates to graphic editors run on either a stand alone computer or a host connected work station and, more particularly, to a graphic editor for freehand drawing which will recognize as a single graphic object a plurality of unconnected strokes. Graphic editors for stand alone computers and host connected work stations are known which are capable of manipulating primitive graphic objects such as lines, circles, rectangles and the like. More sophisticated graphic editors also accept as input freehand drawing. Typically, a drawing cursor is displayed on the computer or workstation display screen, and this drawing cursor is moved by the operator using a cursor positioning device such as a joy stick, mouse or digitizing table and stylus. In some cases a so-called "touch screen" may be used as an input to the graphic editor wherein the operator may use his finger to trace out the freehand drawing on the display screen. For any pointing device, the user interface should be the same as long as there is at least one button on the pointing device. Alternatively, any key on the keyboard can be used if a button is not available. Examples of such systems are described in WO85/00683 and Compt. & Graphics, vol. 8, no. 4, 1984, Pergamon Press Ltd, US; pages 351 - 369, H Jansen et al: "Interpretation of freehand drawing for mechanical design processes." One application of freehand drawing in a graphic editor in a business environment is the signing of a signature. For example, in a mixed object editor which supports text objects as well as graphic objects in a common document, the operator may compose a letter or memorandum using the mixed object editor. Rather than printing this document, signing the original and making copies of the signed document for distribution, the operator may prefer to transmit the document electronically either within a network or via a nondedicated communication medium to the intended recipients. However, it is still desirable for the document, whether displayed or printed in hard copy, to bear the originator's signature as an indication of its authenticity. This can be done using the freehand drawing capabilities of some graphic editors, but there is a problem in the manipulation of the signature by the editor which sometimes produces strange results. Typically, a freehand graphic editor recognizes freehand drawing strokes as single graphic entities. Thus, the first name, middle initial and last name of the signature are each treated as separate entities. Moreover, some characters such as the letters i, j, f, t and x are composed of more than one stroke, and each stroke is treated as a separate graphic entity. As a result, it is possible in editing or transmitting a mixed object document, the signature will become divided between lines or pages. The division may be between parts of the name or even in the middle of a part of the name if that part contains a character comprising more than one stoke. The resulting display or print out of the document will therefore not contain a viable signature serving to authenticate the origin of the document. Summary of the Invention In general terms this invention is used in a data display device control system, such as a graphics editor to create a graphics object some lines of which are not displayed. Using the invention a signature which has disconnected strokes can be manipulated and transmitted as a single object. In an embodiment of the invention in the control system for a data display device, an attribute is defined for a freehand drawing. This attribute is the invisible line connection attribute and is turned on between strokes while the operator is writing his signature. For example, if the input draw cursor positioning device is a mouse or a joy stick, a button or key is provided on the mouse or joy stick which is pressed once by the operator between strokes while writing a signature and pressed twice upon completion of writing the signature. Similar user interfaces can be provided for other draw cursor positioning devices such as digitizing tablets and "touch screens". A freehand drawing is constructed by collecting a sequence of points on the display; i.e. p₁, p₂, p₃,..... For every adjacent point, a line segment is drawn between them. The distance between two points is dependent on how fast the pointing cursor can be recorded during the pointing device movement. This distance should be small enough to show the smoothness of the drawing. For every point p i , attributes such as line style, line width, and line colour are defined. If the colour attribute of a point is assigned to be the same as the background colour of the display, then the line segment between this point and the next adjacent point will be invisible on the display. The last point of each stroke should always have this invisible line attribute. Simulating the handwriting of the operator using a computer input device can be done in several different ways. In general, the operator needs to define both the starting position and the ending position of the writing. The starting position can be defined by detecting the position when the button on the pointing device is pressed. The ending position can be defined by detecting the position when the button on the pointing device is released. The "press-and-hold" user interface is very neutral since it is the same as a normal drawing process; that is, press the pen on the paper to draw and lift the pen off the paper to stop. The button on the pointing device is pressed at the beginning of each stroke and held during the stroke, and it is then released at the end of the stroke. During the freehand drawing, the user should be able to sign more than one signature without redefining the drawing mode. The system then needs to be able to distinguish the difference between two strokes and between two signatures. The difference is important if the whole signature needs to be treated as one signal object during a subsequent editing process. The termination of signature can be simply defined by pressing a previously defined key on the keyboard. This is not a very good user interface since the user has to move his finger from the pointing device to the keyboard. A better way of doing this is to use the button on the pointing device so the user can keep his finger on the pointing device all the time during the drawing. Introducing an extra click of the button at the end of the signature can achieve this purpose. The termination of a signature can be defined when both the following conditions are true: 1. The ending position of the previous stroke and the starting position of the current stroke are the same. 2. The current stroke contains only one point: i.e. a dot. Condition 1 by itself is insufficient for determining the termination of a signature simply because it implies that the user may start to draw the current stroke from the ending position of the previous stroke. Condition 2 by itself is insufficient for determining the termination of a signature simply because it implies a single dot is just drawn. By combining both conditions 1 and 2, the termination condition can be made unambiguous. Requiring the user to click the pointing device button without moving the pointing device is not easy since a slight hand movement during the clicking of the button can produce a completely different result. The system should allow a tolerance range during the extra click so that if the distance between any of those three points, the ending position of the previous stroke, the starting position of the next stroke, and the ending position of the next stroke are all within a tolerance range, 5mm for example, then it is considered that all three points are the same. According to the invention there is provided a method of storing a signature in a mixed object editor which supports text objects and graphic objects in a single document comprising the step of manually entering via an input device a plurality of unconnected strokes in a freehand graphics mode of said mixed object editor, said plurality of unconnected strokes constituting said signature; and characterised by: at the beginning of each said unconnected stroke, storing a visible attribute indicating the beginning of said unconnected stroke; at the end of each said unconnected stroke, storing an invisible attribute indicating the end of said unconnected stroke; and recognizing said plurality of unconnected strokes as a single graphic object in said mixed object editor by storing said strokes connected by invisible lines, where each line connects an invisible attribute to a successive visible attribute; whereby in formatting a document said mixed object editor will display said signature as a single freehand graphic object without fragmentation. In order that the invention may be more fully understood it will now be described by way of example with reference to the accompanying drawings, in which: Figure 1 is an illustration of a freehand drawing of a signature on a computer display showing in dotted line the invisible lines connecting the first name, middle initial and last name; and Figure 2 is a flow chart of the process according to the present invention. Detailed Description of the Preferred Embodiment of the Invention As mentioned, freehand drawing in a graphic editor can be used for creating a person's signature which contains a first name, a middle name or initial, if any, and a last name, all of which should be treated as one single object during object manipulation such as move, copy and delete. Characters such as i, j, f, t and x are constructed by two strokes which are not connected. In order to treat a signature which is constructed by more than one unconnected stroke, the invisible line connection which is the subject of this invention is necessary. Figure 1 shows a freehand drawing of a signature as it might be displayed on a computer or host display screen. Only the solid lines of the signature shown in Figure 1 are actually displayed. The dotted lines represent the invisible line connection. A clear user interface which distinguishes the ending of a stroke of a character or the ending of a first name from the ending of the complete signature is defined by an extra press of the mouse button in the preferred and illustrative embodiment of the invention. Every time the mouse button is pressed, the x, y points which the mouse traverses are recorded into the graphic object data structure. Initially, the first point p₁ at the beginning of a stroke which is the first stroke of a plurality of unconnected strokes is read and stored with the visible attribute. As long as the mouse button is pressed, the position p L of the cursor is monitored and lines drawn from each successive point to the next point p₂ with each point p₂ being stored with the visible attribute. When the mouse button is released, the last read position point p₂ is stored with the invisible attribute. When the mouse button is pressed again, the first point of the next stroke is read and stored with the visible attribute, and the process is repeated. When the mouse button is again pressed and released, the ending position point p ⊘ of the previous stroke, the starting position point p₁ of the current stroke and the ending position point p₂ of the current stroke are compared and, if p₁ and p₂ are within the tolerance range and there exist no other points between p₁ and p₂ and if p₁ and p ⊘ are within the tolerance range, then the termination of a signature is detected. Figure 2 is a flowchart of the process according to the invention. p₀, p₁, p L , and p₂ are defined as follows: p ⊘ : The ending position of the previous stroke. p₁: The starting position of the current stroke. p L : The last position of the current stroke, a temporary position. p₂: The ending position of the current stroke. In block 1, p₂ is initially undefined (a negative number which does not exist on the display). P ⊘ is then assigned to the same value of p₁ and p L . The first point p₁ is then stored into the object data structure with a visible attribute. The input device button status is then tested in block 5. If it is in the pressed state, the control goes to block 6 which reads the input device to detect the current pointing cursor position. The value is then assigned to p₂. p L and p₂ are tested in block 7. If p L does not equal p₂, then in block 8, a line is drawn on the display between p L and p₂. The next point p₂ is stored into the object data structure with a visible attribute, and the new p₂ is assigned to p L . In either case of the outcome of the text in block 7, control goes back to test block 5 until the button released state is detected. After the button is detected to have been released, control goes to block 9. Since a button release indicates the end of the current stroke, p₂ is now the end point of the current stroke, and the invisible attribute is assigned to it. In block 10, a determination is then made to see whether the signature termination condition occurs; that is, to see whether p ⊘ , p₁ and p₂ are equal. If signature termination has not yet occurred, the control loops back to block 3 waiting for the drawing of the next stroke. If the signature termination condition occurs, control goes to block 11 which checks the current drawing mode to see if the user has changed to any other graphic object drawing state. Changing from one graphic object draw mode to another can be done by selecting a different drawing tool from a popdown panel, for example, or simply by pressing a key on the keyboard. In block 12, if the system is still in freehand drawing mode, then control goes back to block 2 and waiting for the next signature drawing. Control exits if the system is no longer in freehand drawing mode. The following code written in Program Design Language (PDL) implements the procedure just described. Source and object code can be easily derived from the PDL code. According to the code p₂, the ending position of the current code is initialized to -1 which is off the screen. The process begins by setting p ⊘ , the ending position of the previous stroke if any, equal to p₂. The input device button is monitored and, when the button is pressed, the position of the input device is read. At this point in the code, the beginning of a stroke has occurred, and so the current position of the cursor is set to equal p₁. p₁ is stored with the visible attribute. Then while the input device button is still pressed, each successive point p₂ is read and stored with the visible attribute and lines drawn on the screen between the current cursor position and the next previous position. This process continues until the input button is no longer pressed at which time the attribute stored with the last point p₂ is changed to the invisible attribute. This whole process repeats until the last point p₀ of the previous stroke, the first point p₁ of the current stroke and the last point p₂ of the current stroke are equal and there exist no other points between p₁ and p₂. When this occurs, the drawing mode is checked, it being possible to write yet another signature for example as long as the drawing mode remains the freehand drawing mode. The process ends, however, when the system is no longer in freehand drawing mode. While the invention has been described in terms of a preferred embodiment employing a mouse as a cursor pointing device and a button on the mouse as the user interface for indicating the beginning and ending of strokes and the ending of a series of unconnected strokes which constitute a signature, for example, it will be recognized that the invention is not limited to specific hardware cursor pointing devices and that the invention may be used for other and different graphic objects than signatures.

Claims: A method of storing a signature in a mixed object editor which supports text objects and graphic objects in a single document comprising the step of manually entering via an input device a plurality of unconnected strokes in a freehand graphics mode of said mixed object editor, said plurality of unconnected strokes constituting said signature; and characterised by: at the beginning (P1) of each said unconnected stroke, storing a visible attribute indicating the beginning of said unconnected stroke; at the end (P2) of each said unconnected stroke, storing an invisible attribute indicating the end of said unconnected stroke; and recognizing said plurality of unconnected strokes as a single graphic object in said mixed object editor by storing said strokes connected by invisible lines, where each line connects an invisible attribute to a successive visible attribute; whereby in formatting a document said mixed object editor will display said signature as a single freehand graphic object without fragmentation. A method as claimed in claim 1 wherein said plurality of unconnected strokes is drawn on a computer screen by a cursor controlled by an input device with a button, said step of entering comprising the steps of: pressing said button at the beginning of each stroke; releasing said button at the end of each stroke; and pressing and releasing said button at the end of the last stroke of said plurality of unconnected strokes without moving said input device. A method as claimed in any of claims 1 or 2, further comprising the step of each time a first point (P1) and a last point (P2) of a stroke are detected, comparing the last point (P0) of a previous stroke with the first and last points of the current stroke and if said first and last points of the current stroke are within in a predetermined tolerance range and there exist no other points between said first and last points of the current stroke and if the first point of the current stroke and the last point of the previous stroke are within said predetermined tolerance range, detecting the end of said plurality of unconnected strokes. A method as claimed in any of claims 2 or 3 further comprising the step of determining if said control system is in said freehand mode after detection of the end of said plurality of unconnected strokes and, if so, repeating each of the steps of said method for a second plurality of unconnected strokes.

Inventors: MACHART, BEVERLY HELEN, WANG, JOHN SHIHYUAN
Applicants: INTERNATIONAL BUSINESS MACHINES CORPORATION
Application year: 1986
Main classification: G06F15
IPC codes: G06T7, G06T1, G06K9, G06F3