MULTI-WINDOW COMMUNICATION SYSTEM

Abstract: A multi-window communication system performs a communication and telewriting between terminals having multi-window functions. This system inputs commands for a window frame change, a screen scrolling and various function execution designation, and analyzes and executes a command inputted by said inputting means and transmitted from another terminal. It displays window display data stored in a memory under the control of a command analysis, and transmits and receives transmitting and receiving signals to or from another terminal, under the control of a command analysis. Then, the system maintains window management data, changes a window frame and controls a scrolling of a window screen, under the control of the command analysis.

Description: SPECIFICATION Title of the Invention Multi-Window Communication System Background Art The present invention relates to a multi-window display communication terminal for displaying a plurality of independent rectangular screens (windows) on a display screen, and more particularly to a control apparatus for controlling a multi-window telewriting service using a plurality of variable rectangular windows whose frames can be optionally changed by a user. Recently, a highly developed communication system has been developed for ISDN. As a basic rate interface between network and terminal, 2B + D (64K + 64K + 16K bps) is determined, and a highly developed communication service has been reviewed to fully utilize the 2B + D interface. In these circumstances, a voice can be transmitted by using one B channel, and multi-media documentary information including text, i mage data , graphics and hand-draw ing data are transmitted by another B channel. A conversation is performed by voice, and underlines or comments are . written onto a document displayed on a communication terminal , or a part of a document is des ignated by a cursor. Audio-graphic conference service has been proposed based on a telewriting ( image plotting) service . On the other hand, it is desired to provide a communication terminal with a multi-w indow di splay function. This terminal is adopted, for example, at a work-station, in order to increase its usability. According to a multi-window display, a plurality of rectangular areas of a discretional size are provided on a screen and a part of the image information, such as documentary information, is cut out or displayed. By using this function, a plurality of documents can be displayed simultaneously on a screen. By realizing a multi-media communication service based on the above-recited telewriting on a window, the usability of the system at a communication terminal can be increased. Further, the demand for telewriting based on a document displayed in a plurality of w indow s , i.e. the demand for a multi-window telewriting is increasing. In a telewriting service, the document first referred to is transmitted to another terminal in a batch and displayed. Then, by using a pointing device such as an input-pen, a communication is conducted by voice with the other party and a telewriting service is conducted on the displays at both terminals. Handwriting data is sequentially transmitted between them and s displayed on the original screen as well as at the receiving terminal. Where a multi-media communication is conducted using a telewriting image communication terminal, operation of terminals becomes relatively complicated and it is preferable that the operation output is suitable for the ability of each user and the design of object-oriented software is conducted for this purpose to satisfy a human interface with an unskilled user. A conventional processing communication system is shown in Fig. 1. 1 and 2 are telewriting terminals and 3 is an exchange apparatus. A and B terminals at 1 and 2, respectively, have bit map displays of 640 x 400 dots, for example, as their display apparatuses. Generally speaking, a display screen is - 4 too small for a practical telewriting service. Therefore, a virtual screen as shown in..the Fig. 1 is considered. This screen is several times larger than the actual display screen, and is equal to the size of the document to be displayed. A part of the virtual screen is displayed on the actual screen and the portion to be displayed is scrolled up and down, right and left by operating a scroll button w ith an input- pen. When scrolling is conducted, the displayed portion of the document is made the same at both term ina ls . When one terminal i s s cro l led , it transmits a scroll request to the other term inal which, upon receiving the scroll request, performs the same amount of scrolling as the originating terminal. When the above service is to be carried out by us ing a multi-w indow- system , the user may discretiona lly change the size of his window , making it diff erent from that of the other terminal. In the case shown in Fig. 2, when the window of A terminal 1 is scrolled, the end of the document is already reached in a w indow of B terminal 2 , so that no further scroll ing is possible. Thus , it is not sufficient merely to send a scroll request to the other party. Namely , when the w indow of the other communication party cannot be scrolled any more, a complicated set of controls becomes necessary to handle the situation. There may be document which one party doesn't ■* . * want to show to the other party because of its secret 5 nature, but wants to refer to during a meeting without showing it to the other party. Therefore it is necessary to see a document locally, to perform a local window function and to transmit document data in a batch to enable the other party to decide whether a 10 window function should be conducted during communication. It is preferable to provide a multi- window telewriting system in which two such window functions are realized. Fig. 3, shows an example in which windows 4 and 7, and windows 5 and 8 are used 15 for communication and window 6 is used locally between A terminal 1 and B terminal 2. In this case, the status of the windows of both terminals differs. Therefore the method of managing the windows during communication between the two terminals is important. 20 As relevant arts of the present invention, the following publications are presented. Japanese Laid Open Patent Disclosure (KOKAI), 63-291111 relates to an operation guidance output control system and discloses a structure of a telewriting terminal. Japanese Laid Open Patent Disclosure (KOKAI), 63- 67958 relates to a multi-window telewriting terminal and discloses a technology of detecting a size of a window and an area of a display of the other terminal by marking a frame of display screen of a telewriting terminal. Disclosure of the Invention One object of the present invention is to provide a variable-frame-window communication terminal for easily carrying out smooth screen scrolling even when a communication is conducted with a terminal having a different window size from that of the home terminal. Another object of the present invention is to provide smooth telewriting in which a part of a multi- window is used exclusively for a local window for displaying a document at the home terminal. The other plurality of windows can be used for a telewriting service with the other party. Fig. 4 is a principle block diagram of the present invention. In the drawing, input means 10 of the multi-window communication terminal comprises, for example, an input-pen, a tablet or a key-board. Input means 10 receives change-of-window-frame, screen-scrolling and various function-designating commands which are input by a user. Command analyzing means 11 comprises, for example, a processor, which analyzes an input command and a command transmitted from the other terminal and carries it out. Display means 12 comprises, for example, a display apparatus CRT. A window display data stored in a window memory is displayed on a screen of the display by a control of the command analysis means. Transmitting and receiving means 13 transmits and receives signals such as a window screen scroll confirmation request to and from the other terminal. Window management means 14 maintains a window management data such as vertical width and horizontal width of respective window frames in RAM and performs a window frame change and a window scroll, under control of command analysis means 11. In a terminal of Fig. 4, input means 10 can receive a command of a plurality of window displays from a user and can receive a telewriting service command in case where it is used as a telewriting terminal. In these terminals, in addition to a function of displaying a window display data stored in a window memory in a communication window used for a communication with the other terminal, the display means 12 can display the window display data in a local window which is used for a reference by only the terminal. The display is not limited to a communication window and a local window and the window display data may be displayed in a plurality of windows . Next, in these terminals, transmitting and receiving means 13 can transmit and receive signals for controlling a plurality of windows, signals designating a window used for the home terminal by a window number or memory address, the number of the window for telewriting image communication and the picture information to and from the other terminal. In window management means 14 in these terminals can execute a window frame change, window screen scroll control independently from another window with regard to a plurality of windows and change a window frame to a discretional size within a vertical and horizontal width of the document and can perform scroll of a window screen in any one of upper, lower, right and left directions. Transmitting and receiving means 13 can manage a window by using the number of the communication window received from the other terminal and the picture information. Method of managing a multi-window in a communication between two image telewriting terminals A and B is explained by referring to Fig. 4. For example, an user of A terminal 1 touches an icon for requesting a start of telewriting service on a display by using input means 10 such as an input-pen and designates a window for telewriting service. Then, the window number is analyzed by command analyzing unit 11 , and telewriting request command is transmitted to B terminal 2 by transmitting and receiving means 13. When B terminal 2 receives this command, it hunts an unused window, based on the content of window managing means 14, and returns the window number or the memory address of B terminal 2 to A terminal 1 , thereby enabling the connection between the two windows to be set up. Upon the connection being set up, A terminal 1 transmits, the document data of its communication window and displays it on display means 12 on B terminal 2. Thereafter, users at both terminals perform telewriting and respective users sequentially transmit handwriting data to the other party. The handwriting data is input by an input-pen on a tablet on the display. If necessary, the users at both terminals can also use another windows for telewriting service. In this case, the terminals inform each other of the appropriate communication window numbers, and a telewriting service is then conducted. Namely, different windows for performing communication are hunted but this hunting is conducted independently of a request for start of telewriting. As described above, to enable to do telewriting service they must inform each other of the window number or the memory address to be used for the communication between the windows. A discretional number of the multi-windows are used for a communication with the other party and the remaining window can be used as a local window. Fig. 4 shows a method of scrolling a window screen between the originating terminal and the destination terminal in a communication net-work in which a plurality of communication terminals or multi- window telewriting images are combined. In the present invention a scroll confirmation request is transmitted before screen scrolling is conducted. But a flag showing that the scrolling is now being confirmed is maintained in a window managing means 14. Window managing data is produced simultaneously by both terminals to avoid a collision between the confirmation requests. In Fig. 4, the user of A terminal 1 provides a scroll command to input means 10 and this command is analyzed by command analyzing unit 11. The window managing means determines, in accordance with the contents of said command analyzing unit 11, whether command analyzing unit 11 can scroll the window of the terminal. Window managing means 14 decides from the window managing data, whether or not a scrolling is possible. If it is, this is displayed to a user as a guidance display by display means 12. When it is judged that scrolling is possible, window managing means 14 turns on a scroll confirming flag, and transmitting and receiving means 13 provides a scrolling confirmation request. When B terminal 2 receives this confirmation demand, window managing means 14 determines, based on whether or not a scrolling confirmation flag is turned on, whether or not B terminal 2 should produce a prior scroll confirmation request. When the flag is turned on, this means that a collision of a scroll confirmation request occurs. Scroll-impossible data is provided to the A terminal 1 by transmitting and receiving means 13. When the scroll confirming flag of B terminal 2 5 is off, window managing means 14 judges whether or not scrolling of the window at B terminal 2 is possible. If scrolling is impossible, a scroll-impossible message is sent to A terminal 1 as is similar to the above recitation. - j O When the window of B terminal 2 can perform a scrolling, display means 12 performs a scrolling of a window screen and transmitting and receiving means 13 replies simultaneously to A terminal 1 that scrolling is possible and A terminal 1 also performs screen 15 scrolling on display means 12. The scrolling method of the present invention can be applied to a communication terminal having a single variable frame window function as well as a multi-window function communication terminal. 20 As described above, the present invention determines, before a window scrolling is carried out, whether or not a scrolling at the other terminal is possible. Window management means 14 can judge whether or not window screen scroll is possible in accordance with scroll in a vertical or horizontal directions at any of the lowest limit, the upper limit, the left end, and the right end of the window screen. Brief Description of the Drawings Fig. 1 shows a prior art telewriting service system, Fig. 2 shows an example of a screen scrolling when the window sizes are different, Fig. 3 is a block diagram of a multi-window telewriting system to which the present invention applies, Fig.4 is a principle block diagram of the present invention, Fig. 5 is a block diagram of an embodiment comprising a multi-window telewriting terminal, Fig. 6 shows the structure of one embodiment of a display, Fig. 7 is a view for explaining the scope of a document display in the window area, Fig. 8 shows the window management data, Fig. 9 shows a sequence of screen displays corresponding to an embodiment of a multi-window 14 - telewriting service. Fig. 10 shows a sequence of steps for multi- window telewriting service, Fig. 11 shows a sequence of steps for producing a voice call, Fig. 12 shows a sequence of steps for producing a data call. Fig. 13 shows a sequence of steps for executing a document transfer, Fig. 14 shows the format of telewriting service command. Fig. 15 is a view for explaining a method of scrolling a window screen, Fig. 16 shows a sequence of steps for designating a scrolling control. Fig. 17 shows a sequence of steps for designating a collision of scrolling confirmation requests, Fig. 18 shows an operational flow chart of a command analysis means and a window management means, Figs. 19A to 19C show operational flow charts of the window management means. Figs. 20A to 20C show operational flow charts of the window management means. Fig. 21 shows the initial screen configuration of the terminal, Fig. 22 shows a screen of a transmitting terminal , Fig. 23A to 23D show screens of a receiving terminal. Fig. 24A to 24F show the statuses of the window memory and transient window management tables in accordance with the display, and Fig. 25A to 25F show the window management tables in communication, using the memory address as a parameter. Preferred Embodiment An embodiment of the present invention will be explained in detail by referring to the drawings. Fig. 5 shows a block diagram of an embodiment of a multi-window telewriting terminal according to the present invention. This terminal comprises a processor 15, a key-board 16 and its interface 17, an input-pen 18 for inputting hand-drawing data, a transparent tablet 19, a tablet control unit 20, a graphic display control unit 21 for performing a display control on a display, a plurality of window memories (#1, #2,...) 22 for storing hand-drawing data of respective windows among a multi-window , a window synthesizing control unit 23 for synthesizing the contents of a plurality of window memories , a display 24 , a program memory (ROM ) 25 for storing a program such as a telewriting protocol control and a calling process ing control, a data memory ( RAM ) 26 including a window managing table as described later, for example, a hand-set 27 for voice communication, a telephone control means 28 , a transmission control means 29 for controlling a data transmission , and a ISDN -point interface 30. Display 24 comprises a liquid crystal display panel , an EL display panel , or a plasma display panel, and displays the contents of window memory 22. A transparent tablet 1 9 is provided on the di splay surface and contents of a display can be see through a transparent tablet 1 9. By contacting input-pen 1 8 onto the transparent tablet, an input can be conducted in accordance with a display content. A hand -drawing data is transmitted to the other terminal through transmission control means 29 and is also displayed on the display portion of the other terminal. As described above, an exclusive window memory 22 is provided to each window of the multi -window , so that a telewriting can be simultaneously conducted for a plurality of windows. Thus, software processing cannot catch up with the telewriting of a super- imposition of the several windows upon display, and is controlled by window combining control unit 23 in a hardware manner. Fig. 6 shows a structure of an embodiment of display 24. On the right side of the display, window producing command, various icon such as telephone, icon for command for various telewriting such as eraser, thick pen, and thin pen are provided. On the upper most portion of the window display area, the document name is displayed and various icons, for example, for the input of the command for deleting a window are provided for instructing the document. Fig. 7 shows a relation between a document in an virtual space and a display scope of a document in a window area on an actual display. In Fig. 7, a point designated by a scroll amount (in a vertical and horizontal direction) on a document is designated at an upper left point and the scope of a vertical and horizontal width of the window is designated as being a window frame displaying position (X, Y coordinate) of a display on an upper left point. A window display priority is designated with regard to respective windows when the windows are overlapped. Fig. 8 shows a contents of window management data maintained in window management means 14. First of all, a list of window number designating windows that are in use and window numbers designating windows that are not yet in use is stored, for windows of a multi-window. Data for respective windows comprises window display prio'rity, frame display position (X, Y coordinate), horizontal width and vertical width of the frame, flag for designating that the scroll is being confirmed, amount of screen scroll in a horizontal direction and vertical direction, the window number of a terminal of the other party for communication, flag for designating whether this window is in communication or not, file name of a document, and the address and vertical and horizontal width of the document. In multi-window display, these data are maintained for respective windows. Fig. 9 shows a screen sequence in an embodiment of a multi-window telewriting service. In Fig. 9A, a user presses a telephone icon. In Fig. 9B, he dials the telephone number of an opposite party to get into a communication state with him. In Fig. 9C, the user opens a window on his own terminal by pressing a window-creating icon. In Fig. 9D, a document is written on the window, and in Fig. 9E, an icon for a command designating a start of telewriting is pressed to create a window on the other terminal and communication between windows is established. In Fig. 9F, hand-drawing data on the window is displayed at both terminals. In Fig. 9G, when the user inputs a command for completing a telewriting service using the window, the window enters a local state and the hand-drawing data at one terminal is not transmitted to the other terminal. In Fig. 9H, a command for designating a window cancellation or a window save is input, and then the window is deleted from the display. Fig. 10 shows an embodiment comprising a sequence of connecting terminals in which a telewriting is conducted between telewriting communication terminal s as shown in Fig. 5. In Fig. 10 a telewriting starts from an A terminal, for example, and set up ( )is transmitted to an exchange from the A terminal via D-channel DCH. This reaches the B terminal as set up signal Q), and connect )is transmitted from the B terminal to the A terminal as a response, thereby completing connection of information channel. Telewriting is carried out sequentially by B channel. When a telewriting starts, request (4) is transmitted from the A terminal to the B terminal by pressing, for example, a telewriting button. Request (5) for communication between windows to which the number of the communication window, for example W1 , is attached, is transmitted. In response. to this, the B terminal produces an acknowledge (5) of a communication between windows, and a communication window number, for example W3, at the B terminal is transmitted to the A terminal. Then the data on the window W1 , namely, bit map data, is transmitted to the B terminal as window information, through a batch transmission (7) and hand-drawing data (δ) and (9) are transmitted between the terminals by a telewriting method. If it becomes necessary to use a different window for a communication during telewriting, the A terminal again transmits a request for communication between windows ) to the B terminal and the window number, for example, W2, used for the A terminal is informed. In response to this, the B terminal informs the A terminal of the window number in use, for - 21 - example, W4, at (Q) and thereafter the hand-drawing data (j_2) is transmitted from the A terminal. When a communication using a certain window is stopped during the telewriting, request (j ) for 5 disconnecting a communication directed to a window W1 of the A terminal is transmitted from the A terminal to the B terminal. The B terminal returns the acknowledge for disconnecting the communication ( 4) directed to the B terminal, the window W3 being in 10 communication with the window W1 of the A terminal. On the other hand, window W2 of the A terminal is in communication with window W4 of the B terminal as the A terminals and B terminals get in communication with each other as shown in ^θ) and (Q)_ Therefore, 15 hand-drawing data ( ) and Q_ ) is transmitted from the B terminal and telewriting continues. When telewriting is completed, the request for completion Q_7j is transmitted from the A terminal and the B terminal transmits the response 3), thereby 20 completing the telewriting. Thereafter, D-channel DCH disconnects and releases the line between the A terminal and the exchange apparatus and the exchange and the B terminal. Users at the A terminal and B terminal get intoa communication state in accordance with the sequences shown in 1 to 3 in Fig. 10. The embodiment of the calling sequence at this time is shown in Fig. 11. Thereafter, the user of the A terminal transmits the document prepared by him to the user of the B terminal at 7 in Fig. 10 after he presses a start icon for a telewriting. At this time, the connection sequence of the B2 channel is shown in Fig. 12 and the sequence for transmitting the document is shown in Fig. 13. A frame format for obtaining the data in B2 channel is shown in Fig. 14. In Fig. 13, it is supposed that the document is transmitted from the A terminal. After the B terminal inputs a receipt of a telewriting, the A terminal outputs a transfer of the document name and the request to transmit the document. In response to this, the B terminal informs the A terminal of a completion of a transfer of text. Hand-drawing data, text, and image data are divided into a number of blocks and transmitted continuously. After the A terminal receives a signal acknowledging receipt of data from the B terminal, actual telewriting starts. In Fig. 14, it is supposed that the window number of the terminal and the window number of the other terminal are given a transmission format by a window management data retained in a window management means 14. When a telewriting request command is transmitted, "0" is inserted to the transfer format as the window number of the other party is not yet identified. When a telewriting acknowledge command is received from the other party his window number is identified. This is retained as window management data in the window management means 14, and is used for the following window communication. Where, a telewriting terminal as shown in Fig. 5 can display a window whose size or frame can be changed optionally, it is generally called a multi- window. In this case a window screen scrolling method is considered for communication between terminals. The scrolling method is shown in the block diagram in Fig. 15. A sequence of a scroll control is shown in Fig. 16. A collision of a scroll confirmation request is shown in Fig. 17. In Fig. 15, it is supposed that the request for the screen scrolling is produced by the A terminal side as is similar to the above explanation. Block 31 on the A terminal side determines whether or not the terminal can perform a window scrolling. If the decision is YES, a flag showing that scrolling is confirmed is turned on at 32 and the scrolling confirmation request is transmitted to the B terminal side at 33. On the B terminal side, a flag showing that scrolling of the terminal is confirmed is turned off at 34 and it is judged at 36 whether or not window scrolling being conducted. Thereafter, scrolling is carried out at 37 and a reply stating that scrolling can be conducted is transmitted to the A terminal. The A terminal receives this reply and turns off the flag showing that scrolling is being confirmed, and executes scrolling at 38. This corresponds to the sequence of Fig. 16A. When a scrolling confirmation flag is turned on at 34 on the B terminal side, as shown in Fig. 15, the scrolling confirmation request is produced by the B terminal and a scrolling impossible reply is sent to the A terminal at 35. When scrolling is impossible, as shown at block 36, a scrolling impossible reply is similarly sent to the A terminal. Fig. 16B shows this sequence. The A terminal side turns off the scrolling confirming flag, receipt of the scrolling impossible reply and performs a guidance display showing that scrolling is impossible. Fig.17 shows the sequence that results when the scrolling buttons at both A and B terminals are depressed simultaneously. Upon depression of the scrolling buttons, the scrolling confirmation flags of both terminals are turned on, and a scrolling- i possible reply is sent to both terminals in response to a request for confirmation. Therefore, the scrolling confirmation flags of both terminals are turned off. Fig. 18 shows an operational flow chart of command analyzing means 11. As stated above, command analyzing means 11 analyzes the content of the command input by an input means 10, such as an input pen 18, and the command received from the other terminal through transmitting and receiving means 13. When the input is entered at step 40, the command analysis is conducted at step 41 and the window management data shown in Fig. 8. At step 42, the command from the input means is distinguished from the command from the other terminal and both of them are sent to window management means 14. Figs. 19 to 20 show an operational flow chart of window management means 14. Window management means 1 controls scrolling and manages the window status in response to a user command input from input means 10 and a command input from the other terminal through transmitting and receiving means 13. Fig. 19 is a operational flow chart for a pen input in which the input is entered on tablet 19 by input pen 18 as shown in Fig. 5. Fig. 20 is a operational flow chart for the command entered by the other terminal via a net-work. For example, where a communication between windows starts between an A terminal and a B terminal, input pen 18 touches an icon on the terminal display, thereby enabling the pen input to be detected at step 40 shown in Fig. 18 and the input coordinate is analyzed by command analysis means 11 at step 41. When window management means 14 judges that the telewriting starts command is received, based on the output of command analysis means 11 at step 43 of Fig. 19, transmitting and receiving means is requested to transmit a request for telewriting start command with a window number used for communication in the A terminal as a parameter, to the B terminal at step 44. The content of the window management table is renewed in response to a reply from the B terminal side at step 45. Where a connection of the B channel B2CH is not yet conducted at step 44, a connection is requested to transmitting and receiving means 13. A window management table is provided inside data memory 26 in respective terminals. An example is shown in Fig. 24. A communication status designating whether it is local or in communication and the data of the display area on the display is stored in a plurality of windows in the home terminal. Thereafter, at step 46 transmitting and receiving means 13 is asked to transmit the document data used in the communication window of the A terminal to the B terminal as a batch. Telewriting start processing then ends and returns to the step 40 in Fig. 18. The B terminal side receives, from command analysis means 11, a telewriting start request from the A terminal as a command from a network at step 42 shown in Fig.18 and determines the kind of command at step 47 in Fig. 20. When a telewriting start request is judged, an unused window number is hunted at step 48. A telewriting acknowledge is informed to the A terminal by using the window number used for communication between A and B terminals as a parameter at step 49. Data is received from the A terminal and stored in the memory at step 50. Display means 12 is asked to perform a display on a communication window on the B terminal at step 51. Telewriting start 5 processing then ends and returns to step 40. Telewriting starts when the A terminal user performs a pen touch to draw an image on the window display in communication on tablet 19. The pen input is executed as an image telewriting command at step 43 - j Q through steps 40 to 42. The status of the window on which image telewriting data is input is referred to at step 52. If the window receiving a pen input is determined as local at step 53, drawing is conducted at the originating terminal at step 54. Processing 15 then returns to step 40. By referring to the window management table at step 52, the window to which hand-drawing data is input is determined as in communication at step 53. Drawing is conducted at the originating terminal at 20 step 55 and hand-drawing data is transmitted to the other terminal (B-terminal) at step 40. Hand-drawing data from the A terminal is received by the B terminal as a command from a network. After the processes at steps 41 and 42, the command is judged as a drawing order, at step 47 and then the window number to be drawn is referred to in the window management table at the originating terminal. The window memory address (or memory address) in which the document of the corresponding window is stored is used as a parameter and the drawing order is transmitted to the display means and the process is returned to step 40. Upon completing a telewriting or upon interrupting a communication directed to a predetermined window between window communication terminals, a request is entered as a command by a pen input from the A terminal and judged as a telewriting end command at step 43 through steps of 40 and 42. The telewriting end request to the B-terminal is output to be transmitted with the window numbers of both terminals as a parameter, at step 57. The content of the window management table is renewed from a communication state to a local state at step 58, thereby being returned to step 40. At the B terminal the telewriting end request is received as a command from the network. After steps 41 and 42, the telewriting end request is judged at step 47. The status of the corresponding window in the window management table is made local at step 59. The process then returns to step 40. When all the in- communication window are deleted at step 59 , the disconnecting of B2CH is conducted. Further, where the window which is used locally or for communication in the own terminal is deleted, the user touches an icon on the display. After steps 40 to 42, if a window deleting command is received in step 43 , the window management table is rewritten at step 60 and a request for window deletion is conducted by di splay means 1 2 at s tep 61 , and the proces s returns to step 40. When it is necessary to create a new w indow , a pen touch on a icon on the us er ' s display is j udged as a window create command at step 43 after steps 40 to 42. An unused window number is searched at step 62 and the new window display is requested at step 63, and the process returns to step 40. Next , the s crolling contro l sequence i s explained by referring to the flow charts shown in Figs. 1 8 to 20. If the user at the A-terminal 1 inputs a scrolling command (scroll button) on display 24 by using input pen 18 , for example, it is j udged as a scroll command at step 43 after steps 40 to 42. Therefore, at step 64, it is judged from the longitudinal width, horizontal width and scrolling amount based on window in the window management data whether the A-terminal 1 can scroll the window of the originating terminal in the desired direction. If it is judged at step 65 that scrolling is impossible, a guidance display is made on the display means 12 at step 66, and the process returns to step 40. When it is judged that scrolling is possible, it is judged from a flag designating a status of in- com unication at step 67 whether the scrolling command from the user is given to the window in communication. If the flag is off, the window to be scrolled is not in communication and the screen scrolling requested by display means 12 at step 68 is renewed at step 69, and the process is returned to step 40. When a flag designating "in-co munication" is turned on, the content of a flag showing a scroll confirming is judged at step 70. If this flag is already turned on, the response to the scroll confirming demand which was previously produced by at the B terminal 2 has not yet been provided and the process is returned to step 40 without producing a new scroll confirming request. When the scrolling confirmation flag is off, it is turned on at step 71 and a scrolling confirmation command is transferred to the transmitting and receiving means 13 at step 72, and the scrolling confirmation request is transmitted to the B terminal 2 as shown in Figs. 16A and B. When B terminal 2 receives this confirmation request it transmits it to window management means 14 as an input from transmitting and receiving means 13 at step 42 through step 41 as shown in Fig. 18 and the scrolling confirmation command is judged at step 47 in Fig. 20. Next, the content of the scrolling confirmation flag at the B terminal 2 is judged at step 73 and if the scrolling confirmation flag is off, it is judged in step 74 whether scrolling in the predetermined direction is possible. When scrolling can be conducted, it is requested at step 75 by display means 12 and the window management table is renewed at step 76. A reply designating that scrolling is possible is transmitted to transmitting and receiving means 13 at step 77, and the process returns to step 40. After steps 41, 42, the A terminal 1 judges that the reply from the B terminal 2 at step 47 is a scrolling possible command and asks display means 12 to perform a screen scrolling at step 78 and turns scrolling confirmation flag off at step 72. After the window management data is renewed at step 80, the process is returned to step 40. Thus, the sequence of Fig. 16A is completed. When it is judged at step 74 at B terminal 2 that scrolling in a predetermined direction is impossible, a scrolling impossible reply is transmitted to transmitting and receiving means 13 at step 81. The reply is judged as a scrolling impossible command at step 47 of the A terminal 1 side. The guidance display showing the above operation is requested by display means 12 at step 82. At step 83 the scrolling confirmation flag is turned off, and the process is returned to step 40. This corresponds to the sequence of Fig. 16B. When the scrolling confirmation flag is judged to be on at step 73 of B terminal 2, it means that the reply to the scrolling confirmation request previously transmitted from the B terminal 2 to A terminal 1 is not made. In order to prevent a collision of scrolling confirmation request, in Fig. 17, a scrolling confirmation impossible reply is transmitted to transmitting and receiving signal means 13 at step 84. This reply is judged as a scrolling confirmation impossible command at the A-terminal 1 side at step 47 and the scrolling confirmation flag is turned off at step 85. The process is then returned to step 40. Next, by referring to the multi-window telewriting terminal shown in Fig. 5, the case where the user (user A) of the A-terminal 1 telephones a user (user B) of the B-terminal 2 and telewriting is conducted is explained in detail. Fig. 21 shows an initial screen of the terminal. Terminal icon 86, telephone icon 87, book shelf icon 88, mail box icon 89, memorandum paper icon 90, under sheet icon 91, pencil case icon 92, file master icon 93 and waste basket icon 94 are respectively shown. The meaning of the icon is briefly explained. When the terminal icon 86 is touched by a pen, the terminals start to function, as the data terminal can receive an input from key board 16. When the telephone icon 87 is touched by a pen a multi-functional telephone board comprising a telephone dial key, transfer button, and suspending button is displayed. The displayed buttons are designated by input pen 18 thereby enabling an input such as a telephone number to be entered. - 35 - thereby providing a telephone function in which a communication is possible using hand-set 27. When the shelf icon 88 is pen-touched, the process shifts to a phase in which access is made to data base such as a telephone book or a schedule note. If the mail box icon 89 is pen-touched after the document is pen- touched, the process shifts to the phase in which a document is transferred by electronic mail and if the mail box 89 is pen-touched before the document is pen- touched, a list of received mail is displayed and the process moves to a phase in which mail is read out. When memorandum paper icon 90 is pen-touched, it means that the blank document is determined or picked up. If the underlay icon 91 is pen-touched after the document is pen-touched, the document is displayed. When the pencil case icon 92 is pen-touched, the process progresses to a screen on which the document is edited. If file master icon 90 is pen-touched, the drawer is opened and the document in the drawer is displayed. If, after the document is pen-touched, the waste basket case icon 94 is pen-touched, the document is deleted. In Fig. 21 , user A obtains the document (MEMO) from the master file and places it on the under lying diagram. User A utilizes a multi-functional telephone displayed on a screen by pen-touching the diagram of the telephone thereby telephoning user B. The call- execution sequence is shown in Fig. 11. When the user B answers the telephone, user A pen-touches the diagram of the pencil case to transfer the document by proceeding to the screen in Fig. 22A. Various drawing tool icons such as a pencil and an eraser as shown on the right side of the screen, are selected by the input-pen 18, The telewriting mode varies in accordance with respective icons. As shown in the drawing, the name MEMO of the document is provided on the upper left side on the document and an icon for designating the document is provided. The meaning of the icons are explained sequentially from the left side. They are the telewriting start button, key board input input button, upper scroll button on the screen and lower scroll button on the screen. The screen of user B shows that the document is being prepared in a local mode as shown in Fig. 23A, in the state before the document receives. When the transfer of the document is completed, a title bar of the received document is expressed at the lower part of the screen. The received document is then in a telewriting status and the telewriting button is depressed such that white and black are reversed. User B pen-touches a menu bar with input-pen 18 and draws it up as shown in Fig. 23C. As user B's window is smaller than user A's, only the upper part of user A's screen is displayed on user B's screen. If user B pen-touches the downward scroll button, the screens of both user A and user B are scrolled down. Fig. 23D shows that user A's screen reaches the receiving terminal as shown in Fig. 23B, and cannot be scrolled further. This indicates that further scrolling is impossible. Fig. 24 shows a transient usage status of the window memory and the window management table corresponding to the window display. Fig. 24A shows an initial state. The left side is, for example, the A terminal and the right side is, for example, the B terminal. Two windows W1 and W2 are used locally and the contents "P" and "Q" of the windows W1 and W2 are respectively stored in window memories M1 and M2. The widow display parameters, data for designating whether the window is in communication, local or not used and the window number of the other terminal in communication, and the address of the window memory in the own terminal, i.e. the memory number , are stored in the window management table in the A terminal. The display parameters are coordinates X1 and Y1 on the upper left point of the display area, the horizontal width W1 and the vertical ( height ) w idth H1 of the display area in which the w indow is displayed on a screen of the terminal. In Fig. 24A , the w indow W1 i s stored in m em ory M 1 at the B ter m inal . The coordinates of the upper left point of the display area are X1 and Y1 , its horizontal width is W1 , and its height is H1 . W1 is used locally and the contents thereof are denoted by "R". The window W2 , stored in memory M2 , is similarly used locally. Fig. 24B shows the state in which window W 1 of the A term inal i s in communication with the window W 3 of the B terminal. A telewriting start request is produced at the A terminal using the window W1 and a new window 3 is opened in memory M3 , which is not used for the B terminal in Fig. 24A. The contents "P" of W1 of the A terminal which are transmitted from the A terminal are stored and di splayed on the display. The window W1 in the management table of the A terminal is put in an in-communication status and the window number of the other party is W 3. On the other hand, window W3 of the B terminal is used for communication, and when its status is designated as in-communication, the window number of the other party becomes W1. Fig. 24C shows a configuration in which a telewriting start request is produced at the B terminal using window W1 and the B terminal becomes in-communication with newly provided window W3 in the A-terminal side. Thus, the content of the window W3 of the A terminal becomes "R". Then, window W1 in the management table in the B terminal is put in "in- communication" status and the window number of the other party becomes W3. Window number W3 in the management table in the A terminal is put in "in- communication" status and the window number of the other party becomes W1. Fig. 24D shows a configuration in which a communication between W1 in the A terminal and W3 in the B terminal, as shown in Fig. 24C, is completed. The content "P" is deleted from the A terminal and the B terminal becomes local. Accompanying this, window W3 of the management table of the B-terminal becomes local. "Q" of window W2 and "R" of window W3 are displayed at the A terminal. Fig. 24E shows a configuration in which a new window W 1 is created at the A terminal. Its content is "U" and its communication status is local. Fig. 24F shows a configuration in which a window W2 at the B terminal as shown in Fig. 25E is deleted, and "R" is di sp layed in w indow W 1 and "P" i s displayed in window W3. Fig. 25 shows window management tables for the configurations shown in Fig. 24 , with the memory address as a reference. The window numbers correspond to the memory addresses. Thus , it is possible to communi cate between mult i -window telewr it i ng terminals by using memory addresses as parameters. The party to which a communication is sent is stored in the window management table under its memory address , but not under its window number , as shown in Fig. 25. Figs. 25A to 25F correspond to the window management table configurations shown in Figs. 24A to 24F. As explained above, respective windows of the multi-window telewriting terminal can be used as local windows for displaying the data of only the own terminal. They can also be used for to communicate with another terminal. In addition, a plurality of windows can be used to perform a telewriting with another terminal. Therefore, it becomes possible to use multi-window telewriting, thus further increasing the effect of the telewriting service. As explained above, scrolling of the window screen can be conducted after the scrolling of the other terminal is confirmed. Therefore, this invention facilitates a screen scrolling between different-sized terminals, and increases the usability of a terminal with a multi-window display function.

Claims: What is claimed is: 1. A multi-window communication system for performing a communication between terminals having multi-window functions, each of terminals comprising: means for inputting commands for a window frame change, a screen scrolling and various function execution designations; command analysis means for analyzing and executing a first command inputted by said inputting means and/or a second command transmitted from another terminal, display means for displaying window display data under the control of said command analysis means, communication control means for transmitting and receiving signals to or * from another terminal under the control of said command analysis means, and window control means for maintaining window management data, changing a window frame and controlling a scrolling of a window screen under the control of said window management data. 2. A multi-window communication system according to claim 1 , wherein said terminal displays window display data stored in a memory on a communication window used for a communication with another terminal, and on a local window to allow the data to be inspected by the terminal only, under the control of said command 5 analyzing means. 3. The multi-window communication system according to claim 1 , wherein said communication control means transmits and r receives signals to independently control a plurality 10 of windows to or from another terminal. 4. The multi-window communication system according to claim 1 , wherein said display means displays window display data stored in a memory on a plurality of windows under 15 the control of said command analysis means and said window control means maintains window management data, changes a window frame, and scrolls a window screen independently with regard to a plurality of windows, under the control of said window 0 management data and said command analysis means. 5. The multi-window communication system according to claim 1 , wherein said communication control means transmits and receives signals to or from another terminal under the control of said command analysis means, said signals designating a window to be used for communication at the terminal by a window number. 6. The multi-window communication system according to claim 1 , wherein said transmitting and receiving means transmits and receives signals to or from another terminal under the control of said command analysis means, said signals designating a window to be used for communication at the terminal by using a memory address. 7. The multi-window communication system according to claim 1 , wherein said window control means maintains window management data, changes a frame of a window to a discretional frame having a width less than that of the document frame and scrolls a window screen, under the control of said command analysis means. 8. The multi -window communication system according to claim 1 , wherein said window control means maintains window management data, changes a window frame, and controls a scrolling of a window screen in both the vertical and horizontal directions. 9. A multi-window communication system for performing communication between terminals for performing a multi-window control, each of the terminals comprising: means for inputting commands for a plurality of window displays, a screen scrolling and various other function execution designations, command analysis means for analyzing and executing a command inputted by said inputting means and transmitted from another terminal, display means for displaying window display data stored in a memory under the control of said command analysis means, transmitting and receiving means for transmitting and receiving signals to or from another terminal, under the control of said command analysis means, and window management means for retaining window management data and performing a window management of a window screen scrolling, under the control of said window management data and said command analysis means. 10. The multi-window communication system according to claim 9, wherein said terminal displays window display data stored in a memory on a communication window used for a communication with another terminal and on a local window under the control of said command analysis means, to allow said data to be inspected by the originating terminal only. 11. The multi-window communication system according to claim 9, wherein said transmitting and receiving means transmits and receives signals under the control of said command analysis means, to independently control a plurality of windows to or from another terminal. 12. The multi-window communication system according to claim 9, wherein said display means displays window display data stored in a memory on a plurality of windows, under the control of said command analysis means, and said window management means maintains window management data under the control of said window management means, and scrolls a window screen independently with regard to a plurality of windows under the control of said window .management data and said command analysis means. 13. The multi-window communication system according to claim 9, wherein said transmitting and receiving means transmits and receives signals to or from another terminal under the control of said command analysis means, said signals designating a window to be used for communication at the originating terminal by a window number . 14. The multi-window communication system according to claim 9, wherein said transmitting and receiving means transmits and receives signals to or from another terminal under the control of said command analysis means, said signals designating a window to be used for communication at the originating terminal by using a memory address. 15. The multi-window communication system according to claim 9, wherein said window management means maintains window management data and controls a scrolling of a window screen in both vertical and horizontal directions. 16. A method of controlling a window screen scrolling in communication between a first and second terminals comprising steps of: providing the first and second terminals with a scrolling comfirming flag designating that the possibility of scrolling is being examined judging, at the first terminal, whether or not a scrolling of a window screen is possible at the first terminal, turning on the scrolling confirming flag at the first terminal and transmitting a scrolling confirmation request from the first terminal to the second terminal , judging, at the second terminal, the content of the scrolling confirming flag at the second terminal to determine whether or not a scrolling can be performed, returning a "scrolling impossible" signal from the second terminal to the first terminal when the scrolling confirming flag in the second terminal is on, judging, at the second terminal, whether or not. a scrolling of the window in the second terminal is possible, when the scrolling confirming flag in the second terminal is off, returning a "scrolling impossible" signal from the second terminal to the first terminal when the scrolling in the second terminal is judged to be impossible, performing, in the second terminal, scrolling of a screen when the scrolling in the second terminal is judged to be possible, returning a "scrolling possible" signal from the second terminal to the first terminal, and performing, in the first terminal, a scrolling of the screen. 17. The screen scrolling control method according to claim 16, wherein said first and second terminals include means for judging whether or not a scrolling is possible at the lower limit of the window screen. 18. The screen scrolling control method according to claim 16, wherein said first and second terminals include means for judging whether or not a scrolling is possible at the upper limit of the window screen. 19. The screen scrolling control method according to claim 16, wherein said first and second terminals include means for judging whether or not a scrolling is possible at the left limit of the window screen. 20. The screen scrolling control method according to claim 16, wherein said first and second terminals include means for judging whether or not a scrolling is possible at the right limit of the window screen. 21 . A system of of controlling a window screen scrolling in communication between first and second variable frame window terminals comprising: means for judging, at the first terminal, whether or not a scrolling of a window screen is possible at the first terminal, turning on a scrolling confirming flag designating that the possibility of scrolling is being examined , and trans m i tting a s cro l ling confirmation request from the first terminal to the second terminal, means for j udging, at the second terminal , the content of the scrolling confirming flag of the second terminal to determine whether or not a scrolling can be performed, means for returning a "scrolling impossible" signal from the second terminal to the first terminal when the scrolling confirming f lag in the second terminal is on, means for j udging , at the s econd termi na l , whether or not a scrolling of the window in the second terminal is possible , when the scrolling confirming flag in the second terminal is off , means for returning a "scrolling impossible" signal from the second terminal to the first terminal when the scrolling in the second terminal is judged to be impossible, means for performing, in the second terminal, a scrolling of a screen when the scrolling in the second terminal is judged to be possible, means for returning a "scrolling possible" signal from the second terminal to the first terminal, and means for performing, in the first terminal, a scrolling of the screen. 22. The screen scrolling control system according to claim 21 , wherein said first and second terminals include means for judging whether or not a scrolling is possible at the lower limit of the window screen. 23. The screen scrolling control system according to claim 21 , wherein said first and second terminals include means for judging whether or not a scrolling is possible at the upper limit of the window screen. 24. The screen scrolling control system according to claim 21 , wherein said first and second terminals include means for judging whether or not a scrolling is possible at the left limit of the window screen. 25. The screen scrolling control system according to claim 21 , wherein said first and second terminals include means for judging whether or not a scrolling is possible at the right limit of the window screen. 26. A multi-window telewriting terminal for performing a communication of an image drawing with another terminal comprising: means for inputting a hand-drawing image and various function execution designating commands, control means for analyzing and executing a command input by said inputting means and a command transmitted from another terminal, display means for displaying a communication window used for telewriting between terminals and a local window used only for said terminal, as a multi- window, under the control of said control means, a transmitting and receiving means for transmitting and receiving a window number and picture information relating to said communication window between terminals, under the control of said command analysis means, and a window management means for managing a window using said communication window number and picture information received from another terminal by said transmitting and receiving means; wherein said transmitting and receiving means transmits and receives each of the window numbers of optional numbers of communication windows designated by a user from a multi-window of the terminal, between both terminals, thereby performing a telewriting. 27. The terminal device according to claim 26, wherein said transmitting and receiving means enables hunt of a window of the terminal in response to a request from another terminal to start telewriting, and returns a receipt of telewriting signal using the window number of the hunted window as a parameter of another terminal when said window has been found, and transmits and receives picture information between terminals. 28. The terminal device according to claim 26, wherein said transmitting and receiving means enables hunt of a window of the terminal in response to a request f rom another terminal to start telewriting , and returns an "acknowledge of telewriting" s ignal using the memory address of the hunted window as a parameter , to another terminal when said w indow has been found , and then transmits and receives picture information between terminals. 29. The term inal device according to cla im 26 , wherein said transmitting and receiving means produces a request for start of a telewriting and a request for hunting a window, these requests being sent to another terminal and being conducted independently of each other, and a window number of the communication window hunted by a request for hunting and the picture information are transmitted and received between two terminals . 30. The ter m inal dev i ce ac cording to c la im 26 , wherein said transmitting and receiving means produces a request for start of a telewriting and a requestfor hunting a window, these requests being sent to another terminal and being conducted independently of each other , and a memory addres s of the communication window hunted by a request for hunting and the picture information are transmitted and received between two terminals. 31. A telewriting terminal for performing a telewriting with another terminal, comprising: input means for inputting a hand-drawing image, a window frame change, a screen scrolling and commands for designating an executing of various functions, command analysis means for analyzing and executing commands input from said input means and commands transmitted from another terminal, a display means for displaying window display data stored in a memory, under the control of said command analysis means, a transmitting and receiving means for transmitting and receiving signals between the terminal and another terminal, under the control of said command analysis means, and a window management means for retaining window management data and controlling a window frame change and window screen scroll, based on said window management data and under the control of said command analysis means. 32. The telewriting terminal according to claim 31 , • wherein said terminal displays w indow display data stored in a memory on a communication window used for communication w ith another terminal and on a local window for inspection by only the terminal, under the control of said command analysis means. 33. The telewriting terminal according to claim 31 , wherein said transmitting and receiving means transmits and receives s ignals to independently control a plurality of windows to and from another terminal under the control of said command analysis means. 34. The telewriting terminal according to claim 31 , wherein said display means displays window display data stored in a memory on a plurality of windows under the control of said command analysis means , and said window management means maintains window management data, changes a window frame, and scrolls window screens independently with regard to a plurality of windows, under the control of said window management data and said command analysis means. 35. The telewriting terminal according to claim 31 , wherein said transmitting and receiving means transmits and receives signals to or from another terminal under the control of said command analysis means, said signals designating a window to be used for communication in the terminal by a window number. 36. The telewriting terminal according to claim 31 , wherein said transmitting and receiving means transmits and receives signals to and from the other terminal under the control of said command analysis means, said signals designating a window to be used for communication in the originating terminal by using a memory address. 37. The telewriting terminal according to claim 31 , wherein said window management means maintains window management data and changes the frame of a window to a discretional frame that has a width less than that of the document frame and scrolls a window screen, under the control of said command analysis means. 38. The telewriting terminal according to claim 31 , wherein said window management means maintains window management data, changes a window frame, and controls scrolling of a window screen in both vertical and horizontal direction. 39. The terminal device according to claim 31 , wherein said transmitting and receiving means enables hunt of a window of the originating terminal in response to a request for a start of telewriting from another terminal and returns an acknowledge of a . request for telewriting using the window number of the„hunted window as a parameter, and enables a signal including picture information to be transmitted and received between the two terminals. 40. The terminal device according to claim 31 , wherein said transmitting and receiving means enables hunt of a window of the terminal in response to a request for a start of telewriting from another terminal and returns an acknowledge of a request for telewriting using the memory address of the hunted window as a parameter, and thus enables a signals including picture information to be transmitted and received between the two terminals. 41. The terminal device according to claim 31, wherein under the control of said command analysis means, said transmitting and receiving means independently sends to another terminal requests to start telewriting and to hunt a window, and transmits and receives between terminals, the window number of the hunted communication window and the picture information. 42. The terminal equipment according to claim 31, wherein under the control of said command analysis means, said transmitting and receiving means independently sends to another terminal requests to start telewriting and to hunt a window, and transmits and receives between terminals, the memory address of the hunted communication window and the picture information. 43. A window screen scrolling control method used in a communication between image telewriting communication terminals comprising first and second terminals, comprising steps of: providing the first and second terminals with a scrolling confirming flag designating that the possibility of a scrolling is being examined, judging, in the first terminal, whether or not a scrolling of the window screen of the first terminal is possible, and if it is turning on a scrolling confirming flag in the first terminal, transmitting a scrolling confirmation request from the first terminal to the second terminal, judging, in the second terminal, the content of the scrolling confirming flag of the second terminal, returning a "scrolling impossible" signal from the second terminal to the first terminal when the scrolling confirming flag of the second terminal is on, judging, in the second terminal, whether or not a scrolling of the window in the second terminal is possible when the scrolling confirming flag of the second terminal is off, returning .a "scrolling impossible" signal from the second terminal to the first terminal when the scrolling of the window of the second terminal is judged to be impossible, performing, in the second terminal, screen scrolling when the scrolling of the window in the second terminal is judged to be possible, returning a "scrolling possible" signal from the second terminal to the first terminal, and performing screen scrolling in the first - 61 - terminal. 44. The screen scrolling control method according to claim 43, wherein said first and second terminals include means for judging whether or not a scrolling is possible at the lower limit of the window screen. 45. The screen scrolling control method according to claim 43, wherein said first and second terminals include means for judging whether or not a scrolling is possible at the upper limit of the window screen. 46. The screen scrolling control method according to claim 43, wherein said first and second terminals include means for judging whether or not a scrolling is possible a the left limit of the window screen. 47. The screen scrolling control method according t claim 43, wherein said first and second terminals include means for judging whether or not a scrolling is possible a the right limit of the window screen. 48. A multi-window communication system fo performing communication between terminals that has multi-window function comprising: - 62 - input means for inputting commands of a multi- window display, a window frame change, a screen scrolling and an instruction for execution of various f nctions , command analysis means for analyzing and executing the content of a command input from said inputting means, a display means for displaying window display data stored in the memory, based on the control of said command analysis means, a transmitting and receiving means for transmitting and receiving signals between two terminals, based on the control of said command analysis means, and a window management means for retaining window management data and performing control of a window frame change and window screen scroll, based on said window management data.

Inventors: ADACHI MOTOMITSU, KAMATA HAJIME, OBATA AKIHIKO, YANO KATSUTOSHI, ADACHI, MOTOMITSU, KAMATA, HAJIME, OBATA, AKIHIKO, YANO, KATSUTOSHI
Applicants: FUJITSU LTD, FUJITSU LIMITED
Application year: 1989
Main classification: G06F3
IPC codes: G06F3, G09G5