Patent Publication Number: US-2007109561-A1

Title: Operating information recording method, operating information reproducing method, operating information storing method and apparatus and programs of the same

Description:
This application is based on Japanese Patent Application No. 2005-331604 filed on Nov. 16, 2005 in Japanese Patent Office, the entire content of which is hereby incorporated by reference.  
     BACKGROUND OF THE INVENTION  
      The present invention relates to an operating information recording method, an operating information reproducing method, an operating information storing method and apparatus and programs of the same.  
      Conventionally, there have been proposed various kinds of technologies to improve the user&#39;s availability and maneuverability of an image forming apparatus, such as a copier, a facsimile, a printer, etc., which serves as an operational object. As the representative of such the technologies, an operational panel, in which a display device and a touch panel are integrally incorporated, has been practically employed in the various kinds of image forming apparatuses. When the user changes the setting conditions for the image forming operation, such as density, contrast, etc., by operating the touch panel, the operational keys, etc., which are included in the operating section, the hardware processing and the software processing of the image forming apparatus are controlled on the basis of the setting conditions changed by the user, so as to form an image, which complies with the setting conditions desired by the user, on a recording medium to be outputted.  
      Further, there has been devised the system in which the remote-control operation of the image forming apparatus is possible through the network. Concretely speaking, for instance, Patent Document 1 (JP-3042655, Official Gazette of Japanese Patent) sets forth the system in which the remote-control operation of the image forming apparatus is achieved by displaying the operational keys on the display screen of the workstation and transmitting the command signals, corresponding to the operational keys operated through the mouse cursor by the user, to the operational section of the image forming apparatus through the network. In addition, for instance, Patent Document 2 (JP-3327566, Official Gazette of Japanese Patent) sets forth the system in which the coordinate data of the position clicked in the computer screen is transmitted to the copier, and the copier determines the operation designated by the computer from the coordinate data received from the computer so as to conduct the operation concerned.  
      Incidentally, when it is required to recognize the detailed contents of the operations, in order to analyze the malfunction of the image forming apparatus, etc., conventionally, such the malfunction analysis has been conducted by referring to the data contents stored as the operational log information. Since such the operational log information are text information, however, it has been difficult to determine what kind of operation was practically conducted. In addition, since the contents outputted as the operating results are not clear, it has been difficult to grasps the accurate state of the operations.  
     SUMMARY OF THE INVENTION  
      To overcome the abovementioned drawbacks in conventional image forming apparatus, it is an object of the present invention to provide an image forming apparatus, which makes it easy to grasp the contents of the operations conducted for the apparatus.  
      Accordingly, to overcome the cited shortcomings, the abovementioned object of the present invention can be attained by operating information recording methods, operating information reproducing methods, apparatuses and computer programs described as follow. 
      (1) An operating information recording method, comprising: storing operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series; and storing operating screen information with respect to consecutive operating screens to be displayed on a display section corresponding to the operating procedure, while correlating the operating screen information with the operating procedure information.     (2) An operating information reproducing method, comprising: acquiring operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series; acquiring operating screen information with respect to consecutive operating screens correlated with the operating procedure information; and displaying the consecutive operating screens on a display section corresponding to the operating procedure, and at a same time, displaying an operating pointer for indicating the operating procedure on the consecutive operating screens, based on the operating procedure information and the operating screen information.     (3) An operating information reproducing method, comprising: acquiring operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series; acquiring operating screen information with respect to consecutive operating screens correlated with the operating procedure information; and displaying the consecutive operating screens on a display section corresponding to the operating procedure, and at a same time, generating a dynamic picture image file for displaying an operating pointer for indicating the operating procedure on the consecutive operating screens, based on the operating procedure information and the operating screen information; and storing the dynamic picture image file.     (4) An apparatus, comprising: a display section; a storage section to store information; and a control section to control the storage section so as to store operating procedure information including consecutive operating information according to an operating procedure as a procedure in time series and operating screen information with respect to consecutive operating screens to be displayed on the display section corresponding to the operating procedure, while correlating the operating screen information with the operating procedure information.     (5) An apparatus, comprising: a display section; and a control section to acquire operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series, and operating screen information with respect to consecutive operating screens correlated with the operating procedure information, and to control the display section so as to display the consecutive operating screens on the display section corresponding to the operating procedure, and at a same time, so as to display an operating pointer for indicating the operating procedure on the consecutive operating screens, based on the operating procedure information and the operating screen information.     (6) An apparatus, comprising: a storage section to store information; and a control section to acquire operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series, and operating screen information with respect to consecutive operating screens correlated with the operating procedure information, and to control the display section so as to display the consecutive operating screens on a display-section corresponding to the operating procedure, based on the operating procedure information and the operating screen information, and to generate a dynamic picture image file for displaying an operating pointer for indicating the operating procedure on the consecutive operating screens, based on the operating procedure information and the operating screen information, so as to store the dynamic picture image file in the storage section.     (7) A computer program for executing a specific operation against to an apparatus, comprising the functional steps of: storing operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series; and storing operating screen information with respect to consecutive operating screens to be displayed on a display section corresponding to the operating procedure, while correlating the operating screen information with the operating procedure information.     (8) A computer program for executing a specific operation against to an apparatus, comprising the functional steps of: acquiring operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series; acquiring operating screen information with respect to consecutive operating screens correlated with the operating procedure information; and displaying the consecutive operating screens on a display section corresponding to the operating procedure, and at a same time, displaying an operating pointer for indicating the operating procedure on the consecutive operating screens, based on the operating procedure information and the operating screen information.     (9) A computer program for executing a specific operation against to an apparatus, comprising the functional steps of: acquiring operating procedure information including consecutive operating information according to an operating procedure against to an apparatus as a procedure in time series; acquiring operating screen information with respect to consecutive operating screens correlated with the operating procedure information; and displaying the consecutive operating screens on a display section corresponding to the operating procedure, and at a same time, generating a dynamic picture image file for displaying an operating pointer for indicating the operating procedure on the consecutive operating screens, based on the operating procedure information and-the operating screen information; and storing the dynamic picture image file.   

    
    
     BRIEF DESCRIPTION OF THE DRAWINGS  
      Embodiments will now be described, by way of example only, with reference to the accompanying drawings which are meant to be exemplary, not limiting, and wherein like elements are numbered alike in several Figures, in which:  
       FIG. 1  shows an example of a brief configuration of a remote operating system;  
       FIG. 2  shows an example of remote operating screen;  
       FIG. 3  shows an example of a functional configuration of a remote operating system;  
       FIG. 4  shows an example of a data structure of script data;  
       FIG. 5  shows a flowchart of an operating information recording processing;  
       FIG. 6  shows an example of an operating screen;  
       FIG. 7  shows an example of an operating screen;  
       FIG. 8  shows an example of an operating screen;  
       FIG. 9  shows an example of an operating screen;  
       FIG. 10  shows an example of an operating screen;  
       FIG. 11  shows an example of an operating screen;  
       FIG. 12  shows an example of an operating screen;  
       FIG. 13  shows an example of an operating screen;  
       FIG. 14  shows an example of output images;  
       FIG. 15  shows a flowchart for explaining an operating information reproducing processing; and  
       FIG. 16  shows an example of a table of output images. 
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT  
      &lt;Summary of Remote Operating System&gt; 
      Referring to the drawings, a remote operating system embodied in the present invention will be detailed in the following.  
       FIG. 1  shows an example of a brief configuration of a remote operating system  1 . As shown in  FIG. 1 , the remote operating system  1  is constituted by a copier  100  serving as an apparatus of remote operating object and a remote terminal device  300 , and is communicatively coupled to them through a communication network N including hard-wired and/or wireless communication paths. Although the present embodiment will be detailed by exemplifying a copier serving as an example of the image forming apparatus in the following, it is needless to say that another image forming apparatus, such as a facsimile, a printer, etc., is also applicable in the present invention.  
      As shown in  FIG. 1 , the copier  100  is provided with a display section  130  over that a touch panel  124  is mounted and a hard keys section  122 . The user can conduct a changing operation of various kinds of setting conditions, an instructing operation of the copy commencement, etc. in regard to the copier  100 , by pushing down the hard keys section  122  or touching the touch panel  124 . A main operating panel screen  210  from which various kinds of setting conditions can be inputted into the copier  100  and a main operating screen  200 , which includes an operating status, etc., are displayed on the display section  130 .  
      Further, the copier  100  also has a function as a Web server  112 . When the copier  100  is coupled to the communication network N based on the communication protocol, such as the TCP/IP, etc., the Web server  112  can be accessed from an external device. In response to the requesting command sent from the remote terminal device  300  serving as the accessing external device, the Web server  112  transmits remote operating screen data  174  (refer to  FIG. 3 ) to the remote terminal device  300  so as to display a remote operating screen  400  including a screen same as the main operating panel screen  210 .  
      The remote terminal device  300  serves as a client terminal device for remote-controlling the operations of the copier  100 , and for instance, is constituted by a personal computer, a PDA (Personal Digital Assistant), etc. As shown in  FIG. 1 , the remote terminal device  300  is provided with an operational section  320  having a keyboard and a mouse  322 , and a display section  330 . Further, the remote terminal device  300  has a function as the Web browser. When the remote terminal device  300  is coupled to the communication network N based on the communication protocol, such as the TCP/IP, etc., the remote terminal device  300  displays the remote operating screen  400  shown in  FIG. 2  on the display section  330 , based on the remote operating screen data  174  transmitted from the copier  100 .  
      As shown in  FIG. 2 , the remote operating screen  400  includes a remote setting panel  410 , a hard keys panel  430  and a script panel  450 . The contents of the remote setting panel  410  are the same as those of the main operating panel screen  210  to be displayed at the copier  100 , namely, the remote setting panel  410  is constituted by a tab button  412 , an operating status indication area  414  and an individual item setting area  416 . The tab button  412  is used for switching the display of setting items, which are classified into-various kinds of functions. The operating status indication area  414  is used for displaying the operating contents currently implemented in the copier  100 , the current using status of the copier  100 , etc. The individual item setting area  416  is used for setting the individual items included in the function switched by the tab button  412 .  
      In the remote setting panel  410  shown in  FIG. 2 , the copy function is selected by using the tab button  412 , and a document setting button  418  for setting the direction of the image to be read, etc., an image quality setting button  420  for setting a density of the copy, a magnification setting button  422  for setting a magnification, an applied setting button  424  for setting applied function, an output setting button  426  for setting the post processing (such as a staple processing, a sort processing, etc.) to be applied to the recorded paper sheets and a duplex copy setting button  428  for setting the duplex copy mode are displayed within the individual item setting area  416 . When the user clicks the mouse  322  while adjusting a mouse cursor MC, serving as a operation pointer, onto each of the abovementioned setting buttons, the setting panel corresponding to each of the setting items is displayed in the Windows format, so that the user can conducts the detailed setting operation on the setting panel displayed. The operation pointer is defined as such a symbol that is shaped in an arrow and moves with a dragging action of the mouse  322 .  
      The hard keys panel  430  is displayed as a group of buttons copied from the hard keys section  122  of the copier  100 , and includes a numerical button  432 , a reset button  434  for resetting the setting contents, an interrupt button  436  for activating the interrupt processing during the copy operation, a stop button  438  for stopping the copy operation, a confirmation copy button  440  for activating the confirmation copy operation and a start button  442  for commencing the copy operation.  
      The user can conduct setting operations at the time of the copy operation by touching the various kinds of buttons displayed on the main operating panel screen  210  of the copier  100  side, and can conduct the copy commencing operation or the copy resetting operation by pushing down the corresponding buttons included in the hard keys section  122 . On the other hand, the other user located at the site of the remote terminal device  300  can conducts the operations same as those conducted by touching the various kinds of buttons displayed on the main operating panel screen  210  of the copier  100  side or by pushing down the buttons included in the hard keys section  122 , by remote-controlling the copier  100  and clicking the various kinds of buttons included in the remote setting panel  410  and the hard key panel  430 .  
      Every time when the user clicks any one of the buttons displayed on the remote operating screen  400 , the operation information representing the content of the operation concerned are sequentially recorded one by one as the time sequential domain in the copier  100 . In the present embodiment, the operation information mentioned in the above is defined as script data  176  (refer to  FIG. 3 ). The script data  176  make it possible to reproduce the consecutive operations conducted by the user so as to resume the various kinds of setting conditions set by the user.  
      The script panel  450  serves as an operational panel for controlling the script data  176 , and includes a script indicating area  452  for indicating the contents of the script data  176 , a recording button  454 , a readout button  456 , an implementation button  458  and a clear button  460 .  
      After clicking the recording button  454 , the user conducts the various kinds of setting operations by clicking the buttons included in the remote setting panel  410  and/or the hard key panel  430 . Every time when the user clicks any one of the buttons mentioned in the above, the operation information are stored in the copier  100  and, at the same time, displayed on the script indicating area  452 . In addition, at the time of each operation, the image data of the operating screen indicated on the display section  330  (namely, the remote operating screen data  174 ) are stored as operating screen data  178  (refer to  FIG. 3 ) with the record of the operation information, while correlating with each of the operation information. Then, at the time when the user clicks the start button  442 , the record of the script data  176  and the operating screen data  178  is finalized. At this time, the image data representing the output image (output image data  180 ) are also stored, while correlating the output image data  180  with the script data  176  and the operating screen data  178 .  
      Further, when the user clicks the readout button  456 , a control section  110  reads out the script data  176  stored in the copier  100 . Then, at the time when the user clicks the implementation button  458 , the control section  110  reproduces the consecutive operations, which were conducted once by the user, and resumes the various kinds of setting conditions acquired through the consecutive operations. The clear button  460  is used for deleting the script data  176  already stored in the copier  100 , or the other script data  176  currently stored.  
      Still further, a reload button  470  and a close button  472  are displayed in the area located at the upper right position of the remote operating screen  400 . When the user clicks the reload button  470 , the remote terminal device  300  sends the transmitting request of the newest remote operating screen data  174  to the copier  100 , so as to revise the display of the remote operating screen  400 . The close button  472  is used for closing the remote operating screen  400 .  
      &lt;Configuration of Remote Terminal Device&gt; 
       FIG. 3  shows an example of the functional configuration of the remote operating system  1 . At first, the functional configuration of the remote terminal device  300  will be detailed in the following. As shown in  FIG. 3 , the remote terminal device  300  is provided with a control section  310 , the operational section  320 , the display section  330 , an I/F section  340  and a storage section  350 .  
      The control section  310  is constituted by CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc., and implements the various kinds of processing based on the predetermined programs in response to the inputted command signals, and also conducts the input/output operations of data and command signals from/to each of the functional sections, so as to totally manage and control the remote terminal device  300 . Concretely speaking, in response to operational signals inputted from the operational section  320 , the CPU reads out a program stored in the ROM or the storage section  350 , and then, displays the results of the processing executed according to the program concerned.  
      The operational section  320  is provided with the keyboard, having cursor keys, ten keys, various kinds of function keys, etc., and the pointing device, such as the mouse  322 , etc., so as to output the push-down signal of the pushed key, the positional signals of the mouse  322 , etc. to the control section  310 .  
      The display section  330  is constituted by a CRT (Cathode Ray Tube), a LCD (Liquid Crystal Display), etc. so as to display various kinds of screens based on the display data inputted from the control section  310 .  
      The I/F section  340  serves as a functional section for coupling the remote terminal device  300  to the communication network N so as to conduct the data communication through the communication network N. The I/F section  340  is provided with a modem, a LAN (Local Area Network) interface, a USB port, etc.  
      The storage section  350  serves as a functional section for conducting the data read/write operations for the storage medium, such as, for instance, a CD-ROM, a-memory card, a hard disc drive, etc. A magnetic storage medium, an optical storage medium, a semiconductor storage medium, etc. can be employed as the abovementioned storage medium, which stores application programs, various data processed by executing various kinds of processing programs, etc.  
      The control section  310  serves as the Web browser to display the remote operating screen  400  on the display section  330 . In addition, based on the positional signals of the mouse  322 , outputted from the operational section  320 , the control section  310  acquires (x, y) coordinate values of the mouse cursor MC on the remote operating screen  400 , and then, transmits the acquired coordinate data to the copier  100  through the I/F section  340  so as to request a transmission of the remote operating screen data  174 . Then, when receiving the remote operating screen data  174  transmitted from the copier  100 , the control section  310  changes the remote operating screen  400  to new one based on the remote operating screen data  174 . According to this operation, the remote terminal device  300  displays the remote operating screen  400  based on the remote operating screen data  174  transmitted by the web server  112 .  
      Further, the control section  310  receives the script data  176 , the operating screen data  178  and the output image data  180  from the copier  100 , in order to display the consecutive operational screens corresponding to the operating procedure on the display section  330  and to display the mouse cursor MC indicating the operating procedure on the screen of the consecutive operations, based on the script data  176  and the operating screen data  178 . Still further, based on the output image data  180 , the control section  310  displays the output image outputted by the copier  100  onto the display section  330 . Yet further, the control section  310  generates a moving image file for displaying the consecutive operational screens including the movement of the mouse cursor MC and the output image, and then, stores the generated moving image file into the storage section  350 .  
      &lt;Configuration of Copier&gt; 
      Next, a functional configuration of the copier  100  will be detailed in the following. As shown in  FIG. 3 , the copier  100  is provided with the control section  110 , an operating section  120 , the display section  130 , a scanner section  140 , a printer section  150 , an I/F section  160  and a storage section  170 .  
      The control section  110  is constituted by a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc., in order to execute processing based on the predetermined programs in response to the command signals inputted from the operating section  120  and conduct input/output operations of the instructions and data from/to each of the functional sections, so as to totally manage and control the copier  100 .  
      The operating section  120  is provided with the hard keys section  122  including various kinds of keys, such as numeral keys, a start key, a reset key, etc., to output the push-down signals corresponding to the pushed-down keys in the hard keys section  122  to the control section  110 . Further, the operating section  120  is also provided with a touch panel integrally formed with the display section  130 , so as to detect a position on the touch panel  124  touched by the finger tip of the user or a touch pen and to output the detected positional signal to the control section  110 .  
      The display section  130  is constituted by the CRT, the LCD, etc., over which a transparent touch panel is mounted. In response to instructions sent from the control section  110 , the display section  130  displays various kinds of screens to be outputted. Concretely speaking, the display section  130  displays the main operating screen  200  based on main operational screen data  172  stored in the storage section  170 . The control section  110  compares the positional signals, representing the touched position on the touch panel  124 , with the main operational screen data  172 , in order to determine which button included in the main operating screen  200  was touched by the user. Then, the control section  110  executes the processing corresponding to the button pushed by the user, for instance, changing the copy setting, revising the main operational screen data  172 , etc.  
      The scanner section  140  has a function for reading an image residing on the document, put on the document stacking tray, to generate image data representing the image. Concretely speaking, when the start key in the operating section  120  is pushed, the scanner section  140  conveys the document put on the document stacking tray to the contact glass at which the light, originally emitted from a light source and irradiated onto the document, is reflected from the document, and then, the reflected light travels into the CCD (Charge Coupled Device) image sensor through a mirror unit and the focusing lens so as-to read the reflected light as the image data.  
      The printer section  150  has a function for forming an image onto a transfer material. Concretely speaking, in the printer section  150 , the photoreceptor drum is exposed by scanning the laser beam emitted from the exposing section and modulated on the basis of the image data read by the scanner section  140  so as to form a latent image on it. Successively, in the developing section, toner particles are absorbed onto the photoreceptor drum, and then, the toner image formed on the photoreceptor drum is transferred onto the transfer material. Finally, in the fixing section, the toner image is fixed onto the transfer material by applying heat and pressure onto the transfer material with the toner image.  
      The I/F section  160  is provided with a modem, a LAN interface, a USB, etc., and has a function for coupling the copier  100  to the communication network N so as to conduct the data communicating operations.  
      The storage section  170  serves as a functional section for conducting the data read/write operations for the storage medium, such as, for instance, a VRAM (Video Random Access Memory), a CD-ROM, a memory card, a hard disc, etc. A magnetic storage medium, an optical storage medium, a semiconductor storage medium, etc. can be employed as the abovementioned storage medium, which stores application programs, various data processed by executing various kinds of processing programs, the image data read by the scanner section  140 , setting contents of the copy function set by the user, etc. Further, as shown in  FIG. 3 , the storage section  170  stores the main operational screen data  172 , the remote operating screen data  174 , the script data  176 , the operating screen data  178  and the output image data  180  in it.  
      The main operational screen data  172  serve as image data (for instance, in the form of HTML) for displaying the main operating screen  200  including the main operating panel screen  210  and the detailed setting panel, etc. When any one of the buttons on the main operating panel screen  210  is pushed, or any one of the buttons on the remote setting panel  410  of the remote terminal device  300  is clicked, the control section  110  generates the main operational screen data  172  so as to revise it as new data. Further, based on the revised main operational screen data  172 , the main operating screen  200 , in which the detailed setting panel (for instance, an applied setting panel P 1  in the form of the Windows format shown in  FIG. 8 ) overlaps the main operating panel screen  210 , is displayed.  
      The remote operating screen data  174  serve as image data (for instance, in the form of HTML) for displaying the remote operating screen  400  on the remote terminal device  300 . The control section  110  generates image data sets for displaying the hard key panel  430  and the script panel  450 , and then, generates the remote operating screen data  174  by combining and synthesizing the generated image data sets with the main operational screen data  172 .  
      Receiving the coordinate data from the remote terminal device  300 , the control section  110  compares the (x, y) values, represented by the received coordinate data, with the remote operating screen data  174 , so as to detect the position clicked on the remote operating screen  400 . Then, when the control section  110  determines that a button displayed on the remote setting panel  410  is clicked, the control section  110  generates the main operational screen data  172  for displaying the detailed setting panel corresponding to the clicked button on the main operating panel screen  210  so as to revise it as new data. While, when the control section  110  determines that a button displayed on the hard key panel  430  is clicked, the control section  110  deems that the corresponding hard-key button on the hard keys section  122  is pushed down, and conducts the processing operation corresponding to the hard-key button concerned (for instance, the commencement or the reset of the copy), and further, generates the main operational screen data  172  for displaying the operating status indication area  414  so as to revise it as new data.  
      At the same time when revising the main operational screen data  172  in response to the user&#39;s operational input, the control section  110  also revises the remote operating screen data  174 , based on the revised main operational screen data  172 , and then, transmit the revised remote operating screen data  174  to the remote terminal device  300 , in order to make the remote terminal device  300  revise the display of the remote operating screen  400 . For this purpose, the remote terminal device  300  can display the remote operating screen  400  including the remote setting panel  410  which is the same as the main operating panel screen  210 , based on the remote operating screen data  174 , while the copier  100  displays the main operating panel screen  210  based on the main operational screen data  172 .  
      The script data  176 , being operating procedure information, serve as a data table in which the consecutive operations to be conducted in the remote terminal device  300  of the user are recorded as the operating procedure information in the time domain series. Based on the coordinate data received from the remote terminal device  300 , the control section  110  determines which position in the hard key panel  430  or the remote setting panel  410  is clicked, and then, cumulatively stores the determined results one by one in order of the time series as the operating information in the form of the “command argument”.  
       FIG. 4  shows an example of the data structure of the script data  176 . For instance, operating information  190  represents an event that the position, at which coordinate values are x=“200”, y=“500” in the remote setting panel  410 , is clicked, while operating information  196  represents an event that “3” of the numerical button  432  on the hard key panel  430  is clicked.  
      Since the control section  110  can sequentially read out the operating information stored in the script data  176  in order to conduct the processing corresponding to the operation represented by the operating information concerned, it becomes possible to reproduce the user&#39;s consecutive operations stored in the script data  176  concerned. Accordingly, it is also possible to reproduce the copy conditions established previously by the user.  
      The operating screen data  178  serve as image data of consecutive operating screens, which were displayed on the display section  330  of the remote terminal device  300  corresponding to the operating procedure of the user, when recording the script data  176 . In other words, the operating screen data  178  are formed by cumulatively storing the remote operating screen data  174  as the time series item. Further, each of the operating screen data  178  is correlated with each of the operating information of the script data  176 . For instance, the image data for displaying an operating screen  500  (refer to  FIG. 6 ) is correlated with the operating information  190  included in the script data  176  shown in  FIG. 4 . According to the correlation mentioned in the above, it can be recognized that the position, at which coordinate values are x=“200”, y=“500” in the operating screen  500 , is clicked.  
      The output image data  180  serve as thumbnail image data of the images outputted by the copier  100  when recording the script data  176 .  
      When recording the script data  176 , the control section  110  stores both the script data  176  and the operating screen data  178  in the storage section  170  while correlating them with each other, and further, also stores the output image data  180  while correlating the output image data  180  with both the script data  176  and the operating screen data  178 .  
      &lt;Concrete Operations of Remote Operating System  1 &gt; 
      Next, concrete operations of remote operating system  1  will be detailed in the following.  
      Initially, referring to  FIG. 5 , an operating information recording processing will be detailed. The operating information recording processing is conducted on the basis of an operating information recording program stored in the ROM of the control section  110  or the storage section  170 . When the control section  110  of the copier  100  determines from the coordinate data transmitted from the remote terminal device  300  that the recording button  454  of the script panel  450  is clicked, the control section  110  reads out the operating information recording program in order to commence the operating information recording processing based on the program concerned.  
      The control section  110  waits an occurrence of a user event in its standby state. Hereinafter, the user event is defined as an event caused by an operating action conducted by the user. Concretely speaking, the user event would be a reception of the coordinate data transmitted from the remote terminal device  300  as a result of an action for clicking the mouse  322 .  
      As shown in  FIG. 5 , the flowchart of the operating information recording processing to be conducted by the control section  110  includes the steps of: detecting the occurrence of the user event (Step S 1 ); determining a kind of the operation, conducted by the user in the site of the remote terminal device  300 , from the coordinate data received; storing the image data of the operational screen displayed on the display section  330  of the remote terminal device  300  at the time of the operation (the remote operating screen data  174 ) and the operating information representing the action conducted by the user, while correlating them with each other (Step S 2 ), wherein the image data of the operational screen are stored as the operating screen data  178  in the storage section  170 , and the operating information are stored as the script data  176  in the storage section  170 ; revising the main operational screen data  172  and the remote operating screen data  174 , and transmitting the operational instruction to each of the functional sections (for instance, renewals of copy settings, such as a magnification setting, a number of copies, a size of document, etc., and the commencement of the copy operation), in response to the operational actions conducted by the user (Step S 3 ); determining that the storing operation of the operating information should be finalized, when the coordinate data of the start button  442  are received (Step S 4 , Yes); storing the thumbnail image data outputted from the copier  100  and established as the output image data  180 , while correlating the output image data  180  with the operating screen data  178  and the script data  176  (Step S 5 ); and finalizing the operating information recording processing.  
      When determining that the storing operation of the operating information should be continued (Step S 4 , No), the processing step returns to Step S 1 , and the processing steps form Step S 1  to Step S 4  are repeated so as to store the operating screen data  178  and the script data  176  in response to the occurrence of the user event.  
      For instance, when the user clicks a “ONE-SIDE→BOTH-SIDES” button  510  for the duplex copy setting, the coordinate data (x=“200”, y=“500”) of the mouse cursor MC on the “ONE-SIDE→BOTH-SIDES” button  510  are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  500  and the operating information  190  shown in  FIG. 4 , while correlating them with each other. As mentioned in the above, every time when the user conducts the clicking action in the site of the remote terminal device  300 , the image data of the operating screen are recorded into the operating screen data  178 , and the operating information are stored in the script data  176  as the time series item. In response to the action for clicking the “ONE-SIDE→BOTH-SIDES” button  510 , as shown in  FIG. 7 , the operating screen  501  in the state of selecting the “ONE-SIDE→BOTH-SIDES” button  510  is displayed on the display section  330 .  
      Next, when the user clicks an applied setting button  424  in the operating screen  501  shown in  FIG. 7 , the coordinate data (x=“500”, y=“200”) of the mouse cursor MC are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  501  and the operating information  191  shown in  FIG. 4 , while correlating them with each other. In response to the action for clicking the applied setting button  424 , as shown in  FIG. 8 , the operating screen  502  on which the applied setting panel P 1  overlaps is displayed on the display section  330 .  
      Successively, when the user clicks a one-sheet integrating button  511  in the operating screen  502  shown in  FIG. 8 , the coordinate data (x=“150”, y=“450”) of the mouse cursor MC are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  502  and the operating information  192  shown in  FIG. 4 , while correlating them with each other. In response to the action for clicking the one-sheet integrating button  511 , as shown in  FIG. 9 , the operating screen  503  on which a one-sheet integrating panel P 2  overlaps is displayed on the display section  330 .  
      Still successively, when the user clicks a 4in1 button  512  in the operating screen  503  shown in  FIG. 9 , the coordinate data (x=“200”, y=“320”) of the mouse cursor MC are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  503  and the operating information  193  shown in  FIG. 4 , while correlating them with each other. In response to the action for clicking the 4in1 button  512 , as shown in  FIG. 10 , the operating screen  504  in the state of selecting the 4in1 button  512  is displayed on the display section  330 .  
      Still successively, when the user clicks an OK button  513  in the operating screen  504  shown in  FIG. 10 , the coordinate data (x=“750”, y=“580”) of the mouse cursor MC are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  504  and the operating information  194  shown in  FIG. 4 , while correlating them with each other. In response to the action for clicking the OK button  513 , the one-sheet integrating panel P 2  is closed and, as shown in  FIG. 11 , the operating screen  505  is displayed on the display section  330 .  
      Still successively, when the user clicks an OK button  514  in the operating screen  505  shown in  FIG. 11 , the coordinate data (x=“748”, y=“580”) of the mouse cursor MC are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  505  and the operating information  195  shown in  FIG. 4 , while correlating them with each other. In response to the action for clicking the OK button  514 , the applied setting panel P 1  is closed and, as shown in  FIG. 12 , the operating screen  506  is displayed on the display section  330 .  
      Still successively, when the user clicks “3” of the numerical button  432  in the operating screen  506  shown in  FIG. 12 , the coordinate data of the mouse cursor MC are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  506  and the operating information  196  shown in  FIG. 4 , while correlating them with each other. In response to the action for clicking “3” of the numerical button  432 , as shown in  FIG. 13 , the operating screen  507  is displayed on the display section  330 . In the operating screen  507 , the number of copies is set at “0003”.  
      Yet successively, when the user clicks the start button  442  in the operating screen  507  shown in  FIG. 13 , the coordinate data of the mouse cursor MC are transmitted to the copier  100 . The control section  110  of the copier  100  stores the image data of the operating screen  507  and the operating information  197  shown in  FIG. 4 , while correlating them with each other. In response to the action for the start button  442 , the copier  100  outputs the copy images. The control section  110  stores the thumbnail image data, shown in FIG.  13 , as the output image data  180 , while correlating the output image data  180  with the operating screen data  178  and the script data  176 .  
      Next, referring to  FIG. 15 , the operating information reproduction processing will be detailed in the following. The operating information reproduction processing is such a processing that reproduces the operating screens once displayed on the display section  330 , based on the script data  176  and the operating screen data  178 , and is conducted on the basis of an operation information reproducing program stored in the ROM or the storage section  350  provided in the control section  310  of the remote terminal device  300 . Incidentally, the operating information reproduction processing is conducted only for confirming the contents of the operations. Accordingly, in the operating information reproduction processing, the copier  100  does not conduct the real operations (such as various kinds of setting operations, the copy operation, etc.).  
      As shown in  FIG. 15 , the flowchart of the operating information reproduction processing to be conducted by the control section  310  includes the steps of: acquiring the script data  176 , the operating screen data  178  and the output image data  180 , which are correlated with each other, from the storage section  170  of the copier  100  (Step T 1 ); storing the acquired data of the script data  176 , the operating screen data  178  and the output image data  180  into the storage section  350 ; reading out image data of an initial operating screen from the operating screen data  178  to display the initial operating screen on the display section  330  (Step T 2 ); reading out the operating information correlated with the image data of the operating screen currently displayed from the script data  176  so as to move the mouse cursor MC on the operating screen, based on the operating information concerned (Step T 3 ); displaying as if the button indicated by the mouse cursor MC were pushed down at the position based on the operating information (Step T 4 ); reading out image data of the next operating screen from the operating screen data  178  to display the next operating screen on the display section  330  (Step T 5 ), wherein it is applicable that a portion displayed in the operating screen, which is changed by the operation corresponding to the operating information, is indicated by a making symbol or the like so as to emphasize the portion concerned; determining whether or not the operating information read out in Step T 3  is the final item of the script data  176  (Step T 6 ); and returning to Step T 3 , when not in Step T 6 , in order to read out the operating information correlated with the image data of the operating screen currently displayed from the script data  176  so as to move the mouse cursor MC on the operating screen, based on the operating information concerned (Step T 3 ). As mentioned in the above, by repeating the processing from Step T 3  to Step T 6 , the consecutive operating screens are sequentially displayed one by one on the display section  330  according to the operating procedures.  
      The flowchart of the operating information reproduction processing to be conducted by the control section  310  further includes the steps of: displaying the output image based on the output image data  180  on the display section  330  (Step T 7 ), when determining that the operating information read out in Step T 3  is the final item of the script data  176  (Step T 6 , Yes), wherein it is applicable that the property information, such as the file name of the output image data  180 , the folder name of the storage device, the information indicating the copier  100  which output the image, etc., are also displayed as the character information associated with the output image; storing the contents of the consecutive operations displayed on the display section  330  in the steps from Step T 2  to Step T 7  into the storage section  350  as a dynamic picture image (Step T 8 ); storing the script data  176  into the storage section  350 , while correlating the script data  176  with the dynamic picture image concerned; and finalizing the operating information reproduction processing.  
      Incidentally, each of the moving attitude of the mouse cursor MC and the time period when revising the display of the operating screen is set at such a velocity that is recognizable for the user.  
      For instance, when the operating information reproduction processing is conducted on the basis of the script data  176  shown in  FIG. 4 , the image data (operating screen data  178 ) of the operating screens  500 - 507  shown in  FIGS. 6-13  and the output image data  180  indicated in  FIG. 14 , at first, the operating screen  500  shown in  FIG. 6  is displayed on the display section  330  as the initial operating screen. Then, based on the operating information  190  of “pushpanel  200   500  ” shown in  FIG. 4 , which is correlated with the image data of the operating screen  500 , the mouse cursor MC moves onto the “ONE-SIDE→BOTH-SIDES” button  510  of the operating screen  500 , and it is displayed as if the “ONE-SIDE→BOTH-SIDES” button  510  were pushed down.  
      Next, as shown in  FIG. 7 , the operating screen  501  in which the “ONE-SIDE→BOTH-SIDES” button  510  is selected is displayed on the display section  330 . Then, based on the operating information  191  of “pushPanel  500   200 ” shown in  FIG. 4 , which is correlated with the image data of the operating screen  501 , the mouse cursor MC moves onto the applied setting button  424  of the operating screen  501 , and it is displayed as if the applied setting button  424  were pushed down.  
      Successively, as shown in  FIG. 8 , the operating screen  502  on which the applied setting panel P 1  overlaps is displayed on the display section  330 . Then, based on the operating information  192  of “pushPanel  150   450 ” shown in  FIG. 4 , which is correlated with the image data of the operating screen  502 , the mouse cursor MC moves onto the one-sheet integrating button  511  of the operating screen  502 , and it is displayed as if the one-sheet integrating button  511  were pushed down.  
      Still successively, as shown in  FIG. 9 , the operating screen  503  on which the one-sheet integrating panel P 2  overlaps is displayed on the display section  330 . Then, based on the operating information  193  of “pushPanel  200   320 ” shown in  FIG. 4 , which is correlated with the image data of the operating screen  503 , the mouse cursor MC moves onto the 4in1 button  512  of the operating screen  503 , and it is displayed as if the 4in1 button  512  were pushed down.  
      Still successively, as shown in  FIG. 10 , the operating screen  504  in which the 4in1 button  512  is selected is displayed on the display section  330 . Then, based on the operating information  194  of “pushpanel  750   580 ” shown in  FIG. 4 , which is correlated with the image data of the operating screen  504 , the mouse cursor MC moves onto the OK button  513  of the operating screen  504 , and it is displayed as if the OK button  513  were pushed down.  
      Still successively, the operating screen  505  shown in  FIG. 11  is displayed on the display section  330 . Then, based on the operating information  195  of “pushpanel  748   580 ” shown in  FIG. 4 , which is correlated with the image data of the operating screen  505 , the mouse cursor MC moves onto the OK button  514  of the operating screen  505 , and it is displayed as if the OK button  514  were pushed down.  
      Still successively, the operating screen  506  shown in  FIG. 12  is displayed on the display section  330 . Then, based on the operating information  196  of “key 3” shown in  FIG. 4 , which is correlated with the image data of the operating screen  506 , the mouse cursor MC moves onto “3” of the numerical button  432  of the operating screen  506 , and it is displayed as if “3” of the numerical button  432  were pushed down.  
      Yet successively, the operating screen  507  shown in  FIG. 13  is displayed on the display section  330 . In the operating screen  507 , the number of copies is set at “0003”, as the result of the operation in the operating screen  506  shown in  FIG. 12 . As shown in  FIG. 13 , it is applicable that the number of copies “0003” is encircled by a mark  515  so as to emphasize the revised portion. Further, when the mark  515  is displayed, by moving the mark  515  from another position to the emphasized position, it is possible to improve the effect of the enhancement than ever. Then, based on the operating information  197  of “key START” shown in  FIG. 4 , which is correlated with the image data of the operating screen  507 , the mouse cursor MC moves onto the start button  442  of the operating screen  507 , and it is displayed as if the start button  442  were pushed down.  
      Finally, the display of the operating screen is finalized, and, as shown in  FIG. 14 , the output image based on the output image data  180  is displayed on the display section  330 . Incidentally, it is applicable that the output image is displayed for every page or every job. For instance, as shown in  FIG. 16 , it is also applicable that a list of the output images is displayed, and the file name is indicated for each of the output images.  
      As described in the foregoing, according to the present embodiment, since the script data  176 , the operating screen data  178  and the output image data  180  are stored while correlating them with each other, it becomes possible to easily confirm each of the operating screens later on, and therefore, it also becomes possible to easily grasp the contents of the operations conducted for the copier  100 .  
      Further, since the output image data  180  are stored, it becomes possible to refer to the output images when analyzing the malfunction of the copier  100 . In addition, it also becomes possible to prevent the copier  100  from being used for an injustice purpose, such as an injustice copy operation, etc.  
      Still further, since the output image data  180  are the thumbnail image data, it is possible to reduce the storage capacity for storing the image data, compared to the case of storing the image data of real image size. However, it is possible to make it a user selectable item whether the thumbnail image data or the real-sized image data should be stored.  
      Incidentally, when the output image data  180  are not necessary, only the script data  176  and the operating screen data  178  are stored while correlating them each other.  
      Still further, since, based on the script data  176  and the operating screen data  178  correlated with the script data  176 , the consecutive operating screens are sequentially displayed one by one on the display section  330  corresponding to the operating procedures, and, at the same time, the mouse cursor MC for indicating the operating procedure on each of the operating screens is also displayed, it becomes possible to easily grasp the contents of the operations conducted for the copier  100 .  
      Yet further, since the contents of the operations conducted for the copier  100  are stored as the dynamic picture image file, by reproducing the dynamic picture image file, it becomes possible to easily grasp the contents of the operations.  
     MODIFIED EXAMPLES  
      In the foregoing, the example in which the present invention is applied to the remote operating system  1  has been described. However, the scope of the present invention is not limited to such the remote operating system  1  mentioned in the above. The preferred embodiment could be modified as needed, as described in the following.  
      For instance, although, in the abovementioned embodiment, the script data  176 , the operating screen data  178  and the output image data  180  are stored in the copier  100  side, it is also applicable that those are stored in the storage section  350  of the remote terminal device  300  side in response to the operations conducted by the user. Further, it is also applicable that the operating information recording program is stored in the remote terminal device  300  side, so that the control section  310  of the remote terminal device  300  implements the operating information recording processing.  
      Further, although, in the abovementioned embodiment, the operating information reproduction processing is conducted in the remote terminal device  300  side, it is also applicable that the operating information reproduction program is stored in the copier  100  side, so that the control section  110  of the copier  100  implements the operating information reproduction processing. At that time, the consecutive operating screens are possibly displayed either on the display section  130  of the copier  100  or on the display section  330  of the remote terminal device  300  after transmitting the image data of them to the remote terminal device  300 . With respect to the dynamic picture image file to be stored in the storage section  350  in the operating information reproduction processing, it is also applicable that the dynamic picture image file is stored in the storage section  170  of the copier  100  side.  
      Still further, it is applicable that, after completing the operating information recording processing, the dynamic picture image file for reproducing the contents of the operations is successively generated so as to store it together.  
      Still further, although, in the abovementioned embodiment, the image data of the operating screens are stored, it is also applicable that the code information corresponding to the each of the operating screens are stored instead of the image data. In the case of storing the code information, it becomes possible to reduce the storage capacity for storing the information in regard to the consecutive operating screens to a smaller level, compared to the case of storing the image data.  
      Still further, instead of displaying the movements and the clicking actions of the mouse cursor MC on the operating screens in the continuous dynamic picture image as aforementioned in the present embodiment, it is also applicable that the movements and the clicking actions are simply displayed one by one along the time series of the operations (slide-show type display method). Further, when displaying the dynamic picture image, it is possible to cut or shorten the transient times of the screen changes, which are obvious or self-evident for the user, so as to achieve the high-speed display mode. Alternatively, it is also applicable that a plurality of operating screens are displayed on a single screen by aligning them in a line, so as to make it possible to recognize the flow of the operating screens at one sight (one-screen integrating type display method). Further, other than the images of the operating screens, for instance, it is also applicable that the consecutive dynamic picture image is generated by mixing the watching images, etc., which are captured from the outside of the copier  100  and comply with the time series, in it.  
      Still further, it is also applicable that the operating actions conducted by the user at the operating section  120  of the copier  100  are stored in the storage section  170  of the copier  100  as the script data  176 . In this case, in Step S 1  of the operating information recording processing shown in  FIG. 5 , by detecting an occurrence of the user event that the operating section  120  of the copier  100  is operated, the script data  176  can be stored.  
      Still further, although, in the abovementioned embodiment, the all area of the operating screen displayed on the display section  330  of the remote terminal device  300  is reproduced in the operating information reproduction processing, it is also applicable that, when displaying the contents of the operations on the remote setting panel  410 , only the remote setting panel  410  is displayed, while, when displaying the contents of the hard key panel  430 , the hard key panel  430  is displayed by scrolling the screen as needed.  
      Still further, although, in the abovementioned embodiment, the processing is commenced by clicking the recording button  454  and the recording operation is finalized by clicking the start button  442 , it is also applicable that the script data  176 , the operating screen data  178  and the output image data  180  are periodically stored for every predetermined time period, irrespective of the instruction of the user.  
      Still further, it is also applicable that the compression processing and/or the encryption processing are/is applied to the script data  176 , the operating screen data  178  and the output image data  180 , when storing them. By compressing the data, it becomes possible to reduce the storage capacity for storing them at lower level. By encrypting the data, it becomes possible to maintain the security of the data.  
      Still further, the scope of the system configuration of the remote operating system  1  is not limited to the aforementioned embodiment. For instance, the system configuration, which is provided with a plurality of remote terminal devices, would be applicable in the present invention. In this case, a plurality of the script data  176 , the operating screen data  178  and the output image data  180 , which are acquired by setting operations conducted in the plurality of remote terminal devices, are stored in the copier  100 . Accordingly, it becomes possible for the user residing at a separate remote terminal device to confirm the contents of the operations conducted in another remote terminal device.  
      Yet further, it is also applicable that the remote operating system  1  has such a system configuration, in which a plurality of copiers are coupled to a single remote terminal device  300  through the network.  
      According to the present invention, the following effects can be attained. 
      (1) It becomes possible to easily grasp the contents of the operations conducted for the apparatus.     (2) It becomes possible to refer to the output data outputted from the apparatus when analyzing the malfunction of the apparatus.     (3) It becomes possible to refer to the output data outputted from the image forming apparatus when analyzing the malfunction of the image forming apparatus     (4) It becomes possible to store the data in the storage having a storing capacity smaller than ever.     (5) Since the image data representing each of the operating screens are stored, it becomes possible to easily confirm each of the operating screens.     (6) Since the code information for specifying each of the operating screens are stored, it becomes possible to store the operating screen information with respect to the consecutive operating screens in the storage having a storing capacity smaller than ever.     (7) Since the consecutive operating screens are sequentially displayed one by one while displaying the operating pointer for indicating the operating procedure on each of the operating screens, it becomes possible to easily grasp the contents of the operations conducted for the apparatus.     (8) Since the components of the operations conducted for the apparatus are stored as the dynamic picture file, it becomes possible to easily grasp the contents of the operations.    

      While the preferred embodiments of the present invention have been described using specific term, such description is for illustrative purpose only, and it is to be understood that changes and variations may be made without departing from the split and scope of the appended claims.