Abstract:
A message notice reply system and a method thereof are disclosed. A message reply scheme functioning a deadline, address and verification for replying is introduced into an electronic mail system. As a sender transmits the message, a message-to-reply field will be incorporated to the message, and a reply field will be added after the recipient opens it. More, a reminder, which can be configured to send to a mobile phone or telephone via VoIP connection, will be launched before the deadline. The reply field won&#39;t be checked until the recipient replies the message. As well, the message-to-reply field won&#39;t be checked until the sender receives the reply. Further, a multimedia apparatus and a handwriting device are utilized to transmit a multimedia message from the sender and reply from the recipient. The invention is applied to substitute the conventional appointment between people that can not trace the schedule precisely.

Description:
BACKGROUND OF THE INVENTION 
       [0001]    1. Field of the invention 
         [0002]    The present invention relates to a message notice reply system and a method thereof, and more particularly to a message reply scheme introduced in a message transmitting system to achieve the message reply and tracking effects after a job is dispatched. 
         [0003]    2. Description of Related Art 
         [0004]    In general, supervisors in a company usually deliver a job to their subordinates by transmitting messages through verbal expressions, written memos or emails. However, busy subordinates may neglect the job delivered by their supervisor easily in the aforementioned method of dispatching jobs. Some supervisors may forget the job that they dispatch. Some supervisors are not sure whether or not their message is delivered properly, and some worry whether or not the job is done properly. Subordinates may forget or delay the job. 
         [0005]    The traditional way of using e-mail for transmitting messages to remind an opposite party about some matters such as a sender specifies a “receipt request” function to request the recipient of an email when the sender sends the email to the recipient to assure that the recipient has actually received the email. The sender uses a mail user agent (MUA) to transmit an email through a mail transfer agent (MTA), wherein a receipt request command is bundled with the email, such that if the recipient uses the mail user agent (MUA) such as Outlook and Mozilla Thunderbird to open the mail, then a pop-up window can be used to notice the recipient whether or not to reply the e-mail. 
         [0006]    The sender can further use e-mail software to generate a message notice, and sent the message notice in the form of an e-mail to the recipient, and the e-mail software used by the recipient produces an event of the calendar, so as to achieve the aforementioned purpose of delivering a job. 
         [0007]    In addition to the traditional way of delivering a job as described in the prior art or using an improved prior art email function to provide an interactive way of delivering a job, the present invention further provides a message notice reply system and its method related to a message reply scheme for actively providing a reminder, and also creates a mail content including voice, image or handwriting content to give a more convenient and efficient message notice reply effect. 
       SUMMARY OF THE INVENTION 
       [0008]    In view of most job deliveries between people are done orally in person or through telephone, and the progress of the delivered job cannot be traced even if an e-mail or a mobile phone message is used for the same purpose, the present invention provides a message notice reply system and a method thereof, adding a message reply scheme to a general mail system, such that both sender and recipient can monitor the statues of processing and replying each mail, and also provide a message reminder function to assure that the mail recipients can execute the delivery job. 
         [0009]    The message notice reply system of the invention comprises message sending means, waiting-to-reply means, message receiving means, a reply reminding means, replying means and acknowledge means. 
         [0010]    When the message sending means of the message agent sends a message in accordance with a preferred embodiment of the invention, a message reply control entry is added to the message. If the message is sent via an e-mail, then the mail user agent (MUA) connects to an outgoing mail server and transmits the e-mail to a receiving end after the sender is verified, and the message can be a text, a scanned document or a file including an audio/video document produced by an audio/video retrieving apparatus and attached to the message and a dynamic description produced by a handwriting system and recorded. Before sending the message, the waiting-to-reply means sets a time to reply the message, and after sending the message, the message agent adds a wait-to-reply field, and there are no particular limitations on the date, time, or recipient. If the recipient uses the message agent to receive the message sent by an e-mail, then the mail user agent (MUA) will connect to an incoming mail server, and the e-mail will be received after the recipient is verified. After the reply reminding means analyzes the received message content by the message agent, the message is recorded in the message agent and a reply reminder field is added, and different forms of repeated reminders can be performed to the recipient with a specific deadline. If the recipient completes the job delivered by the sender or needs to reply to the sender, then the recipient will select a desired reply message, and use the message agent to send a reply message, wherein the message reply control entry is still attached, and the reply reminder field is recorded to show the completion of the reply, and the reply message can be a text, a scanned document, or a file including an audio/video document produced by an audio/video retrieving apparatus and attached to the message and a dynamic description produced by a handwriting system and recorded. After the sender has received a reply message from the recipient and analyzed the message, the replying means records the message reply control entry information, and records the wait-to-reply field previously added by the message agent. 
         [0011]    The message notice reply method of the invention comprises a message sending procedure and a message receiving procedure. 
         [0012]    The message sending procedure comprises the step of starting a message agent to connect an outgoing mail server, adding a message reply control entry to a message created by a sender, transmitting the message to a recipient through the outgoing mail server, using the message agent to file a backup copy, and adding one or more wait-to-reply fields. 
         [0013]    The message receiving procedure comprises the steps of connecting the incoming mail server to receive a message, analyzing the content of the message, filing the message, adding a reply reminder field. Then, a message reply procedure is carried out. The message reply procedure comprises the steps of connecting an outgoing mail server to send a reply message, and records the reply reminder field. Finally, an acknowledge procedure comprises connecting an incoming mail server to receive the reply message, analyzing the reply message, and then recording the wait-to-reply field. 
         [0014]    To make it easier for our examiner to understand the expected objectives, technical measures and effects of the present invention, we use preferred embodiments together with the attached drawings for the detailed description of the invention, but it should be pointed out that the attached drawings are provided for reference and description but not for limiting the present invention. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0015]      FIG. 1  shows the architecture of an e-mail system in accordance with the present invention; 
           [0016]      FIG. 2A  shows a screen of a sender end of a message notice reply system in accordance with the present invention; 
           [0017]      FIG. 2B  shows a screen of a recipient end of a message notice reply system in accordance with the present invention; 
           [0018]      FIG. 2C  shows a screen of a message agent in accordance with the present invention; 
           [0019]      FIG. 2D  shows a directory used by a message agent in accordance with a preferred embodiment of the present invention; 
           [0020]      FIG. 3  shows a flow chart of a message notice reply system and its method in accordance with the present invention; 
           [0021]      FIG. 4A  shows a flow chart of transmitting a message by a message notice reply system in accordance with the present invention; 
           [0022]      FIG. 4B  shows a flow chart of replying a message by a message notice reply system in accordance with the present invention; 
           [0023]      FIG. 5A  shows a flow chart of transmitting an audio/video message by a message notice reply system in accordance with the present invention; 
           [0024]      FIG. 5B  shows a flow chart of replying an audio/video message by a message notice reply system in accordance with the present invention; 
           [0025]      FIG. 6  shows a flow chart of transmitting a message by a message agent of a message notice reply system in accordance with the present invention; 
           [0026]      FIG. 7  shows a flow chart of receiving a message by a message agent of a message notice reply system in accordance with the present invention; 
           [0027]      FIG. 8  shows a flow chart of replying a message by a message agent of a message notice reply system in accordance with the present invention; 
           [0028]      FIG. 9  shows a flow chart of replying a message by a message agent of a message notice reply system in accordance with the present invention; and 
           [0029]      FIG. 10  shows a flow chart of a message notice reply system selecting a message creating method in accordance with the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0030]    The present invention is described in details by preferred embodiments together with attached drawings as follows: 
         [0031]    The invention provides a message notice reply system and a method thereof, wherein a message reply scheme is introduced into an e-mail system to replace the traditional job delivery between people that cannot trace its progress or schedule effectively. 
         [0032]    In the network environment of the Internet or a local area network (LAN), a system including a plurality of mail servers is used for transmitting e-mails. Referring to  FIG. 1  for the network architecture of an e-mail system, a first mail server  12  and a second mail server  14  are connected separately to the Internet  10 , and each has a domain name, such as domain 1  for the first mail server  12 , wherein a mail transfer agent (MTA)  121  establishes the mail service of @domain 1 , and domain 2  for the second mail server  14 , wherein the mail transfer agent (MTA)  141  establishes the mail service of (domain 2 . 
         [0033]    A plurality of computers used by users are connected directly or indirectly to the Internet  10 , or directly connected to a personal computer  16  of the first mail server  12 , and connected to personal computers  18 ,  18 ′,  18 ″ of the second mail server  14  as shown in  FIG. 1 , and each personal computer installs a mail user agent (MUA) such as Outlook, Mozilla Thunderbird and different mail sending and receiving software supporting different operating systems for receiving e-mails. In  FIG. 1 , users need to use a mail user agent (MUA)  161  installed in the personal computer  16  to transmit or receive e-mails, and a user at an opposite end can use a mail user agent (MUA)  181  installed in the personal computer  18 , a mail user agent (MUA)  181 ′ installed in the personal computer  18 ′ or a mail user agent (MUA)  181 ″ installed in the personal computer  18 ″ to receive or transmit e-mails. 
         [0034]    The message notice reply system in accordance with a preferred embodiment adopts e-mails for its process, but the procedures including the preparation, transmission and receipt and reply of messages are necessary to be transmitted via e-mail, since a specific proxy program can be used to achieve the specific communication protocol. Particularly, the reply software program for creating audio/video can maximize the utility of the functions of the message notice reply system. In addition to a general mail communication protocol, a peer-to-peer method can be used for the transmissions. The message agent of the mail user agent (MUA) introduces a message reply scheme, and the message notice in accordance with a preferred embodiment of the present invention can be a job delivered by a superior to a subordinate or among colleagues or friends. 
         [0035]    Referring to  FIG. 2A  for a screen of a sender end of a message notice reply system in accordance with the present invention, the screen of a sender end of the message agent comprises two areas, respectively a sender&#39;s mail sending area  20  and a sender&#39;s mail receiving area  22 , wherein the sender&#39;s mail sending area  20  includes a mail sending area field  201  and a message content list  203  comprised of information such as date/time, message recipient, subject, way to send, and time to reply. After a sender sends out a message, the sender can use the message agent to automatically set a default message subject, or manually create the message subject, and set the time to reply the message, wherein the time to reply is converted into a reply date after the time to reply is set to a few hours, a few days or a few weeks. The foregoing setup result and the date/time and sender of the transmitted message will be displayed automatically in the message agent field. Further, the above information can be sent by an audio/video, an audio/video handwriting document or a text mail, and the way to send is displayed in a creating method field  209  which includes a message produced by a scanned document or a retrieved screen, a message produced by an audio/video, a handwriting message, a pure text message, and a message produced by capturing a plurality of scans and a message produced by retrieving successive screens, and the aforementioned methods can be combined freely to produce a message, such as a mail produced by “scanned document or retrieved screen+audio/video+handwriting” or a mail simply produced by a “scanned document or a retrieved screen” or an “audio/video mail” produced by an audio/video preparing equipment” or a mail including “audio/video+handwriting mail” in its production or a “handwriting mail” carried out by a handwriting panel, or a mail combined with “handwriting+audio/video”, such that the sender can produce different e-mails quickly by clicking a desired option, and needs to comply with each hardware equipment including an audio/video device, a handwriting panel and a scanner, etc. 
         [0036]    More specifically, the mail is sent for the first time according to a method in the creating method field  209 , and the record of sent message data is generated in the sender&#39;s mail sending area  20 , but the mail is sent for the second time and thereafter by clicking any record of the message or any replied and received record of message in the sender&#39;s mail sending area  20  or the sender&#39;s mail receiving area  22 , and then selecting a creating method in the creating method field  209  to complement the message for the second time, third time, fourth time to n th  time. Thus, a sent reply time is not just for a one-to-one correspondence record only, but also for many sent or replied records. Further, the sender can select an option whether or not to complete the message (and the default setting is set to be not to complete), so that we can check the messages of all incomplete jobs. 
         [0037]    Another area is provided for displaying the sender&#39;s mail receiving area  22 , which comprises a mail receiving area field  205  and a message content list  207  including reply date/time, respondent, subject, and type of reply. After the message sender has transmitted a message, and set its time to reply (the time to reply or the person to reply may not set), a “wait to reply field” is added in the sender&#39;s mail receiving area  22  and displayed at a side of the corresponding transmitted message to record the reply message, in addition to the messages recorded in the aforementioned message content list  203  of the sender&#39;s mail sending area  20 , similar to the aforementioned sender&#39;s mail receiving area  22  comprised of the mail receiving area fields  205  and the message content list  207 . Further, a reply reminder is generated within a specific time according to the message of the wait to reply field. 
         [0038]    In the embodiment as shown in the figure, the sender&#39;s mail sending area  20  records that a recipient B sent a message with a subject “Job” on January 3, and set the time to reply as January 10; and another person sent a message with a subject “Notice” to the recipient B on February 1 and set the time to reply as February 5, and sent a message with a subject “Announcement” to several recipients C, D, E, F. Further, the sender&#39;s mail receiving area  22  records that the recipient B sent a reply message with a subject “Re: Job” (which is automatically generated by adding the retrieved original subject of the received message behind the reply (Re:)) to the sender A (wherein it is not necessary to display the sender A on the screen) on January 8 to reply the message sent by the sender A, and the reply is made in the form of an audio/video message. In addition to the main reply method by using audio/video contents, another preferred embodiment can use a text message, and the sender&#39;s message can be transmitted simultaneously to a plurality of recipients. Now, the recipient field may show a plurality of recipients, and the corresponding fields will indicate a plurality of employee reply fields, so that each reply status can be traced easily. Each of the field contents can be opened by clicking with a mouse or any other pointing device, and the screen display facilitate users to trace each reply message. In another preferred embodiment, if the time to reply of the sender end is up, but no mail is replied yet, then the program will automatically generate a number of times of the reply reminders, and such reply reminders will be shown automatically on a computer screen or dialed automatically to a preset telephone or mobile phone through the function of a VoIP to provide an effective reminder automatically. 
         [0039]    In this preferred embodiment, the sender can click the message in the sender&#39;s mail sending area  20  again to resend the already transmitted message to other persons and set the time to reply. Now, the message content list  203  in the sender&#39;s mail sending area  20  produces a record of the sent message, and displays each sent message according to the sending order. Similarly, if the recipient end repeatedly makes a reply, the sender&#39;s mail receiving area  22  of this embodiment will produce a record of the reply message in the message content list  207  again, and display each reply message according to the reply order. 
         [0040]    Referring to  FIG. 2B  for a screen of a recipient end of a message notice reply system in accordance with the present invention, the message agent comprises two areas, respectively a recipient&#39;s mail receiving area  24  and a recipient&#39;s reply area  26 , wherein the recipient&#39;s mail receiving area  24  comprises a mail receiving area field  211  consisting date/time, message sender, subject, way to receive, and time to reply, and the information of the received message is displayed at the message content list  213 . After the message is received, the message agent will analyze the message content to display the information of the message such as the field contents of date/time, message sender, subject, way to receive, and time to reply, etc. If the message is a message with an attached message reply control entry, then the recipient&#39;s reply area  26  will add the a reply area field  215  (comprising the fields of reply date/time, respondent, subject and reply method) corresponding to the message, and produce a corresponding message in the message content list  217  after the reply is made. 
         [0041]    In this preferred embodiment, the sender also can click a message in the recipient&#39;s mail receiving area  24  to send the already replied message to the original sender. Now, the message content list  217  in the recipient&#39;s reply area  26  will produce another record of reply message, indicating that the reply has been made for several times, and each message is displayed according to the reply order. In the same time, if the recipient end receives such reply message repeatedly, the mail receiving area also displays another record of reply message. In the embodiment as shown in the figure, the recipient receives the “Job” message sent by the sender A on January 3 and learns from the message content that the time to reply is January 10, since this message has set the time to reply, and thus a “reply reminder field” is added and displayed at a side of the corresponding received message, for recording a required reply message, similar to the aforementioned recipient&#39;s reply area  26  comprised of the reply area field  215  and the message content list  217 . Further, a reply reminder (displayed on the screen, or dialed to a telephone or mobile phone through a network by an integrated VoIP technology) is produced (repeatedly) in a specific time according to the message of the reply reminder field, and the way to receive including an audio/video, an audio/video handwriting document, and a text mail is recorded. 
         [0042]    In the embodiment as shown in the figure, the sender A sent a message with a subject “Notice” on February 1 and set the time to reply as February 5, and received a “Notice” message sent by a sender C on February 3 and a set time to reply on February 7. 
         [0043]    However, after the recipient has received a reply message of the sender, the recipient&#39;s reply area  26  has recorded the reply message. In the embodiment as shown in the figure, the message content list  217  records that the recipient B replied a reply “Re: Job” message on January 8, and the way of replying the message is by an audio/video document, or by a text reply in accordance with another preferred embodiment. Further, it is recorded that the reply message “Re: Notice” is sent by the recipient B on February 3, the way of replying the message is by a scanned document. 
         [0044]    When the reply is made, it is necessary to click any one of the records in the message recipient&#39;s mail receiving area  24  first, and use the creating method field  219  to select a way of producing the reply message, which includes a message produced by a scanned document or a retrieved screen, an audio/video message, a handwriting message, a pure text message, a message produced by capturing a plurality of scans, a message produced by retrieving successive screens, and a message produced by any combination of the above such as a mail produced by the “scanned document or retrieved screen+audio/video+handwriting’ or a mail simply produced by a “scanned document or a retrieved screen” or an audio/video mail prepared by an audio/video apparatus or an “audio/video+handwriting mail” produced by a handwriting panel, or an integrated “handwriting+audio/video” mail, so that the sender can produce different e-mails quickly by clicking a desired option, and the sender has to comply with each hardware equipment including an audio/video device, a handwriting panel and a scanner, etc. More specifically, when the reply is made, several copies of the replies can be duplicated to any record of the received message item in the same recipient&#39;s mail receiving area  24 , so that users can complement any missing description of the reply anytime. 
         [0045]    In the reply mechanism in accordance with the foregoing preferred embodiment, a message reply control entry is introduced to the transmitted message, and the information comprises control entries such as time to reply, reply address and wait/reply reminder field. If the message is transmitted from the sender, the message agent at the message sender end will add one or more wait-to-reply fields, wherein the date/time, or reply person is not restricted, and the message reply control entry is attached to the message, and the wait to reply field is recorded, and the recipient&#39;s reply message is displayed as shown in  FIG. 2A . 
         [0046]    After the recipient end receives and opens the message, the message agent at the recipient end adds a reply reminder field according to the attached control entry information, wherein the recorded contents are listed in a screen of the recipient end as shown in  FIG. 2B , and a reminder is issued to the recipient within the recorded deadline (which is a default setting or a period such as three hours or a day set by users). After the recipient end has replied the message, the reply is recorded in the reply reminder field, which will be converted into a reply date automatically, and at least record the reply date/time. After the sender end has received the reply message, the attached message (such as the message reply control entry) is recorded into the wait-to-reply field according to the message attached to the reply message, and at least the reply date/time is recorded, so as to achieve the purpose of replying to a message after a job is delivered. 
         [0047]    The aforementioned message notice reply system can further transmit an audio/video document produced by the audio/video retrieving apparatus, and the handwriting system. After the recipient end has received the audio/video document, the aforementioned message reply mechanism is provided for replying an audio/video message. In addition, the message agents of the sender and the recipient in accordance with this preferred embodiment are mail user agents (MUA), and the transmitted and received messages are in the form of e-mails, and the devices used by both of them are desktop computers or notebook computers or other portable communication devices including personal digital assistants (PDA) and mobile phones, etc. Further, the sender end can transmit the foregoing message to the recipient end at the same time, and the recipient end can have a plurality of recipients. 
         [0048]    The message notice reply system in accordance with the present invention comprises the aforementioned mail sending and receiving functions integrated in the message agent as shown in  FIG. 2C , and the program comprises a sending mail folder  27  and a receiving mail folder  28 , wherein the functions include using a message agent to achieve mail sending means and mail receiving means, such that the sending mail folder  27  or the receiving mail folder  28  can be browsed by switching a computer cursor (or a mouse cursor or a keyboard control), and the display method is not limited those illustrated in the figure, but also includes other required mail sending and receiving functions of an e-mail system. 
         [0049]    In a preferred embodiment as shown in  FIG. 2C , a sending mail folder  27  displayed on the screen of the send end as shown in  FIG. 2A  comprises two areas, respectively a sender&#39;s mail sending area  20  and a sender&#39;s mail receiving area  22 , and the sender&#39;s mail sending area  20  includes a mail sending area field  201  and a message content list  203 , and the sender&#39;s mail receiving area  22  has a mail receiving area field  205  and a message content list  207 , and several creating methods  209  displayed in accordance with a preferred embodiment include the foregoing “scanned document or retrieved screen+audio/video+handwriting”, “scanned document or retrieved screen”, “text mail”, “audio/video mail”, “audio/video+handwriting mail”, “handwriting mail”, “captured scanned documents+audio/video+handwriting”, “successive retrieved screens+audio/video+handwriting” and “handwriting+audio/video mail’, etc. 
         [0050]      FIG. 2D  shows a directory used by a message agent in accordance with a preferred embodiment of the present invention, and if it is necessary to produce a message, the name list of recipients in the directory  29  can be used for the selection, and the recipients can be divided into groups  291  to facilitate their search and display, and each group  291  displays its respective fields such as name  293  and e-mail  295 , etc. The select field  297  is provided for selecting one or more recipients, and after the selection is completed, a reply deadline can be set in the deadline setup field  298 , such as a few hours, a few days or a few weeks, and the program will automatically convert the reply deadline into date and time for the display. 
         [0051]      FIG. 3  shows a flow chart of a message notice reply system and its method in accordance with the present invention, the message notice reply system of the invention introduces the foregoing message agent to the message reply mechanism, and includes a plurality of functional means as described below:
       1. (Step S 301 ) When the message sending means uses a message agent to send a message, a message reply control entry is attached to the message, and if the message is in the form of an e-mail, then a mail user agent (MUA) connects to an outgoing mail server. After the sender is verified (and the verification is not a must), the e-mail is sent to a receiving end, and the message can be a text, a scanned document or a file including an audio/video document produced by an audio/video retrieving apparatus and attached to the message and a dynamic description produced by a handwriting system and recorded.   2. (Step S 303 ) Before the waiting-to-reply means sends out the message, a time to reply the message is set. After the message is set, one or more wait-to-reply fields are added to the message agent, and the wait to reply fields are displayed on a side corresponding to the message.   3. (Step S 305 ) The recipient receives the message by the message agent.         
         [0055]    If the message is in the form of an e-mail, then a mail user agent (MUA) connects to an incoming mail server, and receives the e-mail after the recipient is verified.
       4. (Step S 307 ) The reply reminding means records the message into the message agent after the message agent analyzes the received message content, and then a reply reminder field is added to remind the recipient to reply within a specific deadline (and the reminding method includes using the VoIP technology for the reminder), and the reply reminder field is displayed at a side corresponding to the message.   5. (Step S 309 ) When the recipient completes the job delivered by the sender or other required replies, the recipient selects a desired reply message first, and sends a reply message by the message agent, wherein the message reply control entry is attached, and the reply reminder field is recorded to indicate the completion of a reply, and the reply message can be a text, a scanned document or a file, including an audio/video document produced by an audio/video retrieving apparatus and attached to the reply message, or a handwriting dynamic description of the reply message produced by the handwriting system;   6. (Step S 311 ) Confirm that the replying mean records the information of a message reply control entry after the sender has received the recipient&#39;s reply message and analyzes the information recorded in the message, and then wait-to-reply field is added to the message agent before being recorded.       
 
         [0059]    The above procedure can be repeated. In other words, if a message is replied, a message reply control entry can be attached to the reply message, or a reply deadline is set after the original sender has received the reply message, so that the message notice reply method can be used repeatedly to achieve the purpose of replying and completing the delivered job. 
         [0060]    The message notice reply system of the invention is illustrated in details by the following embodiments, such as the message transmitting procedure as shown in  FIG. 4A . 
         [0061]    The invention uses a message agent such as a mail user agent (MUA) in a computer system for transmitting a message. In the beginning, a sender turns on a message agent (Step S 401 ), and uses an editing program to create a message, and inputs the required notice items. (Step S 403 ), and sets one or more recipients (Step S 405 ), and selects a message reply control entry to be attached. In this step, the sender can either select or not to select a recipient reply message. If the sender decides not to select the recipient reply message, then the default setting of not to reply can be adopted (If it is necessary to set a reply message in Step S 407 , the sender has to set the time to reply, and the time to reply can be inputted manually or a predetermined time in a menu can be selected (Step S 409 ), and then transmitted. If the mail user agent (MUA) is used for transmitting the message, then it is necessary to transmit the message to the recipient through an outgoing mail server (such as a MTP server) (Step S 411 ). 
         [0062]      FIG. 4B  shows a flow chart of replying a message by a message notice reply system in accordance with the present invention. After the procedure of the flow chart is operated for receiving a message from the sender, the message agent such as a mail user agent (MUA) in a computer system is used for replying the message. At the beginning, the recipient turns on the message agent (Step S 421 ), and then selects a desired reply message (Step S 423 ) and sends the reply, wherein the related message reply control entry is still attached to the message (Step S 425 ), or after the reply is completed, a reply message is created first (Step S 427 ) and then transmitted (Step S 429 ). 
         [0063]    The aforementioned mail sending and replying processes use the message agent for transmitting the message. When it is necessary to create a desired sending message, the invention further uses an image capturing device, a sound capturing device, a document scanner, or a handwriting device to create the desired sending message as illustrated by in the flow chart of sending an audio/video message by a message notice reply system of the invention as shown in  FIG. 5A . 
         [0064]    The invention transmits a message by the message agent such as a mail user agent (MUA) used by a computer system in accordance with a preferred embodiment of the invention. At the beginning, the sender turns on the message agent (Step S 501 ), and creates a message (Step S 503 ) such as a message containing images and sound produced by an image capturing device and a sound capturing device including a camcorder in addition to a general document (Step S 505 ), and a handwriting description of a handwriting track can be added to a general document or a scanned document (Step S 507 ), and the foregoing images, sound, documents and handwriting description are integrated to produce an audio/video message (Step S 509 ), and the audio/video message in this preferred embodiment is created by the audio/video document method disclosed by R.O.C. Pat. Application No. 93130138 entitled “Network audio/video document facsimile device and synchronous classified filing method” and filed by the inventor of the present invention on Oct. 5, 2004. 
         [0065]    Then, a recipient is set (Step S 511 ), and a message reply control entry is selected to be attached. In this step, the sender can select whether or not to have a recipient reply message (Step S 513 ). If a reply message is required, then the time to reply is set, and the time to reply can be inputted manually or by selecting a preset time on a menu (Step S 515 ), and then transmitted (Step S 517 ). 
         [0066]      FIG. 5B  shows a flow chart of replying an audio/video message by a message notice reply system in accordance with the present invention, the invention not only allows the sender to send an audio/video document, but also allows the recipient to reply by an audio/video document. At the beginning, the recipient turns on a message agent (Step S 521 ), and selects a desired reply message from a message list, (Step S 523 ), and makes a reply by executing a reply function in the message agent (Step S 525 ), and then prepare an image and sound by an image capturing device and a sound capturing device in addition to a general document (Step S 527 ), and records a handwriting track on the general document or scanned document (Step S 529 ), and the foregoing images, sounds, documents and handwriting contents are integrated to produce an audio/video reply message (Step S 531 ). Similarly, and the audio/video message in this preferred embodiment is created by the audio/video document method disclosed by R.O.C. Pat. Application No. 93130138 entitled “Network audio/video document facsimile device and synchronous classified filing method” and filed by the inventor of the present invention on Oct. 5, 2004. After the audio/video reply message is created, the message agent automatically attaches the message reply control entry, and the message agent is used for transmitting the audio/video message (Step S 533 ). 
         [0067]      FIGS. 4A and 5B  show the flow charts of a message notice reply system of the invention from the view point of the users, but the message agent itself actually transmits a message as shown in  FIG. 6 . At the beginning, the message agent connects to an outgoing mail server (first). If the message is transmitted by an e-mail, then it is necessary to connect to an outgoing mail server in compliance with the simple mail transfer protocol (SMTP) (Step S 601 ), and may need to execute an online connection authorization to make sure that the sender has gone through the server authorization (Step S 603 ), and then the message agent attaches a reply control entry to the message, and produces the record of a time to reply set by the sender, such that after the recipient&#39;s message is analyzed by the message agent, a reply reminder field is added to the message agent (Step S 605 ). Then, the completed message is transmitted to the aforementioned outgoing mail server (first), and then transmitted to the recipient end through the server (Step S 607 ). Now, the message agent at the sender end will file a backup copy of the transmitted message, such as a backup copy recorded in the sender&#39;s mail sending area as shown in  FIG. 2A  (Step S 609 ), and then one or more wait-to-reply fields such as those recorded in the sender&#39;s mail receiving area as shown in  FIG. 2A  are added for waiting for a reply from the recipient within a deadline (Step S 611 ). 
         [0068]    In the procedure at the receiving end as shown in  FIG. 7 , a message agent is used for receiving a message, and the message agent connects to an incoming server (second). If the message is transmitted by an e-mail, then the incoming mail server uses a general POP3 or an Internet Message Access Protocol (IMAP) incoming mail server (Step S 701 ) to execute an online connection authorization for performing a user verification (Step S 703 ), and the message is received after the verification (Step S 705 ), and after the message is received to the message agent, the message content is analyzed, and related information including the source and content of the message and whether or not the message reply mechanism such as the time to reply can be learned from the message (Step S 707 ), and then the information in each field of the recipient&#39;s mail receiving area as shown in  FIG. 2B  is filed according to the analyzed message, such that the message is recorded in the message agent (Step S 709 ). Since the required deadline of the reply can be found from the analyzed message, therefore a reply reminder field is added into the recipient&#39;s reply area as shown in  FIG. 2B  (Step S 711 ) for performing a reply reminder at a specific time. 
         [0069]    In the description above, the recipient records the received message in the message agent, and adds the reply reminder field at the same time for executing a reply message procedure to the message agent at the recipient end within a deadline (or after the expiration) as shown in  FIG. 8 . 
         [0070]    The message agent connects to an outgoing mail server (second), wherein the outgoing mail server at the sender end is not necessary to be the same) (Step S 801 ), and executes an online connection authorization. After the recipient end goes through the authorization, the message is transmitted (Step S 803 ), but this step is not a must, and the outgoing mail server can verify the user by other methods or is opened directly to the connected users for transmitting messages. After the online connection authorization is completed, a reply message such as a message reply control entry is attached to notice the original sender that the message is the previous wait-to-reply message (Step S 805 ), and then the reply message is transmitted to the outgoing mail server (Step S 807 ), and the message agent records the reply reminder field automatically (Step S 809 ). 
         [0071]    After the recipient has replied the message, the message agent of the message notice reply system of the invention receives the reply message according to the procedure as shown in  FIG. 9 . The original sender uses the message agent to connect to an incoming mail server (first) wherein the incoming mail server at the recipient end is not necessary the same one such as a POP3 server or an IMAP server (Step S 901 ), and then an online connection authorization is executed (Step S 903 ), and the message is received after going through the verification (Step S 905 ), and the content of the received message is analyzed (Step S 907 ), and the information of the received message (such as the message reply control entry attached to the message) can be known from the message which is a message with a previously set time to reply, and recorded in the corresponding wait to reply field (Step S 909 ). 
         [0072]      FIG. 10  shows a flow chart of a message notice reply system selecting a message creating method in accordance with the present invention. At the beginning, software and hardware for the message notice reply system of the invention are prepared (Step S 101 ), wherein the software includes a message agent, and the hardware includes an audio/video preparing apparatus, a scanner, and a handwriting panel, etc, and the conditions for producing the message include a general transmission ( 11 ), which is a new message. There is a message reply ( 12 ), which is a message replied after the mail is received. There is another way of preparing and sending the message ( 13 ), wherein the already sent message can be sent once again such as forwarding to other recipients, or sending a complement to the recipient. There is another way of preparing a reply again ( 14 ), wherein the already replied message is prepared and replied to the original sender once again. 
         [0073]    The recipient of the message is specified by selecting a recipient from a director as shown in  FIG. 2D  (Step S 103 ), and then a creating method is selected (Step S 105 ), wherein the preferred embodiments include the methods such as “scanned document or retrieved screen+audio/video+handwriting”, “scanned document or retrieved screen”, “text mail”, “audio/video mail”, “audio/video+handwriting mail”, “handwriting mail”, “captured scanned documents+audio/video+handwriting”, “successive retrieved screens+audio/video+handwriting” and “handwriting+audio/video mail”, etc. 
         [0074]    After the creating method is selected, the message is produced step by step (Step S 107 ), and each way of executing the corresponding application program such as an audio/video preparing program, a handwriting interface, a scanned document or retrieved screen program, and integrating the software and hardware to produce an audio/video multimedia or traditional text or a graphic message, and then such message is sent out (Step S 109 ). In the meantime, the message is recorded in the reply field of the sender end or recipient end (Step S 111 ), and the time to reply can be set if required. 
         [0075]    In summation of the description above, the present invention is unlike the general software for transmitting messages. With the aforementioned technical contents, the software can actively divide the processed, non-processed, replied, non-replied messages, so as to achieve the purpose of tracing the progress or schedule of each delivered job. With the procedure of transmitting a message as shown in  FIG. 6 , the procedure of receiving the message as shown in  FIG. 7 , the procedure of replying the message as shown in  FIG. 8 , and the procedure of receiving a replied message as shown in  FIG. 9 , the message notice reply system and its method of the invention can be achieved, wherein the transmitted message includes a text, an audio/video message, a handwriting dynamic description, a graphic file or a scanned document or a retrieved screen, plus audio/video, handwriting, or captured scanned document, audio/video, handwriting, or successive retrieved screens, and audio/video, handwriting, etc. 
         [0076]    Although the present invention has been described with reference to the preferred embodiments thereof, it will be understood that the invention is not limited to the details thereof. Various substitutions and modifications have been suggested in the foregoing description, and others will occur to those of ordinary skill in the art. Therefore, all such substitutions and modifications are intended to be embraced within the scope of the invention as defined in the appended claims.