Communication method and apparatus

Abstract: In order to automatically renew data using a modem which can simultaneously transmit/receive audio and data signal, there is disclosed an apparatus having a modem which can simultaneously transmit/receive audio and data signal (4 in Fig. 2), a discrimination circuit (flow chart in Fig. 5B) for discriminating if a communication partner is a specific partner, and a control CPU (flow charts in Figs. 4A and 4B) for controlling the modem to perform a predetermined data communication together with an audio call on the basis of the discrimination result of the discrimination circuit.

Description: The present invention relates to a communication method and apparatus for performing communications using data transmission means which can simultaneously transmit an audio signal and data. In recent years, owing to the downsizing of computers such as notebook type personal computers and with the advent of electronic stock control and slip process systems using, e.g., POS systems, information in an office can be accessed using a notebook type personal computer or a special-purpose handy terminal via a communication line during sales activity (out) time away from the office. As a result, information acquisition and stock confirmation at a customer site can be easily realized, and a quick response to a customer's need can be attained. An actual sales person connects a notebook type personal computer or handy terminal to a modem (a PCMCIA card or unit) and a portable telephone, and makes a telephone call to a host computer or a personal computer in his or her office so as to exchange data. Furthermore, recently, electronic devices such as pen computers incorporating a portable telephone function are commercially available. These electronic devices can be used for managing personal schedules and address books in addition to original jobs such as sales activities. Since information is electrically processed, when personal information such as a schedule of a particular sales person directly heard from him or her is stored in a notebook type personal computer or a portable electronic device, a third party can access this information to confirm his or her schedule and/or to make an appointment on behalf of this sales person. Furthermore, facsimile (FAX) data which has been conventionally output onto a paper sheet can be read on a display screen or can be easily transmitted using a FAX server or a FAX system using a personal computer. For this reason, in addition to a one-way access in which a sales person at a remote location performs confirmation of a received order or a stock, it is often required to send data from an office to the location of the person so as to renew his or hew personal schedule or to send FAX data to this person. As a background for such requirements, an environment for personal use of electronic devices has been established since high-performance, compact, and low-cost devices have become commercially available, and the area of spread of information has increased due to a widened service area and lower cost of wireless telephones. A conventional modem (a data or FAX modem) modulates data to transmit digital data onto an analog telephone line for transmitting an audio signal. For this reason, when data is transmitted, a normal speech communication is disabled. However, a modem which can simultaneously transmit audio and data signals (data and FAX) by a time-division or double-carrier method when two stations use identical modems has been recently developed. However, not to mention a case wherein a modem which can send only data is used, even when a modem which can simultaneously transmit data and audio signals is used, a user cannot know the state of data transmission while performing a speech communication. Therefore, operability is poor. When a speech communication and a data communication are simultaneously performed for different purposes, the progresses of the two communications often contradict with each other. In addition, not to mention a case wherein a modem which can send only data is used, even when a modem which can simultaneously transmit data and audio signals is used, as described above, a user must perform an operation for sending data while making a speech communication, resulting in poor operability. Furthermore, even when data is renewed in a portable device or a host computer in an office, data is not renewed unless a user makes a telephone call to renew the data. The present invention has been made in consideration of the above situation, and has as a concern object to provide a communication method and apparatus with good operability. US Patent Specification US-A-5036513 discloses a method of and apparatus for simultaneous voice and digital data communication with the digital communication being imperceptible to a user of the audio communication. It is another concern of the present invention to provide a communication method and apparatus which can prevent contradiction between the progress states of audio and data communications even when the audio and data communications are simultaneously performed. According to a first aspect of the present invention, there is provided a communication apparatus as set out in claim 1. According to a second aspect of the invention there is provided a method of controlling a communication apparatus as set out in claim 6. It is still another concern of the present invention to provide an apparatus which has a novel function using data transmission means which can substantially simultaneously transmit audio and data signals. Other advantages and features of the present invention will become apparent from the following description of embodiments of the invention which are described by way of example only with reference to the accompanying drawings. Fig. 1 is a block diagram showing the entire arrangement according to an embodiment of the present invention; Fig. 2 is an internal block diagram of an electronic device according to the embodiment of the present invention; Fig. 3 is a communication diagram of the embodiment of the present invention; Figs. 4A to 4C are flow charts and a table associated with setting of renewal data according to the embodiment of the present invention; Fig. 5A is comprised of Fig. 5A1 and Fig. 5A2 showing flow charts at the transmitting side according to the embodiment of the present invention, and Fig. 5B is a flow chart at the transmitting side according to the embodiment of the present invention; Fig. 6 is comprised of Fig. 6A and Fig. 6B showing flow charts at the receiving side according to the embodiment of the present invention; Fig. 7 is a flow chart showing an interruption routine according to the embodiment of the present invention; Fig. 8 is a diagram showing a dial monitor according to the embodiment of the present invention; Figs. 9A and 9B are respectively a table and a flow chart for discriminating whether or not a communication partner is a specific one; Figs. 10A to 10D are flow charts showing a limit time setting routine and its interruption routine; Fig. 11 is a communication diagram when a communication is broken; Fig. 12 is a flow chart at an audio call requesting side; Fig. 13 is a flow chart at a partner side; Fig. 14 is a communication diagram according to the second embodiment of the present invention; Fig. 15 is a flow chart at an audio call requesting side; Fig. 16 is a data table; Figs. 17A and 17B are flow charts showing an informing operation; Fig. 18 is a plan view showing an example of a display unit as information means; Fig. 19 is a flow chart showing an operation when a break instruction is issued; Fig. 20 is a plan view showing a modification of the display unit as the information means; and Figs. 21A and 21B are flow charts showing a modification of the operation shown in Figs. 17A and 17B. Fig. 1 is a schematic diagram showing a data transmission/reception system via a public line using a communication apparatus according to an embodiment of the present invention. A portable electronic device 1 (a pen computer in Fig. 1) has a wireless telephone function. The telephone function can be used by inputting a number using a soft ten-key pad displayed on the screen or designating a number in an address book displayed on the screen, and an audio signal is exchanged with an operator via a hand set 2. The electronic device may be an existing notebook type personal computer 3 which does not incorporate a wireless telephone function. In this case, a modem 4 is connected to a PCMCIA interface of the electronic device 3. A wireless telephone 5 is a normal one, and is connected to the modem 4 to perform wireless data transmission. The modem 4 as data transmission means of this embodiment can simultaneously transmit audio and data signals. Therefore, in the apparatus of this embodiment, an audio signal is also transmitted via the modem 4. More specifically, audio information is converted into digital data, the digital data is modulated by the modem 4, and the modulated data is output onto a line. A receiving operation is performed in an order opposite to the above-mentioned transmitting operation. These two types of portable electronic devices are used at a remote location. On the other hand, a personal computer or host computer 7 is a machine which is equipped at a fixed place in, e.g., an office and can manage order slips, stock state, and personal schedules. The computer 7 is also connected to a public line via the modem 4. A telephone 6 is a normal one used in ordinary jobs. The public line may be either a wireless line or a wired line. In this embodiment, a case has been exemplified wherein the portable electronic device is used in a remote location. However, the present invention can be applied to, e.g., communications between a desktop machine in a branch office and a host computer in a head office. Fig. 2 is a schematic block diagram showing the arrangement of the portable electronic device 1 or a block A shown in Fig. 1. The arrangements of the device 1 and the block A are substantially the same, except for the types of CPU devices. Referring to Fig. 2, the electronic device 1 or the block A comprises a CPU 8 for controlling the electronic device 1 or the block A, a peripheral I/O 9 connected to CPU peripheral devices (e.g., a memory controller), a RAM 10, a ROM 11, and an input device 12. If the electronic device 1 comprises a pen computer, a digitizer is used as a standard input device; if the electronic device 1 comprises a notebook type personal computer, a keyboard is used as a standard input device. The device 1 or the block A also comprises a display controller (VGA) 13, and a display 14 which may be either a liquid crystal display or a CRT. The device 1 or the block A further comprises a hard disk 15 for storing a large amount of programs and user data, and an interface (called a PCMCIA) 16 for an IC card, which interface is attached to a compact electronic device as standard equipment, and to which the modem 4 is connected. Of course, in place of such a detachable card, the modem 4 may be incorporated in the device. A wireless unit 17 transmits/receives radio waves in accordance with the specifications of a wireless telephone. A line control unit 18 performs line control such as an operation for informing a line connection state to a wireless network via the wireless unit in response to an operation for making a telephone call, i.e., an operation for setting an off-hook state by picking up a hand set. A hook control unit 20 transmits a line connection request or a disconnection request from the CPU to the line control unit 18. In practice, the hand set is set in an off-hook state after the CPU discriminates the overall state. Thus, as will be described later, even when the user sets the hand set in an off-hook state, data transmission is continued. An audio signal generating means 19 generates a pseudo dial tone upon disconnection which indicates the end of an audio call to a communication partner in place of an exchange when one of communication partners who communicate with each other sets the hand set in an on-hook state, and generates a DTMF signal. An I/F 21 such as RJ11 is used for connecting a wired line. Fig. 3 is a diagram showing actual data and audio call sequences in a system disclosed in this embodiment. The transmitting and receiving sides can be either a remote location or an office. In this example, only the transmitting side has data to be renewed. A user at the transmitting side sets an "off-hook" state by picking up the hand set 2 or 2' or using a hook icon (not shown) on the screen. With this operation, a line between the transmitting side and an exchange is opened, and the exchange sends back a dial tone indicating reception of this operation. When the dial tone is confirmed, the electronic device itself automatically dials in accordance with a predetermined software program or the user manually dials. At this time, the CPU 8 in the system monitors the dialing operation, and checks if the dial number coincides with a registered one. The registered dial number is a number of a terminal as a partner having a modem which can simultaneously send audio and data signals. If the coincidence between the two numbers is confirmed, a partner device comprises a modem which can simultaneously send audio and data signals, and devices at two ends of a line may have data to be sent to the other. Therefore, when the partner answers, the two devices exchange data communication packets with each other using the function of the modem which can simultaneously send audio and data signals, and a channel for transmitting data, i.e., a background channel to confirm their IDs (identification information), regardless of the contents of an audio call. When one or both devices have data to be sent, the data is sent as packets in units of data. The receiving side performs an error check operation each time it receives a packet, and returns an ACK signal if no error is detected. When a data communication is started, the start of the data communication is informed to a user. The information means may display a message "in data transmission" or may use a simple means such as an LED (not shown). Data is transmitted from the transmitting side first, and when data transmission has been finished and the receiving side has data to be transmitted, data is transmitted from the receiving side (not shown in Fig. 3). These data exchange operations progress regardless of an audio call, and the progress state of the data exchange operations does not influence an audio call or action of the user. For this reason, as soon as a user finishes an audio call, he or she sets the hand set in the on-hook state or operates the hook icon on the screen to hang up the telephone. However, if the data transmission is being executed, the line control unit 18 keeps the line connected. At the same time, in order to cause one audio call partner to recognize that the other partner hangs up the telephone, the audio signal generating means 19 generates a disconnection tone. At this time, the data is kept transmitted, and after data transmission operations from both the sides are finished, the line is disconnected without troubling a user. Since the line is kept connected, a user may continue an audio call since the charge remains the same. For this reason, a user may talk about another subject if he or she can know the remaining time of the data transmission. Therefore, "remaining time" is displayed in addition to the message "in transmission", so that a user can always know the remaining time. Of course, the remaining time may be displayed upon request of a user. Figs. 4A and 4B are flow charts for realizing the above-mentioned diagram. Figs. 4A and 4B show a sequence executed when data is renewed in a case wherein the system of this embodiment has a schedular function. Fig. 4A shows a case wherein confirmation of a schedule of the owner of the portable device or postulation of an appointment is performed for the personal computer 7 via a communication. Data is received (4-1), and a command is interpreted to determine the contents of the received message (4-2; in this case, confirmation of a schedule (4-3) and postulation of an appointment (4-5) will be exemplified). If the command indicates confirmation of a schedule, schedule data on the personal computer 7 is returned (4-4). On the other hand, if the command indicates postulation of an appointment, and if the schedule has a room, the appointment is registered as temporary data (4-6), and a flag indicating the presence of renewed data is set (4-7). Thereafter, a pointer of an area where the number of appointments in units of renewal data is stored as a table is stored (4-8). Fig. 4B is a flow chart showing a case wherein a user registers or modifies a new schedule in both the personal computer and the portable electronic device. In this case, when new data is input by the portable terminal which executes steps 4-9 and 4-10 at a remote location, and the personal computer registers temporary data, the data in these two devices contradict each other, and must be matched. Fig. 4C shows an example of a renewal data table in the personal computer or the portable electronic device 1. In this case, a table including a number (order of reception), the kind of data (a schedule, FAX, order, or the like), date and hour, the data capacity, the pointer indicating a memory where data is actually stored, and a communication record (communication start or break) is created for one data. The number of data is equal to the number of tables. Figs. 5A1 and 5A2 are flow charts showing a data communication executed parallel to an audio call at the calling party when there is data to be renewed, as shown in Fig. 4C. This flow may be executed by either the personal computer 3 or the portable device 1. As described above, a dialing operation is performed when a user connects a line as in a normal calling operation or designates a partner to be called (5-1). It is checked if the dial number to be called is a registered number (5-2). If the dial number is a number other than the registered numbers, it is determined that only an audio call is made, and no data communication is performed (5-3). When the dial number is a registered number, the modem 4 is permitted to prepare for data transmission (5-4), and the control waits for an answer from the partner (5-5). Although not shown, when the partner is busy or does not answer the telephone call, the user hangs up the hand set to give up a call, and this flow also ends. If the answer from the partner is received, the self ID is transmitted as data in parallel with the audio call (5-6). Then, the control waits for an ID returned from the partner (5-7), and the ID received from the partner is checked (5-8) to discriminate if the received ID is normal (5-9). When the ID is not returned from the partner over a predetermined period of time, or when the ID does not match, the flow advances to step 5-30 to perform only an audio call. In this case, a communication need not be performed via the modem 4. It is then checked if the renewal data flag shown in Fig. 4C is set in the calling party side (5-10). If the renewal data flag is set, data are transmitted as packets in accordance with the storage order in the data tables (5-11). Then, the two terminals exchange data capacities to be transmitted (5-25), and a time required for data transmission is calculated. The data capacity is a sum of a total of the self data tables and the capacity transmitted from the partner. A message "data communication start" is displayed on the display unit, and the remaining communication time is also displayed. Each time a data packet is transmitted, it is checked based on each ACK message returned from the partner if data is normally transmitted (5-12), and normally transmitted data is deleted from the table (5-13). It is checked if all data are transmitted (5-14). If data to be transmitted remain, the flow returns to step 5-11 to transmit the next packet. If all data are transmitted, the flag indicating the presence of data to be renewed is reset (5-15). If there is no data to be transmitted or if all data are transmitted, a message indicating the absence of data is transmitted (5-16), and the control waits for an answer from the partner (5-17). If the partner has data to be transmitted, the data is received (5-18); otherwise, data transmission/reception ends. In step 5-19, an audio call state is checked. If the audio call still continues, an audio call state is set. If the audio call has already been finished, and the hand set is set in the on-hook state, the line is disconnected (5-20). Fig. 17A shows in detail the process in step 5-25 between steps 5-9 and 5-10 in Figs. 5A1 and 5A2. In step 17-1, the sum of the capacities of data to be transmitted of the data tables is calculated. The data indicating the sum of the capacities is transmitted to the partner (17-2), and partner data is received (17-3). Then, the received data is added to the self data capacity (17-4). An actual transmission time is calculated based on the data capacity and the transmission rate, and a time required for a procedure is added by experience to the calculated transmission time, thereby obtaining a required time (17-5). A message "in communication" and the required time are displayed on the display 14. Fig. 17B is a flow chart showing correction of the required time after the time begins to be displayed. Although a one-second interruption is utilized by the system for various purposes, only this portion will be explained below. The display time is decremented by 1 second (17-7), and it is checked if the display time has reached zero second (17-8). If the display time has not reached zero second yet, the flow ends; otherwise, it is further checked if a communication has actually been finished (17-9). If the communication has been finished, the message "in transmission" is turned off (17-10). However, if the communication has not been finished, since a time error has occurred in an actual audio call, the time is set again based on the current communication progress state (17-11). The process for confirming a telephone number in step 5-2 shown in Fig. 5A1 will be described below with reference to Fig. 5B. This process is divided into two modes depending on how to set the telephone number. The first mode corresponds to a case wherein a telephone number is manually input (5-21). In this mode, in the electronic device 1, the telephone number is input by depressing a soft ten-key pad displayed on the display screen with a pen. In a general notebook type personal computer, the telephone number is input by depressing numeric keys on the keyboard or keys on the ten-key pad. Since the keyboard or the ten-key pad is an input device of an electronic device, the depressed number can be recognized in a software manner. The input number is sequentially stored (5-22). In the second mode, a pre-stored number such as a number stored in an address book, telephone book, or abbreviated dial in the electronic device is called using an associated key without directly depressing keys (5-23). At this time, a number to be called is detected as soon as it is designated by a user. The input telephone number is compared with a registered number to be transmitted to check if the two numbers coincide with each other. Note that the presence/absence of, e.g., an area code can be estimated at this time. Figs. 5A1, 5A2 and 5B show the control flow of the device at the calling party side. On the other hand, Figs. 6A and 6B show the control flow of the device at the called party side. Since these flows include basically the same portions, only differences between them will be explained below. The bell of the telephone rings, and someone answers. On the side of the called party, since the calling party is unknown, the controls waits for information data transmitted from the data side (6-3). If no data is received for a predetermined period of time, it is determined that a call is generated by a normal telephone which has no simultaneous communication function of audio data, and thereafter, an audio call is started. On the other hand, if an ID is transmitted and is proper, partner data is received, and then, data on the called party side is transmitted (other detailed operations are the same as those in Figs. 5A1, 5A2 and 5B, and a detailed description thereof will be omitted). Fig. 7 shows an interruption process upon completion of an audio call. When a user clearly indicates his or her intention to end the audio call (e.g., when the user sets the hand set in an on-hook state or designates the hook icon), an interruption is generated, and the flow shown in Fig. 7 is executed. In this service routine, it is checked if data is being transmitted (7-1). If it is determined that data is being transmitted, the line is held, and a disconnection tone is generated so that the partner hears a tone as if the user on this side hangs up the telephone (7-2). It is observed if the partner hangs up the telephone (the partner sets the hand set in the on-hook state) (7-3). If the partner sets the hand set in the on-hook state to end the audio call, tone generation ends (7-4). Even when the partner does not set the hand set in an on-hook state, if data transmission has been finished, the flow branches to step 7-1, and the line is disconnected (7-5). Fig. 18 shows an example of the display screen. In this embodiment, as one of multi-windows, a message "in data transmission" and the required transmission time are displayed. When a user wants to break a communication, he or she can click a "break" icon or touch it with a pen. Fig. 19 shows an operation executed when a break instruction is issued. A break message is transmitted in place of the message "in data transmission" (19-1), and the control waits for an agreement from the partner (19-2). It is checked based on the on/off-hook state of the hand set if an audio call is being performed (19-3). If it is determined that the audio call has ended, the line is disconnected (19-4). Then, a process of data which has been transmitted to the middle of it is executed. It is checked if data or an ACK signal is being transmitted from this side upon the break instruction (19-5). If data or an ACK signal is being transmitted, it is checked if data is being transmitted (19-6). If data is being transmitted, a break message is stored in a communication record of the corresponding data table (19-7), and thereafter, the flow ends. On the other hand, if an ACK signal is being transmitted, the currently received data packet is erased (19-8). At the receiving side, data or an ACK signal is similarly checked (19-9), and the same process is executed (19-10). Furthermore, although the message "in data communication" is informed, when a user temporarily ends an audio call, and indicates an intention to start an audio call again by setting the hand set in an off-hook state, a warning message shown in Fig. 20 is displayed, and the next audio call operation is inhibited from being started. A user can start the next audio call after he or she waits for the end of the data communication or by ending the communication by the break instruction. (Second Embodiment) In the above embodiment, a message display on the display 14 is used as information means to a user. This embodiment will exemplify a case wherein the information means generates audio information using the audio signal generation means 19. Figs. 21A and 21B are flow charts showing a modification of Figs. 17A and 17B, and only differences from Figs. 17A and 17B will be explained below. When data transmission is started (21-6), an audio message "data communication is started, communication time is three minutes" is generated by the audio signal generation means 19 to be superposed on a normal audio call. Alternatively, a user may recognize the start of data communication by generating a predetermined tone of, e.g., a buzzer, a chime, or the like. Upon finishing of communication, an audio message "data communication finished" is generated or a predetermined tone is generated (21-10). When the communication time is corrected (21-11), the corrected time is informed. Furthermore, although the message "in data communication" is informed, when a user temporarily ends an audio call, and indicates an intention to start an audio call again by setting the hand set in an off-hook state, for example, an audio message "in data communication, please wait for one minute" is informed to the user via the hand set. In the above description, visual information and audio information have been exemplified as different embodiments. However, information as a combination of visual information and audio information may be made. As described above, according to this embodiment, if data and an audio signal can be simultaneously transmitted, even when a user makes a telephone call for the purpose of an audio call, data can be automatically renewed without troubling the user, thus improving operability. Furthermore, since the data communication state is informed, an audio call can be effectively made to the end of the data communication time. Furthermore, when the user attempts to start the next audio call before data communication is finished, a warning message is generated, and reliability of data transmission can be improved. In each of the above embodiments, when the modem which can simultaneously transmit audio and data signals is used, and when both the transmitting and receiving sides have data to be renewed, data communication is informed to a user upon exchange of data as a background call of a normal audio call of the user. (First Modification) In each of the above embodiment, as discrimination means for discriminating if a communication partner is a specific one, a number input by depressing push buttons or a soft ten-key pad (telephone screen) as telephone number confirmation means or by registering names is monitored, and is compared and discriminated with abbreviated dials or an address book (telephone book). In this modification, a number can be monitored even when an electronic device which does not have such a telephone function, i.e., the notebook type personal computer 3 in, e.g., Fig. 1, generates a dial signal using an external portable wireless telephone. Fig. 8 shows the arrangement of this modification. In this modification, a DTMF receiver 22 for monitoring a dial signal DTMF output from a portable telephone is added to the modem 4 (PCMCIA card) inserted in the notebook type personal computer 3. The DTMF receiver is a commercially available IC. Upon detection of a DTMF signal, the DTMF receiver generates an INT (interruption signal) and sequentially informs the input number to the system. This signal is stored in step 5-22 in Fig. 5B. For this reason, even when an external telephone is used, whether or not a user is trying to make a telephone call to a registered partner can be discriminated. (Second Modification) In the description of each of the above embodiments, the renewal data table has only one transmission path. However, in some cases, data must be transmitted to terminals corresponding to different kinds of information (e.g., a user must transmit schedule data to his or her own personal computer in a branch office, and must transmit order data to a host computer of the head office). Fig. 9A shows a plurality of data tables in which transmitted sides or data destinations can be respectively set. Each application has a default transmitted side (in this case, a user must transmit schedule data to his or her own personal computer in a branch office). However, the transmitted sides may be individually set by a user. In step 5-11 in Fig. 5A2, as shown in Fig. 9B, it is checked if data in each table coincides with the transmitted side of a telephone number of the current called party (9-1). If a non-coincidence is found, the next table is looked up (9-2); otherwise, data is transmitted (9-3). Thereafter, the flow returns to step 5-11 in Fig. 5A. In this manner, data can be transmitted to any of a plurality of transmitted sides. Furthermore, renewal data presence flags may be formed in correspondence with transmitted sides of renewal data. (Third Modification) In each of the above embodiment, when either one of users calls, renewal data are automatically exchanged as a background call. However, it is preferable that confirmation of a schedule or transmission of urgent facsimile data be performed at given time intervals regardless of a manual telephone call by a user. In this modification, upon renewal of data, a timer set in correspondence with the urgency level of the renewed data is started, and if no telephone call is received after an elapse of a time determined by the timer, a message indicating this is informed to a user or automatic transmission is performed. Figs. 10A to 10D are flow charts showing an operation executed upon renewal of data. The operation shown in Figs. 10A and 10B is substantially the same as that shown in Figs. 4A and 4B. When data is set in a renewal data table, a timer is set in accordance with the kind of the set data (10-9 or 10-13). For example, one hour is set for renewal data of a scheduler and data for registering temporary data, and 20 minutes are set for reception of facsimile data. Note that the time to be set in the timer may be a default value, as described above. However, when a schedule is confirmed using a currently proposed network description language, the renewal limit time may be set and transmitted in a command interpreted in step 10-2. Fig. 10C shows a case wherein warning information is generated for a user by an interruption routine executed when the time limit timer overflows. Prior to the interruption routine, if the power supply of the electronic device is OFF, the power supply is turned on as in an alarm operation. In order to inform the time limit to a user, a message for urging a user to renew data is displayed on the screen of the display 14 together with an audio warning by, e.g., a buzzer (10-14). On this screen, the type of data, the partner to which data is to be transmitted, the telephone number, and the like are displayed. By confirming the intention of the user by displaying a message "OK?" (10-15), the display 14 is turned off (10-16), and the flow ends. Alternatively, if the user clicks the message "OK", an on-hook dial operation of the telephone may be automatically started. Fig. 10D shows an example of automatic renewal. An on-hook dial operation is automatically performed to a transmitted side by the interruption routine (10-17). However, if the user currently uses his or hew own telephone, even when this interruption is generated, a service cannot be immediately started. For this reason, the time is set again, and the flow ends. It is checked based on the calling tone of a partner if the partner answers (10-18). If the partner answers, each device confirms the other (10-19). If the partner can be confirmed (10-20), all data to be renewed in tables are renewed. If the partner does not answer for a predetermined period of time or longer after the calling tone is generated, or if the partner's telephone is busy, a predetermined time is set in the timer, and the flow ends. As described above, in this embodiment, when data is not renewed for a predetermined period of time or longer, a warning message is informed to a user or data is automatically transmitted. For this reason, data can be matched within the predetermined period of time, and information can be transmitted quickly. This modification can be applied regardless of a condition for simultaneously transmitting data and audio signals. As described above, according to this embodiment, if data and an audio signal can be simultaneously transmitted, even when a user makes a telephone call for the purpose of an audio call, data can be automatically renewed without requiring an operation of the user, thus improving operability. Furthermore, since a single line can be used for two purposes, the call charge can be saved. (Fourth Modification) Fig. 11 is a diagram showing a countermeasure taken against a case wherein a user sets the hand set in an off-hook state to make another audio call or operates the hook icon on the screen when an audio call is finished during a data communication in the first embodiment described above. In the modification shown in Fig. 11, renewal data can be transmitted as a background call without troubling a user while the user makes an audio call. In this case, when the user finishes the audio call and wants to start another audio call, the data communication is immediately broken and the line is disconnected to prepare for the next audio call. In order to break data, a break command is transmitted in place of data, and a partner returns a break confirmation message to disconnect the line. Then, an off-hook state is set to allow the next audio call, so that the user can dial. Fig. 11 shows a case wherein the transmitting side is set in an off-hook state during transmission. Of course, if either the transmitting or receiving side starts another audio call, the same operation as described above is performed. Fig. 12 is a flow chart of a device with which a user attempts to start another audio call. Since the user indicates an intention to start an audio call by setting the hand set in an off-hook state or operating the hook icon on the screen, an interruption routine is executed in response to this operation as a trigger. This electronic device checks if a background communication is being executed (12-1). If no background communication is performed, a normal telephone mode (Figs. 5A1, 5A2 and 5B) can be started. If a background communication is being performed, the data communication is temporarily finished to immediately break the data communication, so that the user may not be troubled with an operation in association with the data communication, and a break command is transmitted (12-2). The control waits for a confirmation message returned from a partner (12-3), and thereafter, the line is disconnected (12-4). Then, a process for data which has been transmitted to the middle of it is executed. For example, a process for allowing a re-transmission process later is performed. It is checked if data or an ACK signal is being transmitted from this side upon the break instruction (12-5). If data or an ACK signal is being transmitted, it is checked if data is being transmitted (12-6). If data is being transmitted, a break message is stored in a communication record of the corresponding data table (12-7), and thereafter, the telephone mode is started. If the ACK signal is being transmitted, the currently received data packet is erased (12-8). At the receiving side, data or an ACK signal is similarly checked (12-9). In this case, if data is being transmitted, the data is erased; if an ACK signal is being transmitted, a break message is stored in a communication record of the corresponding data table, and the telephone mode is started. Fig. 13 is a flow chart of the electronic device at the transmitted side. In the case of this interruption, normal data is abnormally terminated (ECC error), and a break command is subsequently received, thus starting a break routine. A break confirmation message is returned (13-1), and the line is disconnected (13-2). Similarly, depending on the transmission/reception state, a process for erasing data or the like is performed so as to prevent an abnormality caused by data which has been received to the middle or a message (13-3 to 13-8). With this operation, the electronic device finishes a communication, and returns to a default state. As described above, in each of the above modifications, when the modem which can simultaneously transmit audio and data signals is used, and when both the transmitting and receiving sides have data to be renewed, the data can be exchanged as a background communication of a normal audio call of the user without any operation of the user. (Fifth Modification) Unlike in the above embodiments, in some cases, it is preferred that data transmission be performed first depending on the urgency or importance of the data. In this modification, when a user attempts to make another audio call before data transmission of specific data set by the user or a specific kind of data (e.g., order data) is finished, a message indicating that important data is being transmitted, and an audio call cannot be immediately started is informed. Fig. 14 is a diagram of this operation. Upon confirmation of a partner, a message indicating whether or not priority data (with a priority flag) is present is added in the current data table. When a user performs an off-hook operation, it is checked if the priority data is being transmitted. If the priority data is being transmitted, an audio message "in data communication" is generated for a user via the hand set, and a visual message is also displayed on the display screen, thus practically inhibiting the user from calling. Although not shown, upon completion of transmission of the priority data, a priority data finish message is added to the end of data. Thus, the presence of priority data can be confirmed at both the sides. In the above embodiments, data are transmitted in the order from data stored earlier (with smaller table numbers). However, in this modification, data are transmitted in the order from those with a priority flag in accordance with the priority flag. Fig. 15 is a flow chart showing an operation executed at this time. In this case, this operation is executed by an interruption according to an off-hook operation. Upon generation of this interruption, it is checked if data is being transmitted (15-1). If data is not transmitted, the telephone mode is set. However, if data is being transmitted, the presence/absence of priority data is checked (15-2). The presence/absence of priority data can be discriminated by checking whether or not all data added with a priority flag in the data table shown in Fig. 16 have already been transmitted to or from a partner. The presence/absence of priority data in the partner device can be checked based on a priority data presence message and a priority data finish message transmitted upon initial confirmation of the partner. Priority data in the table can be set as default data by setting the kind of data (e.g., an order slip) by a user, or can be independently set when, e.g., an urgent meeting is scheduled. When a schedule confirmation command described in the above-mentioned network description language is received from a third party, since the description language can present the importance level, the command is interpreted and a priority flag is set. If the priority data is present, the flow branches from step 15-2 to step 15-12, and an audio warning message "in data transmission" may be generated by synthesizing audio information generated by the audio signal generation means 19, or a warning tone (buzzer) may be generated to call user's attention and a message "in data transmission" may be displayed on the display. Furthermore, the display of the soft dial keys for the telephone mode may be turned off to actually inhibit calling. On the other hand, if no priority data is present, the same process as that described above with reference to Fig. 12 is executed. When transmission of priority data has been finished, the electronic device informs the end of transmission to the user, and permits use of the telephone. More specifically, a message "finish of priority data transmission" or "use of telephone permitted" is displayed to be informed to a user. As described above, according to this modification, if data and an audio signal can be simultaneously transmitted, even when a user makes a telephone call for the purpose of an audio call, data can be automatically renewed without any operation of the user, thus improving operability. Furthermore, since a single line can be used for two purposes, the call charge can be saved. Furthermore, when a user attempts to start the next audio call before transmission of data which is required to be transmitted at an early timing is finished, a warning message is generated, thus improving reliability of data transmission. (Another Embodiment) In the above description, audio information is generated at an arbitrary timing. Furthermore, means for detecting the audio level of audio information on the line is added in the audio signal generation means 19 to discriminate if a user is making an audio call or between words, and control may be made to start an audio message at a timing between words. Furthermore, attention of users may be called by generating a buzzer or chime tone, and when the audio level detection means detects that the audio calls of these users have stopped, an audio message may be started. With these means, an audio message can be generated without disturbing an audio call, and can be reliably transmitted to the users. The audio level detection means monitors an audio line (connected to the hand set) after the modem 4 separates data and audio signals, and detects in an analog manner (comparator) or a digital manner (comparison after A/D conversion) whether or not a sum of transmitted/received levels is equal to or higher than a predetermined level. According to this embodiment, when data and audio signals are simultaneously transmitted/received, a user can recognize a data communication state.

Claims: A communication apparatus comprising: data communication means (1, 2, A) capable of transmitting or receiving audio signals while substantially simultaneously transmitting or receiving data signals via a communication path to a network, characterised by further comprising: discrimination means (8) for discriminating if a new audio call start instruction is generated after an audio call with a specific partner using said data communication means has finished but before communication of data signals has finished; and control means (18) for performing predetermined control of communication path in accordance with the output of said discrimination means. Apparatus according to claim 1, wherein the predetermined control includes the operation of breaking the communication of the data and disconnecting the communication path with the specific partner. Apparatus according to claim 1 , wherein the predetermined control includes the operation of holding the communication path with the specific partner until the communication of the data is finished, and informing a user that a new audio call is impossible to make. Apparatus according to any preceding claim, wherein said data communication means comprises means capable of time divisionally transmitting or receiving said audio and data signals. Apparatus according to any preceding claim, wherein said data communication means comprises means (4, 16) for modulating said audio and data signals with different carrier frequencies. A method of controlling a communication apparatus including data communication means capable of transmitting or receiving audio signals while substantially simultaneously transmitting or receiving data signals via a communication path to a network, and characterised in that said method further comprising the steps of: discriminating if a new audio call start instruction is generated after an audio call with a specific partner by the data communication means has been finished and before a communication of data is finished; and performing predetermined control of the communication path in accordance with a discriminating result of said discrimination step. A method according to claim 6, wherein the predetermined control includes the operation of breaking the communication of the data and disconnecting the communication path from the specific partner. A method according claim 6, wherein the predetermined control includes the operation of holding the line with the specific partner until the communication of the data is finished, and informing a user that a new audio call is impossible to make. A method according to any one of claims 6 to 8, wherein the data communication means comprises means capable of time-divisionally transmitting or receiving said audio and data signals. A method according to any one of claims 6 to 9, wherein said audio and data signals are modulated with different carrier frequencies. A method according to any one of claims 6 to 10 including: discriminating whether or not a communication partner is a specific partner; confirming a presence/absence of renewed data in the communication apparatus; and controlling the data communication means to perform a data communication associated with the renewed data in accordance with a discrimination result of said discrimination step and a confirmation result of said confirmation step.

Inventors: NIWA NOBUYUKI, SHIMADA KAZUTOSHI, SUZUKI YASUTOMO, YAMASHITA YOSHIO, NIWA, NOBUYUKI, SHIMADA, KAZUTOSHI, SUZUKI, YASUTOMO, YAMASHITA, YOSHIO, NIWA, NOBUYUKI, C/O CANON K.K., SHIMADA, KAZUTOSHI, C/O CANON K. K., SUZUKI, YASUTOMO, C/O CANON K.K., YAMASHITA, YOSHIO, C/O CANON K.K.
Applicants: CANON KK, CANON KABUSHIKI KAISHA
Application year: 1994
Main classification: H04M11
IPC codes: H04M11