Image forming system, image forming apparatus, and program

An image forming system includes an image forming apparatus and a communication terminal. The image forming apparatus communicates with the communication terminal and includes an operation panel that displays a first display screen and accepts an operation of inputting information, and a hardware processor. The communication terminal communicates with the image forming apparatus, displays a second display screen, and accepts input of information and includes a central processing unit (CPU) that notifies the input of the information to the image forming apparatus. The communication terminal transmits the information input in the input device to the image forming apparatus, and the hardware processor determines whether the status of the operation panel is a status that accepts the operation, and upon the status of the operation panel being the status that accepts the operation, switches the first display screen to a screen that accepts the operation.

The entire disclosure of Japanese Patent Application No. 2015-224026 filed on Nov. 16, 2015, including the description, claims, drawings, and abstract, is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

Field of the Invention

The present disclosure relates to an image forming system, an image forming apparatus, and a program, and particularly relates to an image forming system to which information to be input into an image forming apparatus is transmitted from a communication terminal, an image forming apparatus that configures such an image forming system, and a program to be executed in the image forming apparatus.

Description of the Related Art

There has conventionally been a technology for displaying a screen that accepts the input of information, such as a screen including a software keyboard, on a display device by computer processing. For example, JP 2015-5911 A discloses an image forming system including an image forming apparatus and a remote control apparatus that remotely controls the image forming apparatus. In the image forming system, the remote control apparatus on which an operation screen is displayed switches the display of a character input screen on the operation screen according to character type information (information indicating the type of an input character on the character input screen) transmitted from the image forming apparatus.

JP 2015-46179 A discloses a display screen control method to be executed in a communication terminal. In the method, the placement of an area to display contents and an area to display an input character string is switched on a touchscreen of the communication terminal according to a users use.

In some known image forming systems, the communication terminal is simply used like a remote keyboard for the image forming apparatus. In such image forming systems, the image forming apparatus cannot accept the input of information such as text unless the image forming apparatus is in a status that accepts the input of the information when the communication terminal transmits the information to the image forming apparatus. Therefore, when transmitting information from the communication terminal to the image forming apparatus, a user of the communication terminal needs to check the operating status of the image forming apparatus and, if the operating status is not one that accepts the information from the communication terminal, operate the image forming apparatus for the purpose of changing the operating status. Therefore, the user is required to perform complicated operations.

SUMMARY OF THE INVENTION

One or more embodiments of the present invention allow a user to avoid complicated operations upon transmitting, from a communication terminal, information to be input into an image forming apparatus.

An image forming system according to one or more embodiments comprises an image forming apparatus; and a communication terminal, wherein the image forming apparatus includes a first communication unit configured to communicate with the communication terminal, an operating unit configured to display a first display screen and accept an operation of inputting information in accordance with the first display screen, and a hardware processor configured to control operation of the operating unit, the communication terminal includes a second communication unit configured to communicate with the image forming apparatus, an input unit configured to display a second display screen and accept input of information to be input into the image forming apparatus in accordance with the second display screen, and a notification unit configured to notify the input of the information to the image forming apparatus in response to the input of the information into the input unit, the second communication unit transmits the information input in the input unit to the image forming apparatus, and the hardware processor is configured to determine whether the status of the operating unit is a status that accepts the operation of inputting the information in response to the notification from the notification unit, and upon the status of the operating unit being the status that accepts the operation of inputting the information, switch the first display screen of the operating unit to a screen that accepts the operation of inputting the information.

An image forming apparatus according to one or more embodiments communicates with a communication terminal and comprises an operating unit configured to display a first display screen and accept an operation of inputting information in accordance with the first display screen; a hardware processor configured to control operation of the operating unit; and a communication unit configured to receive, from the communication terminal, a notification indicating that information to be input into the image forming apparatus is being input in accordance with a second display screen displayed on the communication terminal, wherein the hardware processor is configured to determine whether the operating unit is in a status that accepts the operation of inputting the information in response to the notification from the communication terminal, and upon the operating unit being in a status that does not accept the operation of input ting the information, switch the first display screen of the operating unit to a screen that accepts the operation of inputting the information.

A non-transitory recording medium according to one or more embodiments that stores a computer readable program to be executed by a hardware processor of an image forming apparatus capable of communicating with a communication terminal comprises the image forming apparatus, wherein the image forming apparatus includes an operating unit configured to accept an operation of inputting information, and the program causes the hardware processor to execute displaying a first display screen on the operating unit, receiving, from the communication terminal, a notification indicating that the information to be input into the image forming apparatus is being input in accordance with a second display screen displayed on the communication terminal, determining whether the operating unit is in a status that accepts the operation of inputting the information in response to the notification from the communication terminal, and upon the operating unit being in a status that does not accept the operation of inputting the information, switching the first display screen of the operating unit to a screen that accepts the operation of inputting the information.

DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments of an information processing apparatus will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples. In the following description, the same reference numerals are assigned to the same components and constituent elements. Their names and functions are also the same. Therefore, their descriptions are not repeated.

<1. Overview of the Disclosure>

FIG. 1is a diagram schematically illustrating a first example of an image forming system according to one or more embodiments. As illustrated inFIG. 1, an image forming system1includes an MFP100being an example of an image forming apparatus, and a communication terminal400. The communication terminal400is realized by an information communication terminal such as a smartphone.

The MFP100includes an operation panel300. The operation panel300includes a touchscreen (a touchscreen320inFIG. 4and the like described below) that accepts an operation of inputting characters and the like.

The communication terminal400functions as a remote input device of the touchscreen of the MFP100. In other words, a user can transmit information (such as characters) input on a display screen of the touchscreen of the MFP100from the communication terminal400to the MFP100.

An example of the display screen (a screen401) of the communication terminal400includes a window411having an address input field412, an information input field413, and a send button414. When the user makes a transmission with the send button415, the communication terminal400transmits, to the MFP100, information input in the information input field413.

When having received the information, the MFP100inputs the received information on the display screen on the touchscreen.

(Operation of when Status of Touchscreen of MFP does not Accept Input from Communication Terminal)

FIG. 1illustrates a screen510as an example of a screen displayed on the touchscreen of the operation panel300of the MFP100. The screen510is a screen for settings for an image forming operation in the MFP100, and is not a screen for accepting the input of information (such as characters) transmitted from the communication terminal400.

The communication terminal400notifies the MFP100that information is being input, during the input of the information into the information input field413. In response to this, the MFP100determines whether the operating status of the operation panel300permits the input of the information intended to be transmitted from the communication terminal400. When the operating status of the operation panel300does not permit the input of the information, the MFP100switches the operating status of the operation panel300to one that permits the input of the information.

InFIG. 1, the screen displayed on the touchscreen of the operation panel300is switched from the screen510to a screen520. The screen520includes a window521. The window521includes an input field522for inputting the information input in the information input field413.

The window521includes a software keyboard523. In the MFP100, information can be input into the input field522also by operating the input field522. Furthermore, the information input in the input field522can be corrected by an operation on the software keyboard523.

<2. Overview of Process>

FIG. 2is a diagram illustrating an overview of a process to be executed between the communication terminal400and the MFP100in the image forming system according to the first example. As illustrated inFIG. 2, the communication terminal400activates an application (hereinafter referred to as “app”) for displaying the window including the information input field413, based on an operation by a user PA (“APP ACTIVATION” inFIG. 2). For example, a CPU401executes an application program stored in a storage device403to implement the application. The program may be stored in a recording medium detachable from the communication terminal400, or may be stored in a storage device on a network.

The app selects an MFP being a transmission destination (“MFP SELECTION” inFIG. 2). In an example of the selection of an MFP being a transmission destination, the app reads out an address of an MFP being the previous information transmission destination. In other words, the app selects, as the transmission destination, an MFP identified from the address read out in another example, the app accepts the input of characters into the address input field412. In other words, the app selects, as the transmission destination, an MFP identified from the input characters. Furthermore, in another example, the app acquires an IP (Internet Protocol) address of an MFP by WiFi (registered trademark: Wireless Fidelity) communication or the like. In other words, the app selects, as the transmission destination, an MFP identified from the acquired IP address. When addresses of two or more MFPs are acquired through WiFi communication or the like, an IP address of one MFP selected by the user from the two or more MFPs may be selected.

Next, the app accepts the input of characters to be transmitted to the MFP (“TRANSMISSION CHARACTER INPUT” inFIG. 2). The characters are input by the user PA operating a touchscreen of the communication terminal400. The app establishes a connection between the communication terminal400and the MFP100selected as described above in response the input of the characters (“CONNECTION ESTABLISHMENT” inFIG. 2).

When the connection to the MFP has been established, the app notifies the MFP100that the Information is being input into the information input field413(“INPUT-IN-PROGRESS NOTIFICATION” inFIG. 2).

When having received the notification from the communication terminal400, the MFP100executes a determination about the operating status of the operation panel300as described above (“STATUS DETERMINATION” inFIG. 2).

If having determined that the status of the operation panel300is a status that accepts the input of the information input in the information input field413of the communication terminal400, the MFP100stands by without any further processing. On the other hand, if having determined that the status of the operation panel300is a status that cannot accept the input of the information input in the information input field413, the status of the operation panel300is switched (“SWITCHING OF OPERATION SCREEN” inFIG. 2). Consequently, as described with reference toFIG. 1, the display on the touchscreen of the operation panel300is switched from the screen510to the screen520.

When the send button414is operated (“TRANSMISSION INSTRUCTION” inFIG. 2) afterward, the app of the communication terminal400transmits the information input in the information input field413to the MFP100.

When having received the information from the communication terminal400, the MFP100inputs the received information on the screen displayed on the operation panel300(“CHARACTER INPUT” inFIG. 2).

<3. External Appearance of MFP)

FIG. 3is a perspective view illustrating the entire configuration of the MFP100.

As illustrated inFIG. 3, the MFP100includes an image reading unit2that optically reads an original and obtains image data, and an image forming unit6that prints an image on a sheet of paper based on the image data. A feeder4that transmits the original to the image reading unit2is placed on a top surface of a main body of the MFP100. A plurality of paper feeding units9that feeds a printing sheet to the image forming unit6is placed in a lower part of the MFP100. A tray5into which the printing sheet on which the image has been formed by the image forming unit6is ejected is placed in a middle part of the MFP100.

The operation panel300is mounted on a front side of an upper part of the main body of the MFP100. The operation panel300is installed on the main body of the MFP100in a rotatable manner about a hinge300A.

<4. External Appearance of Operation Panel>

FIG. 4is a diagram illustrating the external appearance of the operation panel300. The operation panel300includes the touchscreen320and hard keys330. The touchscreen320displays information thereon and accepts an information input operation. The touchscreen320can employ a touchscreen of any type such as a resistive type and a capacitive type.

<5. Hardware Configuration of MFP>

FIG. 5is a block diagram illustrating the configuration of the MFP100. As illustrated inFIG. 5, the MFP100includes a system controller601, a memory602, a network interface (I/F)603, a printer engine604, an output image processing unit605, a storage device606, an imaging unit607, an input image processing unit603, the operation panel300, and a power supply unit609. The system controller601is connected, via, for example, an internal bus, to the memory602, the network I/F603, the printer engine604, the output image processing unit605, the storage device606, the imaging unit607, the input image processing unit603, and the operation panel300.

Electric power is supplied from an external power source to the power supply unit609. The system controller601controls the supply of power from the power supply unit609to the elements of the MFP100. For example, when a power button on the operation panel300has been operated, the system controller601starts supplying power from the power supply unit609to the elements of the MFP100. For example, when the power button on the operation panel300has been operated again, the system controller601stops the supply of power from the power supply unit609to the elements of the MFP100.

The system controller601controls the entire MFP100over various jobs such as a scan job, a copy job, an email sending job, and a print job. The system controller601includes a CPU (Central. Processing Unit)621and a ROM (Read Only Memory)622.

The CPU621executes a control program stored in the ROM622. Various programs for control over the operation of the MFP100and various kinds of fixed data are stored in the ROM622. The CPU621reads data from the memory602and writes data into the memory602.

The memory602is, for example, a RAN (Random Access Memory), and is used for, for example, temporary storage of data necessary for the CPU621to execute the control program, and image data.

The network I/F603communicates with external devices (including the communication terminal403) via a network in accordance with an instruction of the system controller601. The network I/F603is used for, for example, communication in compliance with a standard such as Bluetooth (registered trademark). Communication between the network I/F603and an external device is performed in, for example, a wireless LAN (Local Area Network). One example of the network I/F603is an interface of a wired LAN mainly used for communication with a server and/or a PC (personal computer). Another example of the network I/F603is an interface of a wireless LAN (for example, a communication network in compliance with the IEEE 802.11 standard) mainly used for communication with a mobile terminal and/or a PC.

The printer engine604performs a printing process on a sheet and the like based on print data processed by the output image processing unit605. Especially, when the MFP100operates as a printer, the printer engine604prints an image. When the MFP100operates as a copier, the printer engine604prints an image read by the imaging unit607.

For example, upon printing of an image, the output image processing unit605executes a conversion process for converting a data format of the image to a data format for printing.

The storage device606is, for example, an HDD (Hard Disk Drive). Various kinds of data related to the operation of the MFP100, and the like are stored in the storage device606. Furthermore, image data of screens to be displayed on the operation panel300of the MFP100may be stored in the storage device606.

The imaging unit607reads an image of an original and outputs it to the input image processing unit608.

In, for example, a case where the imaging unit607reads an image, the input image processing unit608performs a conversion process of converting to a format of the image data.

In the MFP100, the CPU621executes an appropriate program to implement such operation of the MFP100described in the specification. Programs to be executed by the CPU621may be stored in the ROM622as described above, may be stored in the storage device606, or may be stored in a storage medium detachable from the MFP100. The storage medium in which the programs are stored is a medium in which data is stored in a nonvolatile manner, such as a CD-ROM (Compact Disc-Read Only Memory), a DVD-ROM (Digital Versatile Disk-Read Only Memory), a USB (Universal Serial Bus) memory, a memory card, an FD (Flexible Disk), a hard disk, an SSD (Solid State Drive), a magnetic tape, a cassette tape, an MO (Magnetic Optical Disc), an MD (Mini Disc), an IC (Integrated Circuit) card (excluding a memory card), an optical card, a mask ROM, an EPROM, and an EEPROM (Electronically Erasable Programmable Read-Only Memory).

The program according to the present disclosure may be one that calls a necessary module in a predetermined array at a predetermined timing from program modules provided as part of an operating system (OS) of a computer and executes a process. In this case, the program itself does not include the modules. The process is executed in cooperation with the OS. Such a program without modules can be included in the program according to the present disclosure.

The program according to the present disclosure may be provided incorporated in part of another program. Also in this case, the program itself does not include modules included in the other program. A process is executed in cooperation with the other program. Such a program incorporated in another program can also be included in the program according to the present disclosure.

A program product to be provided is installed in a program storage unit such as a hard disk to be executed. The program product includes the program itself and a recording medium in which the program is recorded.

<6. Configuration of Operation Panel>

FIG. 6is a block diagram illustrating the configuration of the operation panel300of the MFP100. The operation panel300includes a panel CPU101, a ROM102, a RAM103, an LCD (Liquid Crystal Display) control unit104, a VRAM (Video RAM)105, and an input/output control unit111, in addition to the touchscreen320and the hard keys330, which are described with reference toFIG. 4and the like.

The panel CPU101controls the entire operation panel300, and communicates with the system controller601(seeFIG. 5) on the main body side of the MFP100.

A program for controlling the operation of the operation panel300, and images to be displayed on the touchscreen320are stored in the ROM102. The RAM103is work memory of the panel CPU101.

The LCD control unit104controls the display of a display (for example, a liquid crystal display device) included in the touchscreen320. The LCD control unit104controls read and write of the VRAM105. An image stored in the ROM102is stored by the panel CPU101in the VRAM105via the LCD control unit104, and then read out to be output to the touchscreen320.

The touchscreen320includes the display and a touch sensor. The touchscreen320identifies a touch position (or a position at which a conductor has been brought into intimate contact) on the touch sensor, and outputs the identified position to the input/output control unit111.

The input/output control unit111identifies an item (such as a menu or a function) selected by a touch operation based on display contents on the display and the touch position output from the touchscreen320, and outputs the item to the panel CPU101. The input/output control unit111can also be realized as one function of the same processor as a processor configuring the panel CPU101.

The hard keys330include various keys such as a start key, numeric keys, and a panel reset key.

The operation panel300may include various elements such as an LED (Light Emitting Diode) that indicates the status of the MFP100and a buzzer for notification or the like, in addition to the above elements.

Input operations on the hard keys330and the touchscreen320are transmitted to the system controller601via the input/output control unit111and the panel CPU101if necessary. Consequently, the main body of the MFP100operates based on the input operation on the operation panel300. For example, when the start key of the hard keys330is pressed, information indicating that the start key has been pressed is communicated to the system controller601of the main body of the MFP100via the hard key330, the input/output control unit111, and the panel CPU101to start a series of copy operations.

<7. Configuration of Communication Terminal>

FIG. 7is a block diagram illustrating the hardware configuration of the communication terminal400. As illustrated inFIG. 7, the communication terminal400includes, as main constituent elements, the CPU401, a RAM402, the storage device403, a display404, an input device405, and a network I/F406. The CPU401, the RAM402, the storage device403, the display404, the input device405, and the network I/F406are connected to each other by an internal bus.

The CPU401is an example of an arithmetic unit that executes a process for controlling the entire operation of the communication terminal400.

The RAM402functions as a work area upon execution of a process of the CPU401.

Data of various programs such as an OS (Operating System) program or an application program that is executed by the CPU401, and data used to execute these programs are saved in the storage device403. Examples of the storage device403include a medium in which data is stored in a nonvolatile manner, such as an EEPROM. A program downloaded via a network may be installed in the storage device403. The CPU401may execute a program recorded in a recording medium detachable from a main body of the communication terminal400and/or a program recorded in a storage medium on the network to implement a function described in the specification.

The display404is a display device for displaying an image illustrating the process result of a program executed by the CPU401.

The input device405is an example of an input device for inputting information into the communication terminal400, such as the input of an instruction on the process of an application being executed. Another example of an input device included in the communication terminal400is a touch sensor provided on the display404.

The network I/F406communicates with an external device such as the MFP100in compliance with a standard such as Bluetooth.

FIG. 8is a diagram illustrating the functional configurations of the MFP100and the communication terminal400according to the first example.

As illustrated inFIG. 8, the MFP100includes an operating unit151, a control unit152, and a process execution unit153. The operating unit151includes the operation panel300(FIG. 5and the like), and accepts an information input operation of the user. The control unit152includes the panel CPU101and controls the operation of the operating unit151.

The communication terminal400includes an input unit451, a transmission and receiving unit452, and a notification unit453. The input unit451includes the input device405(FIG. 7and the like) and accepts the input of various kinds of information such as information input into the information input field413. The transmission and receiving unit452includes the network I/F406, and transmits and receives information to and from an external device such as the MFP100. The notification unit453includes the CPU401and executes operations including notification to the MFP100.

<9. Flow of Process>

FIG. 9is a flowchart of an example of a process to be executed in the MFP100. The process ofFIG. 9is executed by, for example, the system controller601.

As illustrated inFIG. 9, in step S100, the system controller601determines whether a communication in accordance with a request of the app of the communication terminal400(“TERMINAL APP” inFIG. 9the application for displaying the window including the information input field413) has been established. If it has been determined that the communication has not been established, the process ofFIG. 9ends. On the other hand, if it has been determined that the communication has been established, the control proceeds to step S200.

In step S200, the system controller601determines whether the input of characters has been started in the app. When the input of information into the information input field413(FIG. 1) has been started in the communication terminal400, the app notifies the input of the information to the MFP100. In step S200, the system controller601determines whether to have received the notification from the app. The control remains in step S200until the receipt of the notification. When the notification has been received, the control proceeds to step S300.

In step S300, the system controller601determines whether the operation panel300is in the status that can accept the input of the information input in the information input field413. More specifically, the system controller601determines whether the screen displayed on the touchscreen320is a screen like the screen520ofFIG. 1. If having determined that the information can be input (a screen like the screen520is being displayed), the system controller601ends the process ofFIG. 9. On the other hand, if having determined that the information cannot be input (the screen being displayed is not a screen like the screen520), the system controller601advances the control to step S400.

In this example, according to step S300, the system controller601determines whether the operating unit (the operation panel300) of the image forming apparatus is in a status that accepts an information input operation based on whether the display screen of the operation panel300is the screen that accepts the input of the information input into the information input field413.

The system controller601may inquire of the panel CPU101about the status of the touchscreen320to execute the determination of step S300.

In step S400, the system controller601switches the display of the touchscreen320to the screen that can accept the input of the information from the communication terminal400(for example, the screen520ofFIG. 1) and ends the process ofFIG. 9.

When the send button414(FIG. 1) is operated afterward, the communication terminal400transmits the information input in the information input field413to the MFP100. In response to this, the system controller601receives the information to pass it to the panel CPU101. When having received the information, panel CPU101inputs the information on the screen being displayed on the touchscreen320(for example, the input field522of the screen521).

As described above, when having accepted, in the information input field413, the input of the information to be input into the input field522of the MFP100, the app on the communication terminal400notifies it to the MFP100. The notification may be issued in response to the start of the input into the information input field413, may be issued in response to the input of characters equal to or greater than a predetermined number in the information input field413, or may be issued in response to the lapse of a predetermined time since the start of input into the information input field413.

In response to the notification from the communication terminal400, the MFP100determines whether the touchscreen320is displaying the screen that accepts the input of the information. If the touchscreen320is not displaying such a screen that accepts the input of the information, the MFP100switches the status of the touchscreen320to a status that displays such a screen.

In an image forming system according to a second example, each of the MFP100and the communication terminal400includes a user authentication function. When having received the notification from the communication terminal400, the MFP100switches the display screen of the touchscreen320on condition that the user operating the communication terminal400is the same as a user who has logged in to the MFP100.

FIG. 10is a diagram illustrating the functional configurations of the MFP100and the communication terminal400according to the second example.

As compared toFIG. 8, the MFP100further includes an authentication unit154for authenticating a user who logs in to the MFP100. For example, the system controller601executes a user authentication process to realize the authentication unit154.

The communication terminal400further includes an authentication unit454for authenticating a user who logs in to the communication terminal400. For example, the CPU401executes a user authentication process to realize the authentication unit454.

FIG. 11is a flowchart illustrating a part of a process to be executed in the MFP100.

In step S300ofFIG. 9of the first example, if the system controller601determines that the operation panel300is in the status that does not accept the input of the information input in the information input field413, the control proceeds to step S302ofFIG. 11.

In step S302, the system controller601acquires information that identifies a logged-in user of the communication terminal400from the app on the communication terminal400. The control proceeds to step S304.

In step S304, the system controller601determines whether the logged-in user of the communication terminal400acquired in step S302is the same as a user who has logged in to the MFP100. If having determined that both users are the same, the system controller601advances the control to step S400. On the other hand, if having determined that both users are different, the system controller601ends the process ofFIG. 11without any further processing.

In step S400, the system controller601switches the display of the touchscreen320to the screen that can accept the input of the information from the communication terminal400, and ends the process ofFIG. 11.

As described above, the MFP100switches the display of the touchscreen320on condition that the logged-in user of the communication terminal400and the logged-in user of the MFP100are the same. On the other hand, if both users are different, the switching of the screen described with reference toFIG. 1is not performed. Consequently, the user who is different from the user operating the communication terminal400operates the MFP100. Consequently, the switching of the screen of the MFP100can be avoided when it is not preferable to switch the display screen of the MFP100by an operation on the communication terminal400.

In a third embodiment, if an operation on the operation panel300is performed after a connection to the communication terminal400is established, the MFP100notifies it to the communication terminal400. When having received the notification, the app on the communication terminal400does not issue a notification in response to the input into the information input field413(“INPUT-IN-PROGRESS NOTIFICATION” ofFIG. 2).

FIG. 12is a diagram illustrating an overview of a process to be executed between the communication terminal400and the MFP100in an image forming system according to the third example. As illustrated inFIG. 12, after a communication between the communication terminal400and the MFP100is established (“CONNECTION ESTABLISHMENT” inFIG. 12), the MFP100determines whether an operation is performed on the operation panel300. “Operation” in this case includes an operation on the touchscreen320and an operation on the hard key330. If having subsequently determined that there has been an operation on the operation panel300(“OPERATION ACCEPTANCE” inFIG. 12), the MFP100notifies it to the communication terminal400(“OPERATION PRESENCE NOTIFICATION” inFIG. 12). The “operation presence notification” is an example of a notification that the operating unit (the operation panel300) is accepting input in the embodiment.

When having received the “operation presence notification,” the app on the communication terminal400continues accepting the input into the information input field413but does not issue the “input-in-progress notification” inFIG. 2.

When having accepted an operation on the send button414afterward (“TRANSMISSION INSTRUCTION” inFIG. 12), the app on the communication terminal400transmits the information input in the information input field413to the MFP100(“CHARACTER TRANSMISSION” inFIG. 12).

When having received the information by “character transmission,” the MFP100accepts the input of the information if the screen being displayed on the touchscreen320is the screen that accepts the input of the information (for example, the screen520ofFIG. 1). On the other hand, if the screen being displayed on the touchscreen320is the screen that does not accept the input of the information (for example, the screen510ofFIG. 1), the MFP100discards the information.

FIG. 13is a flowchart of a process to be executed by the app (the CPU401) of the communication terminal400according to the third example. As illustrated inFIG. 13, in step S500, the app determines whether the input of characters into the information input field413(FIG. 1) has been started. If it has been determined that the input has not yet been started, the process ofFIG. 13ends. On the other hand, if it has been determined that the input has been started, the control proceeds to step S510.

In step S510, the app acquires the operating status of the MPF100specified in the address input field412(FIG. 1). More specifically, the app identifies the status of the MFP100based, for example, on whether to have received the “operation presence notification” ofFIG. 12from the MFP100. If the “operation presence notification” has been received, it is identified that the MFP100is being operated. If the “operation presence notification” has not been received, it is identified that the MFP100is not being operated. The control then proceeds to step S520.

In step S520, the app determines whether the statue of the MFP100acquired in step S510is during operation. If it has been determined that the status is during operation, the control proceeds to step S540. On the other hand, if it has been determined that the status is not during operation, the control proceeds to step S530.

Step S520is executed at a specific timing after the start of the input of the information into the information input field413is detected. An example of the specific timing is immediately after the start of the input. Another example is after the lapse of a certain period of time since the start of the input. Still another example is at the time when the input of a specific amount of information is complete during the input. For example, if the information input field413accents the input of a 12-digit IP address, the input of the specific amount of information indicates that the input of up to the ninth digit is completed. Still another example is at the time when specific information is input. For example, if the information input field413accepts the input of an email address, the specific information is a character “@” located in the middle of the email address.

In step S530, the app notifies the “input-in-progress notification” (FIG. 2) to the MFP100. The control then proceeds to step S540.

In step S540, the app accepts an operation on the send button414and, if there is the operation, transmits the information input in the information input field413to the MFP100. Consequently, the process ofFIG. 13ends.

As described above, when information is input into the information input field413in the communication terminal400, if the MFP100accepts an operation on the operation panel300, the communication terminal400does not issue the “input-in-progress notification.” That the MFP100has accepted the operation on the operation panel300during the input of the information into the information input field413may include a possibility that the MFP100is being operated by a user who is different from the user of the communication terminal400. Therefore, it is possible to avoid an event where the display screen of the MFP100is switched if there is the possibility that the MFP100is being operated by a user who is different from the user of the communication terminal400.

When the send button414is operated from the communication terminal400to the MFP100, if the display screen of the MFP100is a screen where the information input in the information input field413can be input, the information is input into the MFP100.

The MFP100according to a fourth example further notifies that the operation panel300is no longer being operated as compared to the MFP100according to the third example,FIG. 14is a diagram illustrating an overview of a process to be executed between the communication terminal400and the MFP100in an image forming system according to the fourth example.

As illustrated, inFIG. 14, if after a connection to the communication terminal400is established, the MFP100issues the “operation presence notification” and then a state where the operation panel300is not operated continues for a certain period of time (for example, one minute), the MFP100notifies that there is no operation on the operation panel300(“OPERATION ABSENCE, NOTIFICATION” inFIG. 14). In the embodiment, the “operation absence notification” is an example of the notification that the operating unit (the operation panel300) is not accepting input.

The communication terminal400issues the “operation-in-progress notification” to the MFP100in response to the receipt of the “operation absence notification,”. In response to this, if the display screen of the touchscreen320is the screen that does not accept the input of the information input in the information input field413, the MFP100switches the display screen of the touchscreen320to the one that accepts the input of the information. (“SWITCHING OF OPERATION SCREEN” inFIG. 14).

FIG. 15is a flowchart of a process to be executed by an app (the CPU401) of the communication terminal400according to the forth embodiment. In the process ofFIG. 15, if it has been determined in step S520that the MFP100is being operated, the control proceeds to step S522.

In step S522, the app determines whether the operation on the operation panel300of the MFP100has been finished. If receiving the “operation absence notification” ofFIG. 14, for example, before the lapse of a predetermined time (for example, two minutes) since the execution of step S520, the app determines that the operation on the operation panel300has been finished. If not having received the “operation absence notification” ofFIG. 14before the lapse of the predetermined time (for example, two minutes) since the execution of step S520, the app determines that the operation on the operation panel300has not been finished. If it has been determined in step S522that the operation on the operation panel300of the MFP100has been finished, the control proceeds to step S530. If it has been determined in step S522that the operation on the operation panel300of the MFP100has not been finished, the control proceeds to step S540.

In step S530, the app issues the “input-in-progress notification” to the MFP100. The control then proceeds to step S540.

In step S540, the app transmits the information input in the information input field413to the MFP100in response to an operation on the send button414.

As described above, when another user's operation on the MFP100is finished, the screen is switched in the MFP100. Also when the user of the communication terminal400operates the MFP100while operating the communication terminal400, in other words, also when the “operation presence notification” is issued by the operation by the user of the communication terminal400, the screen can be switched in the MFP100.

In a fifth example, when the screen of the touchscreen320is switched in the MFP100in response to the “input-in-progress notification” (FIG. 2and the like) from the communication terminal400, the MFP100decides to which screen the display of the touchscreen320is switched, in accordance with the type of information transmitted from the communication terminal400. The type of information may be identified by the app of the communication terminal400, or may be identified by the MFP100.

Prior to the decision about a screen to be switched, the type of the information input in the information input field413is identified. The type may be identified by the app on the communication terminal400accepting the input of information, for identifying the type, or may be identified by pattern recognition of the input information.FIG. 16is a flowchart of an example of a process for identifying the type of input information by pattern recognition.

In step S900, the app executes pattern recognition on the characters input in the information input field413. The control then proceeds to step S902.

In step S902, the app determines whether the characters input in the information input field413has a characteristic of a “personal name” as a result of the pattern recognition of step S900. The app advances the control to the step S904, for example, if a first predetermined number of characters input in the information input field413match a predetermined number of characters of one or more groups of character strings registered as personal names. In this case, the predetermined number of characters input in the information input field413has the characteristic of a “personal name.” For example, if characters “suzuki” are input into the information input field413, and a character string “suzuki” is registered as a “personal name,” the input characters “suzuki” match the registered character string “suzuki” so that the input characters “suzuki” are determined to have the characteristic of a “personal name.”

On the other hand, the app advances the control to step S906if the predetermined number of characters input in the information input field413do not match any of the one or more groups of character strings registered as personal names. In this case, the predetermined number of characters input in the information input field413does not have the characteristic of a “personal name.”

In step S904, the app identifies the information input in the information input field413as a “personal name,” notifies it to the MFP100, and ends the process ofFIG. 16.

In step S906, the app determines whether the predetermined number of characters has a characteristic of a “fax number” as a result of the pattern recognition of step S900. The app advances the control to step S908, for example, if the character string input in the information input field413has the characteristic of a fax number (for example, the character string is a character string including only numerals, and the first character is “0”). On the other hand, the app advances the control to step S910if the predetermined number of characters input in the information input field413do not have the characteristic of a fax number.

In step S908, the app identifies that the information input in the information input field413as a “fax number,” notifies it to the MFP100, and ends the process ofFIG. 16.

In step S910, the app determines whether the predetermined number of characters have a characteristic of an “email address” as a result of the pattern recognition of step S900. The app advances the control to step S912, for example, if the character string input in the information input field413has the characteristic of an email address (for example, the character string includes the character “@” at the second character or later). On the other hand, the app advances the control to step S914if the predetermined number of characters input in the information input field413do not have the character of an email address.

In step S912, the app identifies the information input in the information input field413as an “email address,” notifies it to the MFP100, and ends the process ofFIG. 13.

In step S914, the app determines whether the predetermined number of characters have a characteristic of a “URL” as a result of the pattern recognition of step S900. The app advances the control to step S916, for example, if the character string input in the information input field413has the characteristic of a URL (for example, the character string begins with a character string “http/” or a character string “FTP://”)/. On the other hand, the app advances the control to step S918if the predetermined number of characters input in the information input field413do not have the characteristic of a URL.

In step S916, the app identifies the information input in the information input field413as a “URL,” notifies it to the MFP100, and ends the process ofFIG. 16.

In step S918, the app determines whether the predetermined number of characters have a characteristic of text as a result of the pattern recognition of step S900. The app advances the control to step S920, for example, if the character string input in the information input field413has the characteristic of text (for example, the character string begins with a specific character string “I hope this email finds you well”). On the other hand, the app advances the control to step S922if the predetermined number of characters input in the information input field413do not have the characteristic of text.

In step S920, the app identifies the information input in the information input field413as “text,” notifies it to the MFP100, and ends the process ofFIG. 16.

In step S918, the app determines whether the predetermined number of characters have a characteristic of a “box name” as a result of the pattern recognition of step S900. “Box name” is a name that identifies each of one or more storage areas for file storage set in the storage device606of the MFP100. The app advances the control to step S920, for example, if the character string input in the information input field413has the characteristic of a box name (for example, the character string begins with the same character string as any of one or more character strings registered as box names.). In step S918, box names in the MFP100may be stored in advance in the storage device403. Alternatively, the app may inquire of the MFP100about a list of box names in step S918.

On the other hand, the app advances the control to step S922if the predetermined number of characters input in the information input field413do not have the characteristic of a box name.

In step S918, for example, if the box names in the MFP100include a box name “ichiyama_box,” when a character string “ichiyama_” is input into the information input field413, the app determines that the input character string has the characteristic of a box name.

In step S920, the app identifies the information input in the information input field413as a “box name,” notifies it to the MFP100, and ends the process ofFIG. 16.

In step S922, the app determines whether the predetermined number of characters have the characteristic of a “box name” as a result of the pattern recognition of step S900, “Box name” is a name that identifies each of one or more storage areas for file storage set in the storage device606of the MFP100. The app advances the control to step S924, for example, if the character string input in the information input field413has the characteristic of a box name (for example, the character string begins with the same character string as any of the one or more character strings registered as box names) In step S922, the box names in the MFP100may be stored in advance in the storage device403. Alternatively, the app may inquire of the MFP100about the list of box names in stem S918.

On the other hand, the app advances the control to step S926if the predetermined number of characters input in the information input field413do not have the characteristic of a box name.

In step S922, for example, if the box names in the MFP100include the box name “ichiyama_box,” when, the character string “ichiyama_” is input into the information input field413, the app determines that the input character string has the characteristic of a box name.

In step S924, the app identifies the information input in the information input field413as a “box name,” notifies it to the MFP100, and ends the process ofFIG. 16.

In step S926, the app notifies the MFP100that the type of the information input in the information input field413was not able to be identified, and ends the process ofFIG. 16.

If the type of information is identified in the MFP100as illustrated inFIG. 16, the communication terminal400transmits the information input in the information input field413to the MET100prior to the operation on the send button414(FIG. 1). The system controller601of the MFP100uses the information input in the information input field413, which has been transmitted from the communication terminal400, to execute the process ofFIG. 16.

Next, a description is given of specific examples of screens in accordance with the types of the information input in the information input field413.FIG. 17is an example of a screen corresponding to the type “personal name,”18is an example of a screen corresponding to the type “fax number,”FIG. 19is an example of a screen corresponding to the type “email address.”FIG. 20to are examples of screens corresponding to the type “URL,” respectively.FIG. 23is an example of a screen corresponding to the type “text.”FIG. 24is an example of a screen corresponding to the type “box name.” Each screen is described below.

A screen530ofFIG. 17is an example of a screen for registering a new user in an address book in the MFP100. The screen530includes an input field531that displays an input user name.

If the type of the information input in the information input field413is identified as a “personal name,” the touchscreen320displays the screen530in the “switching of the operation screen” ofFIG. 2. The information transmitted from the communication terminal400by the operation on the send button414is then input into the input field531.

A screen540ofFIG. 18is a screen for inputting a transmission destination when the MFP100transmits data by facsimile communication. The screen540includes an input field541that displays an input fax number.

If the type of the information input in the information input field413is identified as a “fax number,” the touchscreen320displays the screen540in the “switching of the operation screen” ofFIG. 2. The information transmitted from the communication terminal400by the operation, on the send button414is then input into the input field541.

A screen550ofFIG. 19is a screen for inputting an email address of a transmission destination when the MFP100transmits information by electronic mail. The screen550includes an, input field551for displaying an input email address.

If the type of the information input in the information input field413is identified as an “email address,” the touchscreen320displays the screen550in the “switching of the operation screen” ofFIG. 2. The information transmitted from the communication terminal400by the operation on the send button414is then input into the input field551.

A screen560ofFIG. 20, a screen570ofFIG. 21, and a screen580ofFIG. 2are examples of screens for setting a transmission destination of a file from the MFP100, respectively. More specifically, the screen560is a screen for setting a transmission destination for the transmission of a file in compliance with the SMB (Server Message Block) protocol. The screen570is a screen for setting a transmission destination for the transmission of a file in compliance with the WebDAV (Web-based Distributed Authoring and Versioning) protocol. The screen580is a screen for setting a transmission destination for the transmission of a file in compliance with the FTP (File Transfer Protocol) protocol. The screens560,570, and580include input fields561,571, and581for displaying an input transmission destination, respectively.

If the type of the information input in the information input field413is identified as a “URL,” the touchscreen320displays any of the screens560,570, and580in the “switching of the operation screen” ofFIG. 2. If a protocol is further identified in the type of the input information, the touchscreen320displays a screen corresponding to the identified protocol among the screens560,570, and580.

The information transmitted from the communication terminal400by the operation on the send button414is then input into the input field (any of the input fields561,571, and581) on the displayed screen.

A screen600ofFIG. 23(a screen illustrated in the upper part ofFIG. 23) is a screen for inputting a main body of an electronic mail document created in the MFP100. The screen600includes an input field691for displaying an input main body.

If the type of the information input in the information input field413is identified as “text,” the touchscreen320displays the screen600in the “switching of the operation screen” ofFIG. 2. The information transmitted from the communication terminal400by the operation on the send button414is then input into the input field691.

When a screen610for creating an electronic mail (a screen illustrated in the lower part ofFIG. 23) is being displayed on the touchscreen320, if the type of the information input in the information input field413is identified as “text,” the display of the touchscreen320is switched to the screen600. More specifically, the screen610is a screen for creating an electronic mail. The screen610includes an input field611that displays the name of an attached file, an input field612that displays a subtitle of an electronic mail, and an input, field691that displays a main body of the electronic mail. On the other hand, the display of the input fields611and612is omitted on the screen600(the upper part ofFIG. 23).

A screen630ofFIG. 24is a screen for specifying a file save location in the MFP100. The screen630includes an input field631for displaying an input box name.

If the type of the information input in the information input field413is identified as a “box name,” the touchscreen320displays the screen630in the “switching of the operation screen” ofFIG. 2. The information transmitted from the communication terminal400by the operation on the send button414is then input into the input field631.

As described above, the touchscreen320of the MFP100is switched to display a screen of a type in accordance with the type of information input in the information input field413.

If two or more types are identified as the types of information input in the information input field413in an image forming system according to a sixth example, the MFP100displays a list indicating the two or more types before switching the screen in the “switching of the operation screen” (FIG. 1). A user of the communication terminal400selects one type from the list. In response to this, the MFP100displays, on the touchscreen320, a screen for inputting information of the selected type.

FIG. 25is a diagram for explaining an example of the transition of a screen in the MFP100according to the sixth example. A description is given of the transition of display on the touchscreen320of the MFP100if three types “email address,” “personal name,” and “URL” are identified as the types of information input in the information input field413, with reference toFIG. 25.

FIG. 25illustrates three screens710,720, and740. The screen710is a screen for inputting settings for an image forming operation in the MFP100. The screen720is a screen including the display of the above list730. The screen740is a screen for inputting an email address.

When the screen710is being displayed on the touchscreen320, the system controller601switches the display on the touchscreen320if receiving the “input-in-progress notification” (FIG. 2and the like) from the communication terminal400. More specifically, if two or more types are identified as the types of the information input in the information input field413, the system controller601displays the screen720including the list730on the touchscreen320.

The list730is a display for selecting information to be input from the three types “email address,” “personal name,” and “URL,” More specifically, the list730includes a field731for selecting the type “email address,” a field732for selecting the type “personal name,” and a field733for selecting the type “URL.” The app on the communication terminal400may display, on the display404, that the list730is being displayed, and that it is required to select the type of the information to be input into the MFP100from the list730.

The user performs a touch operation on one of the three fields731to733to input information on the selection of one type from the three types on the list730.

When the field731is operated, the system controller601displays the screen740for inputting an “email address” on the touchscreen320. When the field732is operated, the system controller601displays a screen for inputting a “personal name” (for example, the screen530ofFIG. 17) on the touchscreen320. When the field.733is operated, the system controller601displays a screen for inputting a “URL” (for example, the screen560ofFIG. 20) on the touchscreen320.

As described above, if two or more types are identified as the types of information input in the information input field413, a list indicating the two or more types is displayed in the MFP100, A screen for inputting information of a type selected from the list is then displayed in the MFP100.

The list may be displayed on the display404of the communication terminal400. The user operates the input device405to select a type from the list. The CPU401transmits, to the MFP100, information indicating which type has been selected. In response to this, the system controller601displays a screen for inputting information on the type selected in the communication terminal400, on the touchscreen320in the “switching of the operation screen” (FIG. 2and the like).

According to one or more embodiments of the present invention, while information to be input into an image forming apparatus is being input into a communication terminal, the status of the image forming apparatus is changed to a status that can input the information. Consequently, when the communication terminal inputs the information into the image forming apparatus, the image forming apparatus can securely accept the input of the information. Therefore, the need for a user's operation of changing the status of the image forming apparatus is eliminated.

According to one or more embodiments of the present invention, the communication terminal issues a notification not before the information is input but when the information is being input. Consequently, it is possible to avoid an issuance of a needless notification when a user of the communication terminal does not intend to transmit the information to the image forming apparatus.

According to one or more embodiments of the present invention, the communication terminal issues a notification before the information is transmitted. Consequently, the user of the communication terminal can check a user of the image forming apparatus before transmitting the information to the image forming apparatu.