Processing system, information processing apparatus, storage medium, and image forming apparatus

A processing system includes a first authentication section that performs first authentication based on first authentication information associated with a user when acquiring the first authentication information, and a processor that acquires authentication success information indicating that second authentication was performed based on second authentication information different from the first authentication information and acquired by detecting the user in a contactless manner, and that stores a print job associated with the user. The processor displays, when the first authentication is performed while the print job associated with the user is stored, a print instruction screen accepting an instruction for executing printing based on the print job on the display, and causes, when the authentication success information is acquired while the print job associated with the user is stored, the image forming apparatus to execute the printing based on the print job without displaying the print instruction screen on the display.

The present application is based on, and claims priority from JP Application Serial Number 2021-199903, filed Dec. 9, 2021, the disclosure of which is hereby incorporated by reference herein in its entirety.

BACKGROUND

1. Technical Field

The present disclosure relates to a processing system including an image forming apparatus that includes a display and that is capable of performing printing, an information processing apparatus, a non-transitory computer-readable storage medium, and the image forming apparatus.

2. Related Art

Before an image forming apparatus, such as a multifunction peripheral, performs printing based on a print job, a server or the image forming apparatus authenticates a user by accepting an operation, such as an operation of bringing an ID card close to the server or the image forming apparatus or an operation of inputting a user name and a password. Here, “ID” is an abbreviation of “identification”. An image forming apparatus disclosed in JP-A-2019-14191 performs user authentication before displaying a list of registered print jobs on a display unit including a touch panel of the image forming apparatus and executing a print job corresponding to a print instruction issued in response to a touch operation performed by a user on the touch panel or the like.

When the technique described above is employed, it is highly likely that the user touches a device when requesting a user authentication, and furthermore, the user is required to touch the image forming apparatus when instructing execution of a print job.

SUMMARY

According to an aspect of the present disclosure, a processing system having an image forming apparatus that has a display and that is configured to perform printing includes a first authentication section that performs first authentication based on first authentication information associated with a user when acquiring the first authentication information, and a processor that is configured to acquire authentication success information indicating that second authentication was performed based on second authentication information that is different from the first authentication information and that is acquired by detecting the user in a contactless manner, and that stores a print job associated with the user. The processor displays, when the first authentication is performed while the print job associated with the user is stored, a print instruction screen for accepting an instruction for executing printing based on the print job on the display, and causes, when the authentication success information is acquired while the print job associated with the user is stored, the image forming apparatus to execute the printing based on the print job without displaying the print instruction screen on the display.

According to another aspect of the present disclosure, an information processing apparatus connected to an image forming apparatus that includes a display and that is configured to perform printing includes a first authentication section that performs first authentication based on first authentication information associated with a user when acquiring the first authentication information, and a processor that is configured to acquire authentication success information indicating that second authentication was performed based on second authentication information that is different from the first authentication information and that is acquired by detecting the user in a contactless manner, and that stores a print job associated with the user. The processor transmits, when the first authentication is performed while the print job associated with the user is stored, information for displaying a print instruction screen for accepting an instruction for executing printing based on the print job on the display, and causes, when the authentication success information is acquired while the print job associated with the user is stored, the image forming apparatus to execute the printing based on the print job without displaying the print instruction screen on the display.

According to a further aspect of the present disclosure, a non-transitory computer-readable storage medium storing a control program that controls an image forming apparatus that includes a display and that is configured to perform printing causes a computer to realize a first authentication function of performing first authentication based on first authentication information associated with a user when acquiring the first authentication information, and a processing function of acquiring authentication success information indicating that second authentication was performed based on second authentication information that is different from the first authentication information and that is acquired by detecting the user in a contactless manner, and storing a print job associated with the user. The processing function displays, when the first authentication is performed while the print job associated with the user is stored, a print instruction screen for accepting an instruction for executing printing based on the print job on the display, and causes, when the authentication success information is acquired while the print job associated with the user is stored, the image forming apparatus to execute the printing based on the print job without displaying the print instruction screen on the display.

An image forming apparatus includes a display, a printer, a first authentication section that performs first authentication based on first authentication information associated with a user when acquiring the first authentication information, and a processor that acquires authentication success information indicating that second authentication was performed based on second authentication information that is different from the first authentication information and that is acquired by detecting the user in a contactless manner, and that stores a print job associated with the user. The processor displays, when the first authentication is performed while the print job associated with the user is stored, a print instruction screen for accepting an instruction for executing printing based on the print job on the display, and causes, when the authentication success information is acquired while the print job associated with the user is stored, the printer to execute the printing based on the print job without displaying the print instruction screen on the display.

DESCRIPTION OF EXEMPLARY EMBODIMENTS

Hereinafter, an embodiment of the present disclosure will be described. The embodiment below is merely an example of the present disclosure, and it is not necessarily the case that all features of this embodiment are requirements for the solving means of the present disclosure.

1. Outline of Technique of Present Disclosure

First, an outline of a technique included in the present disclosure will be described with reference to examples illustrated inFIGS.1to14. Note that the drawings in this application schematically illustrates examples, and therefore, magnification factors in individual directions in the drawings may vary and the drawings may not be consistent. Components of this technique are obviously not limited to concrete examples denoted by reference numerals. In “Outline of Technique of Present Disclosure”, text in brackets means supplemental description of a preceding word.

First Mode

As illustrated inFIGS.1and13, a processing system SY1 according to a first mode of the present technique includes an image forming apparatus200that has a display206and that is capable of performing printing, and further includes a first authentication section U1 and a processor U3. The first authentication section U1 performs first authentication, when acquiring first authentication information IN1 associated with a user US0, based on the first authentication information IN1. The processor U3 is capable of acquiring authentication success information IN3 indicating that second authentication has been performed based on second authentication information IN2 that is different from the first authentication information IN1 and that is acquired by detecting the user US0 in a contactless manner and includes a print job J0 associated with the user US0. When the first authentication is performed while the first processor U3 stores the print job J0 associated with the user US0, the processor U3 displays a print instruction screen D2 for accepting an instruction for executing printing based on the print job J0 on the display206. When acquiring the authentication success information IN3 while storing the print job J0 associated with the user US0, the processor U3 causes the image forming apparatus200to execute the printing based on the print job J0 without displaying the print instruction screen D2 on the display206.

When the first authentication is performed while the first processor U3 stores the print job J0 associated with the user US0, the print instruction screen D2 for accepting an instruction for executing printing based on the print job J0 is displayed on the display206. In this case, the user US0 may instruct execution of printing based on the print job J0 on the print instruction screen D2.

When the second authentication is performed while the print job J0 associated with the user US0 is stored by the processor U3, the processor U3 acquires authentication success information IN3. Then the print instruction screen D2 is not displayed on the display206, and the image forming apparatus200executes printing based on the print job J0. In this case, the user US0 is not required to touch the apparatus when authentication of the user US0 is requested, or not required to touch the image forming apparatus200when using the image forming apparatus200to perform printing based on the print job J0.

As described above, the first mode provides the processing system SY1 capable of performing the process from the authentication to the printing in a contactless manner where appropriate.

Here, examples of the second authentication include face authentication based on a captured image IM1 of a face of the user UP0 and iris verification based on a captured image of an iris of the user US0. Accordingly, the second authentication information IN2 includes the captured image IM1 of the face or the captured image of the iris.

Examples of the first authentication that is different from the second authentication include authentication using an ID card350, authentication performed by an operation of inputting a user name and a password, and biometric authentication, such as fingerprint authentication, and may further include authentication based on information acquired by detection of the user US0 in a contactless manner. The processing system SY1 may include a second authentication section U2 performing the second authentication.

The terms “first”, “second”, and so on in this specification are used to identify components having similarity and do not indicate order.

Note that the description above is also applied to modes below.

Second Mode

As illustrated inFIG.4and so on, the first authentication section U1 may acquire the first authentication information IN1 from a receiver U4 that accepts an accessing operation of the user US0.

In the case described above, an instruction for executing printing is accepted when the first authentication is performed using the accessing operation as a trigger, and printing is executed without issuing an execution instruction when the second authentication is performed in a contactless manner. Accordingly, the second mode may provide the processing system SY1 of high usability.

Here, the accessing operation indicates an operation of bringing an object or a human body close to a device. Examples of the accessing operation include a touch operation of causing an object or a human body to touch a device and an operation of locating an object or a human body within a short distance, in which information may be acquired, from a device as a base point. For example, a card reader300that accepts an accessing operation of an ID card350may accept, in addition to a touch operation of the ID card350, an operation of arranging the ID card350within a short distance, in which the first authentication information IN1 is readable, from the card reader300as a base point. Note that the description above is also applied to modes below.

Third Mode

As illustrated inFIGS.1and13, the first authentication section U1 may acquire the first authentication information IN1 from a card (such as the ID card350) that records the first authentication information IN1 in a readable manner. The second authentication information IN2 may be the captured image IM1 of the face of the user US0. The authentication success information IN3 may be generated when the second authentication section U2 performs the face authentication based on the captured image IM1 as the second authentication. The processor U3 may acquire the authentication success information IN3 from the second authentication section U2.

The third mode may provide a preferred example of the processing system SY1.

Fourth Mode

As illustrated inFIG.9, when the first authentication is performed while the first processor U3 stores the print jobs J0 associated with the user US0, the processor U3 may display the print instruction screen D2 including a list L1 of the print jobs J0 on the display206. The processor U3 may accept a selection of one of the print jobs J0 in the list L1 or cause the image forming apparatus200to perform printing based on the selected print job J0.

According to the fourth mode, a print job J0 to be printed may be selected from the stored list L1 of the print jobs J0, and therefore, usability may be improved.

Fifth Mode

As illustrated inFIGS.9,11, and14, when the first authentication is performed or the authentication success information IN3 is acquired while the processor U3 does not store any print job J0 associated with the user US0, the processor U3 may display a function list screen D4 of the image forming apparatus200on the display206.

According to the fifth mode, an appropriate guide screen may be displayed when the number of print jobs J0 that are associated with the user US0 is 0.

Sixth Mode

As illustrated inFIG.14, when the first authentication is performed for the user US0 within a predetermined period of time after the authentication success information IN3 corresponding to the user US0 is acquired, the processor U3 may not cause the image forming apparatus200to execute printing but may display the print instruction screen D2 on the display206.

According to the sixth mode, an instruction for executing printing may be issued by operating the print instruction screen D2 within the predetermined period of time after the second authentication is performed, and therefore, usability may be improved.

Seventh Mode

As illustrated inFIG.13, the processor U3 may be included in the image forming apparatus200.

The seventh mode may provide the processing system SY1 that does not require a server that manages the image forming apparatus200.

Eighth Mode

As illustrated inFIG.1, the processor U3 and the image forming apparatus200may be connected to each other through a network NE1. As illustrated inFIG.2, the processor U3 may include a transmitter (a network I/F107, for example) that transmits screen information DO to be displayed on the display206to the image forming apparatus200through the network NE1. Here, “I/F” is an abbreviation of “interface”.

The eighth mode may provide a preferred example of the processing system SY1 since the processor U3 connected through the network NE1 to the image forming apparatus200may perform advanced processing.

Ninth Mode

As illustrated inFIGS.1and2, the information processing apparatus (the authentication printing server100, for example) according to a mode of the present technique is connected to the image forming apparatus200that includes the display206and that is capable of performing printing, and includes the first authentication section U1 and the processor U3. The first authentication section U1 performs the first authentication based on the first authentication information IN1 when receiving the first authentication information IN1 associated with the user US0. The processor U3 is capable of acquiring the authentication success information IN3 indicating that the second authentication has been performed based on the second authentication information IN2 that is different from the first authentication information IN1 and that is acquired by detecting the user US0 in a contactless manner and has a print job J0 associated with the user US0. When the first authentication is performed while the processor U3 stores the print job J0 associated with the user US0, the processor U3 transmits information for displaying the print instruction screen D2 that accepts an instruction for executing printing based on the print job J0 on the display206to the image forming apparatus200. When acquiring the authentication success information IN3 while storing the print job J0 associated with the user US0, the processor U3 causes the image forming apparatus200to execute the printing based on the print job J0 without displaying the print instruction screen D2 on the display206.

The ninth mode provides the information processing apparatus (100) that enables the process from the authentication to the printing in a contactless manner where appropriate.

Tenth Mode

Furthermore, as illustrated inFIGS.2and13, a control program PR1 according to a mode of the present technique controls the image forming apparatus200that includes the display206and that is capable of performing printing and causes a computer to realize a first authentication function FU1 and a processing function FU3. The first authentication function FU1 performs first authentication, when receiving the first authentication information IN1 associated with the user US0, based on the first authentication information IN1. The processing function FU3 is capable of acquiring the authentication success information IN3 indicating that the second authentication has been performed based on the second authentication information IN2 that is different from the first authentication information IN1 and that is acquired by detecting the user US0 in a contactless manner and stores the print job J0 associated with the user US0. When the first authentication is performed while the first processing function FU3 stores the print job J0 associated with the user US0, the processing function FU3 displays the print instruction screen D2 for accepting an instruction for executing printing based on the print job J0 on the display206. When acquiring the authentication success information IN3 while storing the print job J0 associated with the user US0, the processing function FU3 causes the image forming apparatus200to execute the printing based on the print job J0 without displaying the print instruction screen D2 on the display206.

The tenth mode provides the control program PR1 that enables the process from the authentication to the printing in a contactless manner where appropriate.

Eleventh Mode

Furthermore, as illustrated inFIG.13, the image forming apparatus200according to a mode of the present disclosure includes the display206, a printer208, the first authentication section U1, and the processor U3. The first authentication section U1 performs first authentication, when acquiring first authentication information IN1 associated with the user US0, based on the first authentication information IN1. The processor U3 is capable of acquiring authentication success information IN3 indicating that the second authentication has been performed based on the second authentication information IN2 that is different from the first authentication information IN1 and that is acquired by detecting the user US0 in a contactless manner and stores the print job J0 associated with the user US0. When the first authentication is performed while the first processor U3 stores the print job J0 associated with the user US0, the processor U3 displays a print instruction screen D2 for accepting an instruction for executing printing based on the print job J0 on the display206. When acquiring the authentication success information IN3 while storing the print job J0 associated with the user US0, the processor U3 causes the printer208to execute the printing based on the print job J0 without displaying the print instruction screen D2 on the display206.

The 11th mode provides the image forming apparatus200capable of performing the process from the authentication to the printing in a contactless manner where appropriate.

Furthermore, the present technique is applicable to a composite system including the processing system SY1, a composite apparatus including the information processing apparatus (100), an image forming system including the image forming apparatus200, a processing method employed in the processing system SY1, an information processing method employed in the information processing apparatus (100), a processing method employed in the image forming apparatus200, a method for controlling the image forming apparatus200, a computer-readable medium recording the control program PR1, and the like. Any of the apparatuses described above may be constituted by a plurality of distributed portions.

2. Concrete Example of Configuration of Processing System

FIG.1is a diagram schematically illustrating a configuration of a system including the processing system SY1 as a concrete example. The system includes the authentication printing server100, the image forming apparatus200, the card reader300, a face authentication server400, an imaging apparatus500, and a terminal600. Here, the authentication printing server100is an example of the information processing apparatus, the card reader300is an example of the receiver U4, and the face authentication server400is an example of the second authentication section U2. The processing system SY1 includes the authentication printing server100, the image forming apparatus200, and the card reader300. Note that the processing system SY1 may include the terminal600, the face authentication server400, or the imaging apparatus500. The authentication printing server100, the image forming apparatus200, the face authentication server400, the imaging apparatus500, and the terminal600are connected to the network NE1 including the Internet. The network NE1 may include a LAN. “LAN” is an abbreviation of “local area network”. Connection to the network NE1 may be realized by wired connection, wireless connection, or a combination of the wired connection and the wireless connection.

The user US0 uses the terminal600to register the print job J0 to the authentication printing server100. Then the user US0 performs an accessing operation of bringing the ID card350in contact with or over the card reader300to successfully perform card authentication and causes the image forming apparatus200to execute printing based on the print job J0 registered in the authentication printing server100. Here, the operation of bringing the ID card350over the card reader300includes, in addition to an operation of bringing the ID card350into contact with the card reader300, an operation of arranging the ID card350within a short distance, in which the first authentication information IN1 is readable, from the card reader300as a base point. Furthermore, the user US0 may cause the image forming apparatus200to execute printing based on the print job J0 registered in the authentication printing server100, when the imaging apparatus500successfully performs the face authentication by capturing a face image of the user US0.

Note that the number of combinations of the image forming apparatus200, the card reader300, and the imaging apparatus500in the processing system SY1 is not limited to 1, and may be 2 or more. Furthermore, the processing system SY1 may include two or more terminals600.

The authentication printing server100is a server computer including the first authentication section U1 that performs the first authentication based on the first authentication information IN1 read from the ID card350and the processor U3 that causes the image forming apparatus200to perform printing based on the print job J0. The first authentication section U1 may acquire the first authentication information IN1 including information for identifying the user US0 from the ID card350. The first authentication section U1 includes an authentication database DB1 that accumulates information for permitting authentication, and permits a login of the user US0 when the first authentication information IN1 received from the image forming apparatus200through the network NE1 has been registered in the authentication database DB1. The first authentication is thus performed. When receiving a print job registration request RE1 from the terminal600through the network NE1, the processor U3 generates a print job J0 in accordance with the print job registration request RE and associates the print job J0 with the user US0 before storing the print job J0. Furthermore, the processor U3 has screen information DO for displaying, on the display206of the image forming apparatus200, screens, such as a pre-login screen D1 illustrated inFIG.5, the print instruction screen D2 illustrated inFIG.6, a print progress screen D3 illustrated inFIG.7, and the function list screen D4 illustrated inFIG.8. When the processor U3 performs authentication, such as card authentication or face authentication, and the authentication is successfully completed, the processor U3 may transmit the screen information DO suitable for a situation to the image forming apparatus200and transmit the print job J0 associated with the user US0 to the image forming apparatus200.

The image forming apparatus200includes an input section205, the display206, the printer208, and an I/F210for the card reader300. The image forming apparatus200may be a multifunction peripheral as illustrated inFIG.3or a print dedicated machine. The multifunction peripheral is regarded as a print apparatus having various functions in addition to a print function. Examples of the various functions include a document reading function, a copy function, and a facsimile function.

When acquiring the first authentication information IN1 from the card reader300, the image forming apparatus200transmits the first authentication information IN1 to the authentication printing server100through the network NE1. Furthermore, when receiving the screen information DO from the authentication printing server100through the network NE1, the image forming apparatus200displays a screen on the display206in accordance with the screen information DO. Furthermore, when receiving the print job J0 from the authentication printing server100through the network NE1, the image forming apparatus200executes printing based on the print job J0 using the printer208.

When the ID card350recording the first authentication information IN1 in a computer readable manner is brought into contact with or close to the card reader300, the card reader300reads the first authentication information IN1 from the ID card350and transmits the first authentication information IN1 to the image forming apparatus200. The first authentication information IN1 recorded in the ID card350has been associated with the user US0 of an owner of the ID card350. Accordingly, the card reader300accepts an accessing operation performed by the user US0. As the ID card350, an IC card, a magnetic card, a card on which an identification code including the first authentication information IN1 is printed, or the like may be used. Here, “IC” is an abbreviation of “integrated circuit”. Examples of the identification code include a bar code and a two-dimensional code. Examples of the card reader300include an IC card reader, a magnetic card reader, and an identification code reader. The card reader300may have a function of a writer capable of writing information. Note that the card reader300may be directly coupled to the authentication printing server100instead of the image forming apparatus200or may be connected to the network NE1 when having a function of a web server.

The face authentication server400serving as the second authentication section U2 is a server computer including a CPU, a ROM, a RAM, a storage, and an I/F used for connection to the network NE1. Here, “CPU” is an abbreviation of “central processing unit”, “ROM” is an abbreviation of “read only memory”, and “RAM” is an abbreviation of “random access memory”. The storage of the face authentication server400stores a face image database DB2 that accumulates feature values of face images of users US0 to whom the authentication is to be granted. The feature values are associated with the users US0.

The face authentication process is performed by determining validity of a person to be authenticated based on a result of a comparison between the feature values of the face images registered in advance and a feature value of a face image of the person to be authenticated at a time of authentication. Various processes are may be employed as the face authentication process. For example, as the face authentication process, the face authentication server400performs detection of face portions on a captured face image of a user US0 and the registered face images, detects face feature points based on the detected face portions, and calculates similarity degrees of the face portions based on the detected face feature points. When a calculated similarity degree is larger than a predetermined threshold value, it is determined that the user US0 of the captured face image and a person of a corresponding one of the registered face images is identical.

The face portions may be detected by employing a method for discriminating a face from portions other than the face by means of a support vector machine on the captured face image of the user US0 and the registered individual face images. Furthermore, the face portions may be detected by employing a method for discriminating a face from portions other than the face by means of a deep neural network, a general learning vector quantization method, or the like.

The face feature points may be detected by extracting feature points, such as eyes, a nose, and a mouth, from the face portions, calculating positional relationships between the feature points and predetermined characteristics in the vicinity of the feature points as feature values, and converting the feature values as feature value vectors. Here, examples of the predetermined characteristics include color density and color distribution. The face feature points may be detected by other methods.

The calculation of a similarity degree of a face portion may be realized by a method for calculating a chi-square distance or an Euclidean distance between feature value vectors on the captured face image of the user and the registered individual face images. The similarity degrees of the face points may be calculated by other methods.

A feature value having a similarity degree relative to a feature value of a face image included in a captured image IM1 received from the imaging apparatus500through the network NE1 that is larger than a threshold value has been registered in the face image database DB2, the face authentication server400generates authentication success information IN3 including information for identifying the user US0. The captured image IM1 of the face of the user US0 is an example of the second authentication information IN2 acquired when the user US0 is detected in a contactless manner. The face authentication is thus performed as the second authentication so as to generate the authentication success information IN3. The authentication success information IN3 indicates that the second authentication has been performed based on the second authentication information IN2 acquired by detecting the user US0 in a contactless manner. When generating the authentication success information IN3, the face authentication server400transmits the authentication success information IN3 to the authentication printing server100through the network NE1. Note that, when a feature value having a similarity degree relative to a feature value of a face image included in the captured image IM1 that is larger than the threshold value has not been registered in the face image database DB2, the face authentication server400may transmit authentication failure information indicating that the second authentication has not been performed to the authentication printing server100.

The imaging apparatus500illustrated inFIG.1is a network camera having a function of a web server, and includes a CPU, a ROM, a RAM, a storage, an imaging section, an I/F used for a connection to the network NE1. Therefore, the imaging apparatus500may be regarded as a server computer. The imaging apparatus500transmits, when capturing a face of the user US0 in a contactless manner, a captured image IM1 to the face authentication server400through the network NE1. Note that the imaging apparatus500may not be a network camera and may be directly connected to the face authentication server400.

FIG.2is a diagram schematically illustrating a configuration of the authentication printing server100that is an example of the information processing apparatus. The authentication printing server100includes a CPU101that is a processor, a ROM102that is a semiconductor memory, a RAM103that is a semiconductor memory, a storage device104, an input device105, a display device106, a network I/F107, and a clock circuit108. These components are electrically coupled to one another so as to input and output information from and to each other. The network I/F107is an example of a transmitter that transmits the screen information DO to the image forming apparatus200and is included in the processor U3. Therefore, the processor U3 and the image forming apparatus200are connected to each other through the network NE1.

The storage device104stores an OS not illustrated, the control program PR1, the authentication database DB1, the screen information DO, the print job J0, and the like. Here, “OS” is an abbreviation of “operating system”. The storage device104is a computer readable medium recording the control program PR1. The control program PR1 may be recorded in an external computer readable recording medium. The control program PR1 causes the authentication printing server100serving as the computer to realize the first authentication function FU1 corresponding to the first authentication section U1 and the processing function FU3 corresponding to the processor U3. The print job J0 is associated with the user US0 before being stored in the storage device104. In the example ofFIG.2, the storage device104stores print jobs J11 to J13 that are associated with a user US1, a print job J21 associated with a user US2, and print jobs J41 and J42 that are associated with a user US4.

As the storage device104, a magnetic storage device, such as a hard disk, a nonvolatile semiconductor memory, such as a flash memory, or the like may be used.

As the input device105, a pointing device, hard keys including a keyboard, a touch panel attached to a surface of a display panel, or the like may be used. As the display device106, a liquid crystal display panel or the like may be used. The network I/F107is connected to the network NE1 so as to communicate with a counterpart connected through the network NE1 in accordance with a predetermined communication standard. For example, the network I/F107receives the print job registration request RE1, the first authentication information IN1, the authentication success information IN3, or the like from the counterpart, and transmits the screen information DO, the print job J0, or the like to the image forming apparatus200serving as the counterpart. The clock circuit108is capable of outputting a current date and time.

The CPU101executes the control program PR1 read from the storage device104to the RAM103so as to perform a first authentication process corresponding to the first authentication function FU1 and a control process corresponding to the processing function FU3. The control program PR1 causes the authentication printing server100that is the computer to function as the first authentication section U1 and the processor U3. The authentication printing server100that executes the control program PR1 performs a first authentication step corresponding to the first authentication function FU1 and a control step corresponding to the processing function FU3.

FIG.3is a diagram schematically illustrating a configuration of the image forming apparatus200. The image forming apparatus200includes a CPU201that is a processor, a ROM202that is a semiconductor memory, a RAM203that is a semiconductor memory, a storage204, an input section205, a display206, a reader207, a printer208, a facsimile209, an I/F210for the card reader300, a network I/F211, and a clock circuit212. These components are electrically coupled to one another so as to input and output information from and to each other.

The storage204stores firmware and the like. The CPU201executes the firmware read from the storage204into the RAM203so as to cause the image forming apparatus200to realize a plurality of functions as the image forming apparatus200. Examples of the functions include a print function, a reading function, a copy function, and a facsimile function. As the storage204, a nonvolatile semiconductor memory, such as a flash memory, a magnetic storage device, such as a hard disk, or the like may be used.

As the input section205, a touch panel attached to a surface of a display panel, hard keys, or the like may be used. As the display206, a liquid crystal display panel or the like may be used. The reader207reads a document so as to generate scan data indicating a read image. The printer208executes printing on a sheet for printing based on the print job J0. The image forming apparatus200reads a document using the reader207and performs printing on a read image using the printer208so as to perform a copy function. The facsimile209transmits an image read by the reader207by facsimile transmission to a transmission destination through a telephone line or receives an image by facsimile reception from a transmission source through the telephone line. The image forming apparatus200is capable of printing an image supplied from the facsimile209using the printer208. The I/F210is connected to the card reader300and is capable of receiving the first authentication information IN1 from the card reader300. The network I/F211is connected to the network NE1 so as to communicate with the authentication printing server100connected to the network NE1 in accordance with a predetermined communication standard. For example, the network I/F211transmits the first authentication information IN1 and the like to the authentication printing server100and receives the screen information DO, the print job J0, and the like from the authentication printing server100. The clock circuit212is capable of outputting a current date and time. 3. Concrete Example of Processing of System

FIG.4is a diagram schematically illustrating an example of a flow of a process performed by the processing system SY1 when card authentication is performed as the first authentication. Here, step S114corresponds to the first authentication section U1 and the first authentication function FU1. Step S116, step S120, step S122, and step S128correspond to the processor U3 and the processing function FU3. Hereinafter, a term “step” is omitted and individual step numbers are assigned in parentheses where appropriate.

First, the terminal600accepts an operation of registering a print job J0 performed by the user US0 and transmits a registration request of the print job J0, that is, the print job registration request RE1 illustrated inFIG.1, to the authentication printing server100(S102). When receiving the print job registration request RE1 from the terminal600, the authentication printing server100generates a print job J0 based on the print job registration request RE1 and performs a storage process of storing the print job J0 in the storage device104after associating the print job J0 with the user US0 (S104). By this, the processor U3 stores the print job J0 associated with the user US0.

Furthermore, the authentication printing server100transmits, before the user US0 logs in, pre-login screen information for displaying the pre-login screen D1 illustrated inFIG.5on the display206to the image forming apparatus200(S106). The image forming apparatus200performs, when receiving the pre-login screen information from the authentication printing server100, a display process of displaying the pre-login screen D1 on the display206(S108).

The pre-login screen D1 illustrated inFIG.5has content for prompting the user US0 to perform the card authentication or to input a user ID and a password. When the user US0 performs the accessing operation by bringing the ID card350into contact with the card reader300or putting the ID card350over the card reader300, the card reader300reads the first authentication information IN1 including information for identifying the user US0 from the ID card350and transmits the first authentication information IN1 to the image forming apparatus200(S110). Alternatively, when the user US0 performs a touch operation on a button811of “user ID and password” provided on the pre-login screen D1, the image forming apparatus200accepts an operation of inputting a user ID and a password performed by the user US0 and transmits the input user ID and the input password as the first authentication information IN1 to the authentication printing server100. Note thatFIG.4is a diagram illustrating a process performed when the user US0 performs the accessing operation of bringing the ID card350into contact with the card reader300or putting the ID card350over the card reader300.

When receiving the first authentication information IN1 from the card reader300, the image forming apparatus200transmits the first authentication information IN1 to the authentication printing server100to request login of the user US0 (S112). When receiving the first authentication information IN1 from the image forming apparatus200, the authentication printing server100performs a first authentication process of performing first authentication based on the first authentication information IN1 (S114). The authentication printing server100permits login of the user US0 when the first authentication information IN1 has been registered in the authentication database DB1. The first authentication section U1 thus performs the first authentication based on the first authentication information IN1, when receiving the first authentication information IN1 associated with the user US0.

When the first authentication is performed while the print job J0 associated with the user US0 is stored, the authentication printing server100transmits print instruction screen information for displaying the print instruction screen D2 illustrated inFIG.6on the display206to the image forming apparatus200(S116). The print instruction screen D2 is used to receive an instruction for executing printing based on the print job J0. The image forming apparatus200performs, when receiving the print instruction screen information from the authentication printing server100, a display process of displaying the print instruction screen D2 on the display206(S118).

The print instruction screen D2 illustrated inFIG.6includes a list L1 of print jobs J0 and a print button824. In the example illustrated inFIG.2, when the first authentication is performed for the user US1, the print jobs J11 to J13 associated with the user US1 are displayed as the list L1 with check boxes821to823. The input section205receives an operation of determining whether each of the check boxes821to823is to be checked. When the input section205receives a touch operation on the print button824performed by the user US0, the image forming apparatus200executes printing based on a print job or print jobs corresponding to at least one of the check boxes821to823that has been checked. In the example ofFIG.6, the check box821corresponding to the print job J11, the check box822corresponding to the print job J12, and the check box823corresponding to the print job J13 have been checked, and therefore, the image forming apparatus200executes printing based on the print jobs J11 to J13.

Note that, when only one print job J0 is associated with the user US0, such as the case of the user US2 as illustrated inFIG.2, the print instruction screen D2 displays only one print job J0 in a format of the list L1. In this case, the image forming apparatus200accepts a determination as to whether printing is to be executed based on the print job J0.

When the print button824is touched to be operated, the image forming apparatus200transmits selection information indicating a selected print job J0 to the authentication printing server100(S120). When receiving the selection information of the print job J0, the authentication printing server100transmits print progress screen information for displaying the print progress screen D3 illustrated inFIG.7on the display206and print data to the image forming apparatus200(S122). In S122, the authentication printing server100generates print data for executing printing based on the print job J0 indicated by the selection information and transmits the print data to the image forming apparatus200. The image forming apparatus200performs, when receiving the print progress screen information from the authentication printing server100, a display process of displaying the print progress screen D3 on the display206(S124). In S124, the image forming apparatus200performs, when receiving the print data from the authentication printing server100, printing in accordance with the print data. By this, printing is performed based on the print job J0.

On the print progress screen D3 illustrated inFIG.7, processing states831to833of the print jobs J0 are displayed. When the check boxes821to823are checked as illustrated inFIG.6, the image forming apparatus200displays the print state831of the print job J11, the print state832of the print job J12, and the print state833of the print job J13 on the display206. Note that the print state831of “printing” indicates that printing is being executed based on the print job J11 and the print states832and833of “standby” indicate that printing based on the print jobs J12 and J13 is in a standby state. When the printing based on the print job J11 is completed, the printing based on the print job J12 and the printing based on the print job J13 are executed in turn.

When completing the printing based on the print job J0, the image forming apparatus200transmits a print termination notification to the authentication printing server100(S126). When receiving the print termination notification from the image forming apparatus200, the authentication printing server100transmits function list screen information for displaying the function list screen D4 illustrated inFIG.8on the display206to the image forming apparatus200(S128). The image forming apparatus200performs, when receiving the function list screen information from the authentication printing server100, a display process of displaying the function list screen D4 on the display206(S130).

The function list screen D4 illustrated inFIG.8includes a print button841for using a print function, a copy button842for using a copy function, a fax button843for using a facsimile function, and a scan button844for using a reading function. The user US0 performs a touch operation on the function list screen D4 while being logged in the authentication printing server100, so as to use the various functions of the image forming apparatus200. Note that the user US0 may log out of the authentication printing server100by performing a touch operation on a logout button, not illustrated, in the image forming apparatus200.

In practice, authentication may be successfully performed when the processor U3 performs card authentication or the like while the processor U3 does not store any print job J0 associated with the user US0. In this case, it is highly likely that the user US0 uses a function other than the print function, and therefore, the authentication printing server100displays the function list screen D4 on the display206. A process of this case is illustrated inFIG.9.

FIG.9is a flowchart schematically illustrating a process performed by the first authentication section U1 and the processor U3 when the first authentication is performed. InFIG.9, steps the same as those illustrated inFIG.4are denoted by numbers the same as those inFIG.4. The process illustrated inFIG.9is started when login of the user US0 is requested in S112ofFIG.4. The authentication printing server100executes a plurality of processes in parallel as multitask. Here, S114corresponds to the first authentication section U1 and the first authentication function FU1. S140, S116, S120, S122, and S128correspond to the processor U3 and the processing function FU3.

First, the authentication printing server100performs the first authentication process of performing first authentication based on the received first authentication information IN1 (S114). Subsequently, the authentication printing server100branches the process in accordance with a determination as to whether the print job J0 associated with the user US0 has been stored (S140).

When the print job J0 associated with the user US0 has been stored, the authentication printing server100displays the print instruction screen D2 illustrated inFIG.6on the display206(S116) and receives selection information of the print job J0 (S120). Furthermore, the authentication printing server100displays the print progress screen D3 illustrated inFIG.7on the display206and transmits the print job J0 indicated by the selection information to the image forming apparatus200(S122). Thereafter, the authentication printing server100displays the function list screen D4 illustrated inFIG.8on the display206(S128).

When the print job J0 associated with the user US0 is not stored, the process proceeds to S128where the authentication printing server100displays the function list screen D4 illustrated inFIG.8on the display206.

Accordingly, when the first authentication is performed while the processor U3 stores the print job J0 associated with the user US0, the processor U3 displays the print instruction screen D2 including the list L1 of the print jobs J0 on the display206. Thereafter, the processor U3 accept a selection of at least one of the print jobs J0 in the list L1 and cause the image forming apparatus200to perform printing based on the selected print job J0.

On the other hand, when the first authentication is performed while the processor U3 does not store any print job J0 associated with the user US0, the processor U3 displays the function list screen D4 of the image forming apparatus200on the display206.

Here, also when the process from S116to S130inFIG.4is performed at a time of face authentication instead of the card authentication, the image forming apparatus200may perform printing based on the print job J0. However, when the processor U3 accepts a selection of at least one of the print jobs J0 in the list L1, the user US0 is required to perform a touch operation for printing, such as a touch operation on the print instruction screen D2 or the like. In this case, an advantage of the face authentication performed in a contactless manner is reduced.

Therefore, according to the processing system SY1 of this concrete example, printing is performed based on the print job J0 even when a touch operation for a print instruction is not performed at a time of the face authentication.

FIG.10is a diagram schematically illustrating an example of a flow of a process performed by the system including the processing system SY1 when the face authentication is performed as the second authentication. InFIG.10, steps the same as those illustrated inFIG.4are denoted by numbers the same as those inFIG.4.FIG.11is a flowchart schematically illustrating a process performed by the processor U3 when the second authentication is performed. InFIG.11, steps the same as those illustrated inFIG.10are denoted by numbers the same as those inFIG.10. Here, S240, S242, S208, and S214correspond to the processor U3 and the processing function FU3.FIG.12is a flowchart schematically illustrating a process performed by the authentication print server100for switching between a process performed after the card authentication illustrated inFIGS.4and9and a process performed after the face authentication illustrated inFIGS.10and11.

First, the process inFIG.12will be described.

The authentication printing server100stores, when receiving the print job registration request RE1 from the terminal600(S302), the print job J0 as described in S104ofFIGS.4and10and continues the process inFIG.12.

Furthermore, the authentication printing server100proceeds to S114inFIGS.4and9, when receiving a login request along with the first authentication information IN1 from the image forming apparatus200(S304), to perform the first authentication process. The authentication printing server100displays the print instruction screen D2 on the display206while storing the print job J0 associated with the user US0 and continues the process illustrated inFIG.12through S120to S128illustrated inFIG.4.

Furthermore, when the authentication printing server100receives authentication success information IN3 from the face authentication server400(S306), the process proceeds to S240ofFIG.11. The authentication printing server100displays the print progress screen D3 on the display206while storing the print job J0 associated with the user US0 and transmits print data to the image forming apparatus200. The authentication printing server100continues the process inFIG.12through S212and S214ofFIG.10.

Accordingly, when the card authentication is performed while the print job J0 associated with the user US0 is stored, the user US0 may instruct execution of printing based on the print job J0 on the print instruction screen D2. When the face authentication is performed while the print job J0 associated with the user US0 is stored, the image forming apparatus200executes printing based on the print job J0 without displaying the print instruction screen D2. In this case, the user US0 is not required to touch any device when requesting user authentication, or not required to touch the image forming apparatus200when using the image forming apparatus200to perform printing based on the print job J0. According to the processing system SY1 of this concrete example, the process from the authentication to the printing may be performed in a contactless manner where appropriate.

Next, referring toFIG.10, an example of a flow of a process performed by the system including the processing system SY1 when the face authentication is performed will be illustrated. Note that the process from S102to S108is the same as the process from S102to S108ofFIG.4, and therefore, a description thereof is omitted.

The imaging apparatus500transmits, when capturing a face of the user US0 in a contactless manner, a captured image IM1 to the face authentication server400(S202). When receiving the captured image IM1 from the imaging apparatus500, the face authentication server400performs a second authentication process of performing second authentication based on the captured image IM1 serving as the second authentication information IN2 (S204). A feature value having a similarity degree relative to a feature value of a face image included in the captured image IM1 that is larger than a threshold value has been registered in the face image database DB2, the face authentication server400generates authentication success information IN3 including information for identifying the user US0 and transmits the authentication success information IN3 to the authentication printing server100(S206).

When receiving the authentication success information IN3 including information for specifying the user US0 described above while the print job J0 associated with the user US0 is stored, the authentication printing server100transmits print progress screen information for displaying the print progress screen D3 illustrated inFIG.7on the display206and print data to the image forming apparatus200(S208). In S208, the authentication printing server100generates print data for executing printing based on all print jobs J0 associated with the user US0 and transmits the print data to the image forming apparatus200. In the example ofFIG.2, when receiving the authentication success information IN3 corresponding to the user US1, the authentication printing server100generates print data for executing printing based on the print jobs J11 to J13 associated with the user US1. The image forming apparatus200performs, when receiving the print progress screen information from the authentication printing server100, a display process of displaying the print progress screen D3 on the display206(S210). In S210, the image forming apparatus200performs, when receiving print data from the authentication printing server100, printing in accordance with the print data. By this, the printing is performed based on the print jobs J0.

When completing the printing based on the print jobs J0, the image forming apparatus200transmits a print termination notification to the authentication printing server100(S212). When receiving the print termination notification from the image forming apparatus200, the authentication printing server100performs a logout process to terminate the login state of the user US0 (S214). Thereafter, the authentication printing server100transmits the pre-login screen information to the image forming apparatus200in S106. The image forming apparatus200performs, when receiving the pre-login screen information from the authentication printing server100, a display process of displaying the pre-login screen D1 on the display206(S108).

In practice, authentication may be successfully performed when the processor U3 performs the face authentication while the processor U3 does not store any print job J0 associated with the user US0. In this case, it is highly likely that the user US0 uses a function other than the print function, and therefore, the authentication printing server100displays the function list screen D4 on the display206. A process of this case is illustrated inFIG.11. The process inFIG.11is started when the authentication printing server100receives the authentication success information IN3 from the face authentication server400in S206ofFIG.10.

First, the authentication printing server100branches the process in accordance with a determination as to whether the print job J0 associated with the user US0 has been stored (S240).

When storing the print job J0 associated with the user US0, the authentication printing server100displays the print progress screen D3 ofFIG.7on the display206and transmits print data for executing printing based on all print jobs J0 associated with the user US0 to the image forming apparatus200(S208). Thereafter, the authentication printing server100performs the logout process (S214).

When the print job J0 associated with the user US0 has not been stored, the authentication printing server100displays the function list screen D4 illustrated inFIG.8on the display206(S242).

Accordingly, when acquiring the authentication success information IN3 from the face authentication server400serving as the second authentication section U2 while storing the print job J0 associated with the user US0, the processor U3 causes the image forming apparatus200to execute printing based on the print job J0 without displaying the print instruction screen D2 on the display206.

On the other hand, when acquiring the authentication success information IN3 while the processor U3 does not store any print job J0 associated with the user US0, the processor U3 displays the function list screen D4 of the image forming apparatus200on the display206.

Accordingly, when the first authentication, such as the card authentication, is performed while the first processor U3 stores the print job J0 associated with the user US0, the print instruction screen D2 for accepting an instruction for executing printing based on the print job J0 is displayed on the display206. In this case, the user US0 may instruct execution of printing based on the print job J0 on the print instruction screen D2. When the face authentication as the second authentication that does not require a touch operation is performed while the first processor U3 stores the print job J0 associated with the user US0, printing based on the print job J0 is executed without displaying the print instruction screen D2 on the display206. In this case, the user US0 is not required to touch any device when user authentication is requested, or not required to touch the image forming apparatus200when using the image forming apparatus200to perform printing based on the print job J0. According to the processing system SY1 of this concrete example, the process from the authentication to the printing may be performed in a contactless manner where appropriate.

Various modifications of the present disclosure may be made.

For example, the authentication printing server100may include the second authentication section U2 in addition to the first authentication section U1. Furthermore, the processing system SY1 may include a third authentication section or the like that performs third authentication that is different from the first authentication or the second authentication.

The first authentication is not limited to the card authentication and the authentication performed by an operation of inputting a user ID and a password, and may be fingerprint authentication or the like. The second authentication is not limited to the face authentication and may be iris verification or the like.

The processes described above may be modified where appropriate by changing order or the like. Note that the processes described above are not limited to examples of those executed by the CPU but may be executed by an electronic component, such as an ASIC. Here, “ASIC” is an abbreviation of “application specific integrated circuit”. Furthermore, the processes described above may be performed in a distributed manner by a plurality of CPUs or executes by the CPU and the electronic component, such as the ASIC, in cooperation.

As illustrated inFIG.13, the processing system SY1 may not include the authentication printing server100, and the image forming apparatus200may include the first authentication section U1 and the processor U3.FIG.13is a diagram schematically illustrating another configuration of a system including the processing system SY1 in detail. The system includes the image forming apparatus200, the card reader300, the face authentication server400, the imaging apparatus500, and the terminal600. The processing system SY1 includes the image forming apparatus200, and the card reader300. The image forming apparatus200includes the display206, the printer208, the first authentication section U1, and the processor U3. The first authentication section U1 permits login of the user US0 in response to a reception of the first authentication information IN1 from the card reader300when the first authentication information IN1 has been registered in the authentication database DB1. The first authentication is thus performed. When receiving a print job registration request RE1 from the terminal600through the network NE1, the processor U3 generates a print job J0 in accordance with the print job registration request RE and associates the print job J0 with the user US0 to be stored. When generating authentication success information IN3, the face authentication server400transmits the authentication success information IN3 to the image forming apparatus200through the network NE1.

When the first authentication, such as the card authentication, is performed while the processor U3 stores the print job J0 associated with the user US0, the processor U3 displays the print instruction screen D2 illustrated inFIG.6on the display206. Furthermore, when receiving the authentication success information IN3 from the face authentication server400while storing the print job J0 associated with the user US0, the processor U3 causes the printer208to execute printing based on the print job J0 without displaying the print instruction screen D2 on the display206.

Also according to the processing system SY1 illustrated inFIG.13, the process from the authentication to the printing may be performed in a contactless manner where appropriate. Obviously, the image forming apparatus200may include the second authentication section U2 or include the third authentication section or the like.

As illustrated inFIG.14, it is convenient when switching from the second authentication, such as the face authentication, to the first authentication, such as the card authentication, is available.FIG.14is a flowchart schematically illustrating another process performed by the processor U3 when the second authentication is performed. InFIG.14, steps the same as those illustrated inFIG.11are denoted by numbers the same as those inFIG.11. The process inFIG.14is started when the authentication printing server100receives the authentication success information IN3 from the face authentication server400in S206ofFIG.10. Here, S240, S242, S244, S246, S208, and S214correspond to the processor U3 and the processing function FU3.

First, the authentication printing server100branches the process in accordance with a determination as to whether the print job J0 associated with the user US0 has been stored (S240).

The authentication printing server100branches the process in accordance with a determination as to whether the first authentication has been performed for the user US0 (S244) when storing the print job J0 associated with the user US0. The authentication printing server100executes a plurality of processes in parallel as multitask. For example, it is determined that the first authentication has been performed when the authentication printing server100performs the card authentication of the user US0 in a process other than the process ofFIG.14. When the first authentication is performed, the process proceeds to S116ofFIG.4where the authentication printing server100displays the print instruction screen D2 ofFIG.6on the display206.

When the first authentication has not been performed, the authentication printing server100branches the process in accordance with a determination as to whether a predetermined period of time has elapsed after the authentication success information IN3 is received (S246). The predetermined period of time described above is not particularly limited and may be approximately in a range from 10 seconds to 30 seconds that is set in accordance with a use state. When the predetermined period of time has not elapsed, the authentication printing server100performs the process from S244to S246again. Accordingly, when the first authentication is performed for the user US0 within the predetermined period of time after the authentication success information IN3corresponding to the user US0 is acquired, the authentication printing server100does not cause the image forming apparatus200to execute printing but displays the print instruction screen D2 on the display206.

When the predetermined period of time has elapsed, the authentication printing server100displays the print progress screen D3 ofFIG.7on the display206and transmits print data for executing printing based on all print jobs J0 associated with the user US0 to the image forming apparatus200(S208). Thereafter, the authentication printing server100performs a logout process (S214).

Note that, when the print job J0 associated with the user US0 has not been stored, the authentication printing server100displays the function list screen D4 illustrated inFIG.8on the display206(S242).

According to the example illustrated inFIG.14, an instruction for executing printing may be issued by operating the print instruction screen D2 within the predetermined period of time after the second authentication, such as the face authentication, is performed, and therefore, usability may be improved.

As described above, the various modes of the present disclosure may provide a technique or the like capable of performing the process from the authentication to the printing in a contactless manner where appropriate. Even techniques only including components associated with independent claims offer the basic operations and the basic effects described above.

Furthermore, a configuration obtained by replacing the components disclosed in the foregoing examples or modifying a combination of the components, a configuration obtained by replacing the components disclosed in general techniques and the foregoing examples or modifying a combination of the components, and the like may also be embodied. The present disclosure also includes these configurations.