Image forming apparatus and control method with requesting user image capture

An image forming apparatus includes an image sensor configured to capture image data and a controller operatively coupled to the image sensor. The controller is configured to receive, from the image sensor, a requesting user image of a requesting user who requests authentication to use the image forming apparatus. The controller is configured to transmit the requesting user image to a terminal associated with an authenticating user that is authorized to authenticate the requesting user. The controller is configured to acquire, from the terminal, an authentication result indicating whether the authenticating user authenticates the requesting user to use the image forming apparatus.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2022-047135, filed on Mar. 23, 2022, the entire contents of which are incorporated herein by reference.

FIELD

Embodiments described herein relate generally to an image forming apparatus and a control method.

BACKGROUND

In the related art, there is a technology for authenticating a user when using an image forming apparatus.

As the above technology, there is a technology that performs face authentication of a user using a camera mounted on the image forming apparatus. A user who can be authenticated by this technology is a user who is set as an authentication target in advance, and thus other users cannot use the image forming apparatus.

As another technology, there is a technology that allows an issuer to select permission or non-permission of private printing that the issuer instructs the image forming apparatus to perform if a user other than the issuer executes the private printing. The user other than the issuer in this technology is only permitted to perform private printing. That is, the user other than the issuer is not permitted to use the image forming apparatus for purposes other than the private printing.

As described above, the user authentication in the image forming apparatus in the related art has a problem that only the user who is set as the authentication target in advance can be authenticated.

DETAILED DESCRIPTION

Embodiments provide an image forming apparatus and a control method capable of authenticating even a user who is not set as an authentication target in advance.

In general, according to one embodiment, an image forming apparatus includes an image sensor and a controller operatively coupled to the image sensor. The image sensor is configured to capture image data. The controller is configured to receive, from the image sensor, a requesting user image of a requesting user who requests authentication to use the image forming apparatus. The controller is configured to transmit the requesting user image to a terminal associated with an authenticating user that is authorized to authenticate the requesting user. The controller is configured to acquire, from the terminal, an authentication result indicating whether the authenticating user authenticates the requesting user to use the image forming apparatus.

Hereinafter, the image forming apparatus and the control method according to embodiments will be described with reference to the drawings. In the image forming apparatus according to the embodiment, even a user who is not set as an authentication target in advance can be authenticated.

FIG.1is a diagram illustrating a configuration example of an authentication system1000including an image forming apparatus100according to the embodiment. The authentication system1000includes the image forming apparatus100, an authenticating user database (DB) server200, and authenticating user personal computers (PCs)300-1, . . . ,300-n(n is an integer of 1 or more). In the following description, the authenticating user PCs300-1, . . . ,300-nwill be referred to as an authenticating user PC300unless otherwise distinguished. The authenticating user PC300is an example of a terminal used by an authenticating user.

The image forming apparatus100, the authenticating user DB server200, and the authenticating user PC300can communicate with each other via a network NW. The authenticating user DB server200is a server that stores an authenticating user DB as described later, but the image forming apparatus100may store the authenticating user DB, in which case the authenticating user DB server200is not needed.

In the authentication system1000described above, a requesting user who requests authentication for using the image forming apparatus100is imaged (e.g., an image of the requesting user is captured). A requesting user image indicating the requesting user obtained by imaging is transmitted to the authenticating user PC300used by the authenticating user who authenticates the requesting user. The requesting user image is displayed on the authenticating user PC300. The authenticating user determines whether to authenticate the requesting user using the displayed requesting user image. The authenticating user inputs an authentication result to the authenticating user PC300. The authenticating user PC300transmits the authentication result to the image forming apparatus100. The image forming apparatus100acquires the authentication result by the authenticating user. If the authentication result indicates that the authentication is accepted, the image forming apparatus100permits the requesting user to use the image forming apparatus100. If the authentication result indicates that the authentication is rejected, the image forming apparatus100does not permit the requesting user to use the image forming apparatus100.

FIG.2is an external diagram illustrating an example of the overall configuration of the image forming apparatus100according to the embodiment. The image forming apparatus100according to the embodiment is, for example, a multifunction machine, and has a copy function, a printer function, a scanner function, and a facsimile function.

The image forming apparatus100includes a control panel12, a scanner14, a printer16, a camera18, a sheet accommodation portion140, and a system controller1.

The printer16forms an image on a sheet using a developer, such as toner. The sheet is, for example, paper or label paper. Any kind of sheet may be used as long as the image forming apparatus100can form an image on the surface of the sheet.

The scanner14reads image information of a reading target based on brightness and darkness of light. The scanner14records the read image information in a main memory4of the system controller1. The recorded image information may be transmitted to another information processing apparatus via a network. The recorded image information may be image-formed on the sheet by the printer16.

The control panel12(e.g., a user interface or operator interface) includes a display and a plurality of buttons. The display is an image display device such as a liquid crystal display or an organic electro luminescence (EL) display. The display is provided with a touch panel. The display displays various pieces of information about the image forming apparatus100. The control panel12receives an operation of a user.

The sheet accommodation portion140accommodates sheets used for image formation in the printer16.

The printer16forms an image on the sheet based on image information generated by the scanner14or received via a communication path. The printer16forms an image by, for example, the following processing. An image forming unit of the printer16forms an electrostatic latent image on a photosensitive drum based on the image information. The image forming unit of the printer16forms a visible image by allowing the developer to adhere to the electrostatic latent image. A transfer unit of the printer16transfers the visible image onto the sheet. A fixing unit of the printer16fixes the visible image on the sheet by applying heat and pressure to the sheet. The sheet on which an image is formed may be a sheet accommodated in the sheet accommodation portion140or may be a manually fed sheet.

FIG.3is a block diagram illustrating a configuration of the system controller1, which is a control system of the image forming apparatus100according to the embodiment. InFIG.3, the system controller1includes a system LSI2, an image processing unit3, the main memory4, an HDD5, a ROM and/or RAM6, and an imaging controller7. The system controller1is also connected to the control panel12, the camera18, the scanner14, and the printer16.

The system LSI2is a chip called system on chip (SoC). The system LSI2includes an internal bus51capable of high speed communication. A memory controller9, a CPU10, a control panel controller11, and a serial advanced technology attachment (SATA) controller13are connected to the internal bus51. Furthermore, I/O controllers8,17, and20and a peripheral component interconnect express (PCIe) controller15are connected to the internal bus51.

The CPU10controls the overall operation of the image forming apparatus100. Specifically, the CPU10causes a control program stored in the ROM and/or RAM6to reside in the main memory4, and controls each unit based on the contents of the program. The memory controller9controls reading of a resident program from the main memory4, storing of image data in the main memory4, and reading of image data from the main memory4, according to an instruction from the CPU10. The main memory4has an area capable of storing image information for a plurality of pages, and can store image information from the scanner14for each page, for example.

The SATA controller13connects the system LSI2and the HDD5. The HDD5compresses and stores image data read by the scanner14and the like. The I/O controller8connects the system LSI2and the ROM and/or RAM6. The ROM6stores the control program and the like. The RAM6temporarily stores data.

The PCIe controller15connects the system LSI2and the image processing unit3. The image processing unit3performs compression processing and the like on image data output from the scanner14. The image processing unit3performs processing such as decompression of the image data and outputs the decompressed image data to the printer16.

The control panel controller11connects the system LSI2and the control panel12. The control panel controller11controls the control panel12according to an instruction from the CPU10. The control panel controller11includes an I/O controller and an LCD controller. The control panel controller11displays various pieces of information on the control panel12or outputs the operation contents of the user to the CPU10.

The I/O controller17connects the system LSI2and the imaging controller7. The imaging controller7is connected to the camera18. The camera18is an example of the imaging unit (e.g., an image sensor). The imaging controller7controls the camera18. Specifically, the imaging controller7instructs the camera18to image (e.g., generate image data of) a face of an approaching user according to an instruction from the CPU10. Specifically, in the present embodiment, the camera18images the requesting user who requests authentication for using the image forming apparatus100. Imaged face data (for example, a requesting user image) indicating the imaged face of the user is stored in the main memory4via the I/O controller17or the like.

FIG.4is a table illustrating an example of the authenticating user DB (e.g., an authenticating user database) stored in the authenticating user DB server200. The authenticating user DB is a database that stores information about authenticating users who authenticate requesting users. The authenticating user DB is configured with identification information, use authority, connection destination address, and status. The identification information is information that uniquely identifies the authenticating user. The use authority (herein sometimes simply referred to as “authority”) indicates authority granted to the authenticating user (e.g., which functions the authenticating user has authority or permission to perform or grant to a requesting user). Details of the authority will be described later. The connection destination address indicates information for connecting to the authenticating user PC, and is an IP address, for example.

The status indicates state information indicating whether the authenticating user is in a state of being available to authenticate the requesting user. In the present embodiment, “busy”, “available for response”, and “offline” are provided as statuses. “Busy” indicates that the authenticating user is currently busy with something and is having difficulty in performing authentication. “Available for response” indicates that authentication is currently possible. “Offline” indicates that the authenticating user PC cannot be connected, and in this case, the authenticating user cannot, of course, perform authentication. As the status, an authentication period other than the statuses described above may be provided. Examples of the authentication period include an authentication period such as “Authentication is possible until 1:00 p.m.” and “Authentication is possible from 3:00 p.m. to 5:00 p.m.”, or a period during which authentication is not possible.

The authority described above will be described. In the present embodiment, the authority that can be granted to the authenticating user includes “scan execution”, “copy execution”, “print execution”, and “user registration”. “Scan execution” is the authority to execute the scanner function of the image forming apparatus100. “Copy execution” is the authority to execute the copy function of the image forming apparatus100. “Print execution” is the authority to execute the printer function of the image forming apparatus100. “User registration” is the authority to newly register a user who uses the image forming apparatus100.

Therefore, a user to whom “scan execution” is granted can use the scanner function. A user to whom “copy execution” is granted can use the copy function. A user to whom “print execution” is granted can use the printer function. A user to whom “user registration” is granted can newly register a user who uses the image forming apparatus100.

In the authenticating user DB, the presence or absence of the four authorities described above is indicated by 4 bits. If the authority is granted, a bit corresponding to the authority is indicated by “1”, and if the authority is not granted, the bit corresponding to the authority is indicated by “0”. Description will be made in order from the lowermost bit to the uppermost bit of the 4 bits. The first bit indicates whether “scan execution” is granted. The second bit indicates whether “print execution” is granted. The third bit indicates whether “copy execution” is granted. The fourth bit indicates whether “user registration” is granted.

InFIG.4, for example, an authenticating user A is granted “scan execution” and “print execution”, but not “copy execution” and “user registration”. The authorities granted to such an authenticating user are related to the authorities granted to the requesting user authenticated by the authenticating user. Specifically, the use authority for the image forming apparatus100granted to the requesting user if the requesting user is authenticated (e.g., a first use authority) is within the use authority granted to the authenticating user who authenticates the requesting user (e.g., a second use authority). In other words, the use authority that the authenticating user can grant to the requesting user may be limited to the functions within the use authority of the authenticating user, and an authenticating user may not be able to grant permission to use a function outside of the authenticating user's use authority. Therefore, the authority granted to the requesting user authenticated by the authenticating user A is “scan execution” and “print execution”, only “scan execution”, or only “print execution”. The presence or absence of authority may be managed using a list of authorities without using bits.

Next, based on the configuration described above, an example of a screen displayed on the control panel12by the image forming apparatus100to the requesting user will be described.FIG.5is a diagram illustrating an example of a selection screen500displayed to the requesting user who requests authentication for using the image forming apparatus100. If the requesting user inputs a request to display a selection screen, the image forming apparatus100acquires the identification information, use authority, connection destination address, and status described with reference toFIG.4from the authenticating user DB server200.

As illustrated inFIG.5, the image forming apparatus100displays a plurality of candidates for the authenticating user based on the acquired respective pieces of information, and displays the selection screen from which the requesting user can select an authenticating user from the displayed candidates. In the case ofFIG.5, the image forming apparatus100selectably displays three authenticating users: person A; person B; and person C, based on the acquired identification information. Further, the image forming apparatus100displays the granted authority for each authenticating user in an authority field501, based on the acquired authority. Furthermore, the image forming apparatus100displays the status for each authenticating user in a status field502, based on the acquired status. In this manner, the image forming apparatus100displays status information indicating whether the authenticating user can be authenticated, together with the candidates of the authenticating user.

For example, inFIG.5, in the case of person C, “scan execution”, “print execution”, and “user registration” are displayed as the granted authorities, and the status is displayed as “available for response”.

As described above, since the display and the control panel12are configured as an integrated touch panel (e.g., a touchscreen), if the requesting user touches the area where a desired authenticating user is displayed, the image forming apparatus100can specify the selected authenticating user.

If the requesting user selects the authenticating user, the image forming apparatus100displays an authentication in-progress screen.FIG.6is a diagram illustrating an example of an authentication in-progress screen600. An authenticating user field601, an authentication in-progress display602, and an authenticating user image603are displayed in the example of the authentication in-progress screen600. The example of the authentication in-progress screen600illustrates an example of a screen if the requesting user selects person A as the authenticating user. The authenticating user field601allows the requesting user to check the authenticating user that the requesting user chooses. The authentication in-progress display602allows the requesting user to check that the authenticating user is in the process of authenticating their request. The authenticating user image603may be an image of the authenticating user prepared in advance, or may be a current image of the authenticating user imaged by a camera provided in the authenticating user PC300. If the return button is selected, the selection screen is displayed.

If the requesting user selects the authenticating user on the selection screen, the image forming apparatus100notifies the connection destination address of the authenticating user of an authentication request indicating that authentication is requested by the requesting user. When receiving the authentication request, the authenticating user PC300displays an authentication acceptance and rejection screen.FIG.7is a diagram illustrating an example of an authentication acceptance and rejection screen700displayed on the authenticating user PC300. As represented in the example of the authentication acceptance and rejection screen700, an authority list701, a requesting user image702, an authentication button703, and a rejection button704are displayed on the authentication acceptance and rejection screen.

The authority list701is a list that indicates the authorities granted to the requesting user. By checking a checkbox, the authenticating user can grant the authority to be granted to the requesting user within the authority granted to the authenticating user. The requesting user image702is a requesting user image. The requesting user image702is an image indicating a current requesting user acquired by the camera18of the image forming apparatus100. The authenticating user PC300may display the requesting user image702in real time, or may periodically update the requesting user image702every predetermined timing (for example, 0.5 ms). Accordingly, an updated requested user image may be periodically captured by the camera18and transferred to the authenticating user PC. Alternatively, the authenticating user PC300may receive a still image imaged immediately before transmitting the authentication request and display the still image.

The authentication button703is a button that the authenticating user presses to authenticate the requesting user. If the authentication button703is pressed, the authenticating user PC300notifies the image forming apparatus100of the fact that the authentication is accepted as an authentication result OK. The rejection button704is a button that the authenticating user presses when rejecting the authentication of the requesting user. If the rejection button704is pressed, the authenticating user PC300notifies the image forming apparatus100of the fact that the authentication is rejected as an authentication result NG.

If the authentication result is acquired, the image forming apparatus100displays an authentication result screen corresponding to the authentication result. If the authentication result OK is acquired, an authentication OK screen is displayed.FIG.8is a diagram illustrating an example of an authentication OK screen800. As represented in the example of the authentication OK screen800, an authenticating user field801, an authentication result display802, an authority field803, an authenticating user image804, and a login button805are displayed on the authentication OK screen.

The example of the authentication OK screen800illustrates an example of a screen if the requesting user selects person A as the authenticating user. The authenticating user field801allows the requesting user to check the authenticating user that the requesting user chooses. The requesting user can check that the authentication is accepted by “authentication is accepted” represented in the authentication result display802. The authority field803indicates the authority granted to the requesting user. The authenticating user image804may be an image of the authenticating user prepared in advance, or may be a current image of the authenticating user imaged by the camera provided in the authenticating user PC300. The login button805is a button for the requesting user to log in to the image forming apparatus100. If the return button is selected, the selection screen is displayed. If the login button805is pressed, the image forming apparatus100allows the requesting user to log in with the granted authority. With this configuration, the requesting user can use the image forming apparatus100.

If the authentication result NG is acquired, an authentication NG screen is displayed.FIG.9is a diagram illustrating an example of an authentication NG screen900. As represented in the example of the authentication NG screen900, an authenticating user field901, an authentication result display902, and an authenticating user image804are displayed on the authentication NG screen. Unlike the authentication OK screen, an authority field and a login button are not displayed on the authentication NG screen.

The example of the authentication NG screen example 900 illustrates an example of a screen if the requesting user selects person A as the authenticating user. The authenticating user field901allows the requesting user to check the authenticating user that the requesting user chooses. The requesting user can check that the authentication is rejected by “authentication is rejected” represented in the authentication result display902. The authenticating user image904may be an image of the authenticating user prepared in advance, or may be a current image of the authenticating user imaged by the camera provided in the authenticating user PC300. If the return button is selected, the selection screen is displayed.

FIG.10is a flow chart illustrating a flow of a process of the image forming apparatus100. The process illustrated inFIG.10is executed by the system controller1of the image forming apparatus100. InFIG.10, the image forming apparatus100displays the selection screen (seeFIG.5) if the requesting user inputs a request to display the selection screen (ACT101). If the requesting user selects the authenticating user (YES in ACT102), the image forming apparatus100makes a notification of an authentication request (ACT103). A notification destination is the authenticating user PC300having a connection destination address corresponding to the selected authenticating user.

The image forming apparatus100determines whether the authentication result OK is acquired (ACT104). If the authentication result OK is acquired (YES in ACT104), the image forming apparatus100displays the authentication OK screen (seeFIG.8) (ACT105), and ends the process. If the authentication result OK is not acquired (NO in ACT104), the image forming apparatus100determines whether the authentication result NG is acquired (ACT106). If the authentication result NG is acquired (YES in ACT106), the image forming apparatus100displays the authentication NG screen (seeFIG.9) (ACT107), and ends the process. If the authentication result NG is not acquired (NO in ACT106), the image forming apparatus100returns to ACT104.

FIG.11is a flow chart illustrating a flow of a process of the authenticating user PC300. InFIG.11, if the authentication request is received from the image forming apparatus100(ACT201), the authenticating user PC300displays the authentication acceptance and rejection screen (seeFIG.7) (ACT202). The authenticating user PC300determines whether the authentication button703is pressed (ACT203). If the authentication button703is pressed (YES in ACT203), the authenticating user PC300makes a notification of the authentication result OK (ACT204), and ends the process. The notification destination is the image forming apparatus100that transmits the authentication request.

If the authentication button703is not pressed (NO in ACT203), the authenticating user PC300determines whether the rejection button704is pressed (ACT205). If the rejection button704is pressed (YES in ACT205), the authenticating user PC300makes a notification of the authentication result NG (ACT206), and ends the process. The notification destination is the image forming apparatus100that transmits the authentication request. If the rejection button704is not pressed (NO in ACT205), the authenticating user PC300returns to ACT203.

In the embodiment described above, the image of the requesting user is displayed on the authenticating user PC300, but instead of or in addition to displaying the image of the requesting user, a voice call between the requesting user and the authenticating user may be enabled. By displaying an image and a voice call, more rigorous authentication can be performed. A text input may be received from the control panel12. In this case, for example, by allowing the requesting user to input attributes such as date of birth and affiliation and transmitting the attributes to the authenticating user PC300, the authenticating user can check and authenticate the input contents. In the case of authentication using only text input, a camera is not needed for the image forming apparatus100, and thus the configuration of the image forming apparatus100can be simplified.

If there is only one authenticating user, only one authenticating user may be displayed on the selection screen (seeFIG.5), but the authentication in-progress screen (seeFIG.6) may be displayed without displaying the selection screen.

According to the embodiments described above, a user who is not set as the authentication target in advance can also be authenticated.