Information processing device, portable terminal, control device, and non-transitory computer readable medium

An information processing device includes a retaining unit and an image display. The retaining unit retains image-formation-related information of an image forming apparatus that forms an image. The image display causes a display section of a portable terminal having the display section and an image capturing section to display an image for assisting with an operation of the image forming apparatus based on a captured image result of the image capturing section and the image-formation-related information retained in the retaining unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2016-160219 filed Aug. 17, 2016 and Japanese Patent Application No. 2016-164982 filed Aug. 25, 2016.

BACKGROUND

Technical Field

The present invention relates to information processing devices, mobile terminals, control devices, and non-transitory computer readable media.

SUMMARY

According to an aspect of the invention, there is provided an information processing device including a retaining unit and an image display. The retaining unit retains image-formation-related information of an image forming apparatus that forms an image. The image display causes a display section of a portable terminal having the display section and an image capturing section to display an image for assisting with an operation of the image forming apparatus based on a captured image result of the image capturing section and the image-formation-related information retained in the retaining unit.

DETAILED DESCRIPTION

An exemplary embodiment of the present invention will be described below with reference to the appended drawings.

Configuration of Image Forming System

FIG. 1illustrates an example of the overall configuration of an image forming system1according to an exemplary embodiment.

As shown inFIG. 1, the image forming system1according to this exemplary embodiment includes a print server3that manages, for example, a print job, which is a process based on a print command (i.e., output command), and an image forming apparatus5that serves as an example of a target object to be operated by an operator and that executes a printing process (i.e., image forming process) on continuous paper S under the control of the print server3. The image forming system1also includes a wearable terminal7that is used by being worn by the operator who performs various types of operations on the image forming apparatus5and that serves as an example of a portable terminal displaying, for example, an operational assistance image for assisting with the various types of operations performed by the operator.

In the image forming system1, the print server3, the image forming apparatus5, and the wearable terminal7are connected to one another in a communicable manner via, for example, a wireless communication line.

Configuration of Image Forming Apparatus

FIG. 2illustrates the internal structure of the image forming apparatus5according to this exemplary embodiment. The image forming apparatus5according to this exemplary embodiment forms an image onto the transported continuous paper S. In the image forming apparatus5according to this exemplary embodiment, the continuous paper S is transported at a high speed of, for example, about 100 meters per minute so as to allow for high-speed printing of several thousands of pages per minute. The continuous paper S in this exemplary embodiment refers to paper that is continuous in the transport direction in the image forming apparatus5. The continuous paper S may be, for example, perforated or folded so long as it is continuous in the transport direction.

As shown inFIGS. 1 and 2, the image forming apparatus5is a combination of multiple devices. Specifically, the image forming apparatus5includes a first image forming device51that forms an image onto one face of the continuous paper S and a second image forming device52that forms an image onto one face or the other face of the continuous paper S on which the image is formed by the first image forming device51. The image forming apparatus5also includes a paper feeding device53that feeds the continuous paper S to the first image forming device51and a collecting device54that collects the continuous paper S by winding it up after the image is formed thereon by the second image forming device52. Furthermore, the image forming apparatus5includes an inverting device55that inverts the front and rear faces of the continuous paper S, where appropriate, having the image formed thereon by the first image forming device51and transports the continuous paper S to the second image forming device52. Moreover, the image forming apparatus5includes multiple relay units (not shown) that relay between the paper feeding device53and the first image forming device51, between the first image forming device51and the inverting device55, between the inverting device55and the second image forming device52, and between the second image forming device52and the collecting device54.

The image forming apparatus5includes a display panel56(seeFIG. 1) that receives an operation input by the operator and displays information to the operator, and also includes a controller60(seeFIG. 5to be described later) as an example of a control device that controls the operation of each device in the image forming apparatus5and that communicates with the print server3.

As shown inFIGS. 1 and 2, the first image forming device51includes a first image forming unit511that forms an image onto one face of the transported continuous paper S and a first drying unit512that dries the continuous paper S having the image formed thereon by the first image forming unit511. Furthermore, the first image forming device51includes multiple transport rollers513that transport the continuous paper S. Moreover, the first image forming device51includes an operation panel515that receives an operation when, for example, the operator loads the continuous paper S into the first image forming device51. The first image forming device51also includes a housing516that accommodates, for example, the first image forming unit511, the first drying unit512, and the transport rollers513. As shown inFIG. 1, the housing516has an openable-closable door516athat may be opened by, for example, the operator when loading the continuous paper S.

The first image forming unit511forms an image onto the continuous paper S in accordance with a so-called inkjet method. Specifically, the first image forming unit511has an inkjet head (not shown) having multiple nozzles that eject ink therefrom as liquid droplets.

The first drying unit512heats the ink ejected on the continuous paper S by the first image forming unit511so as to dry the ink. Specifically, the first drying unit512includes a heater (not shown) that generates heat by being supplied with electricity.

The second image forming device52has a configuration similar to that of the first image forming device51. Specifically, the second image forming device52includes a second image forming unit521that has an inkjet head and that forms an image onto the continuous paper S in accordance with the so-called inkjet method, and also includes a second drying unit522that heats ink ejected on the continuous paper S by the second image forming unit521so as to dry the ink. The second image forming device52also includes multiple transport rollers523that transport the continuous paper S. Furthermore, the second image forming device52includes an operation panel525that receives an operation when, for example, the operator loads the continuous paper S into the second image forming device52. The second image forming device52also includes a housing526that has an openable-closable door526aand that accommodates, for example, the second image forming unit521, the second drying unit522, and the transport rollers523.

The paper feeding device53feeds the roll-wound continuous paper S to the first image forming device51via a replay unit while unwinding the continuous paper S. The paper feeding device53includes a rotatable roller member531that supports the roll-wound continuous paper S and also includes multiple transport rollers532that transport the continuous paper S unwound from the roller member531toward the first image forming device51. Furthermore, the paper feeding device53includes an operation panel535that receives an operation performed by the operator when feeding the continuous paper S. Moreover, the paper feeding device53also includes a housing536that has an openable-closable door536aand that accommodates the roller member531, the transport rollers532, and the continuous paper S supported by the roller member531.

The collecting device54collects the continuous paper S having the image formed thereon by the second image forming device52while winding up the continuous paper S into the shape of a roll. Specifically, the collecting device54includes a rotatable roller member541that winds up the continuous paper S into the shape of a roll and also includes multiple transport rollers542that transport the continuous paper S released from the second image forming device52toward the roller member541. Furthermore, the collecting device54includes an operation panel545that receives an operation when the operator loads the continuous paper S into the collecting device54. Moreover, the collecting device54also includes a housing546that has an openable-closable door546aand that accommodates the roller member541, the transport rollers542, and the continuous paper S supported by the roller member541.

In the image forming apparatus5according to this exemplary embodiment, the paper feeding device53feeds the roll-wound continuous paper S while unwinding it, and the collecting device54collects the continuous paper S while winding it up into the shape of a roll. Alternatively, the type of continuous paper S is not limited to this. For example, continuous paper S accordion-folded along perforations may be fed while being unfolded by the paper feeding device53, and may be collected while being accordion-folded along the perforations by the collecting device54.

The inverting device55inverts the front and rear faces of the continuous paper S, where appropriate, having an image formed thereon by the first image forming device51and transports the continuous paper S to the second image forming device52. The inverting device55includes multiple inverting rollers (i.e., a first inverting roller551to a fifth inverting roller555, seeFIG. 3to be described below) that guide the continuous paper S.

FIG. 3illustrates the internal structure of the inverting device55according to this exemplary embodiment and corresponds to the diagram of the inverting device55shown inFIG. 2, as viewed from the direction of arrow III.

As described above, the inverting device55according to this exemplary embodiment includes five inverting rollers (i.e., the first inverting roller551to the fifth inverting roller555) that guide the continuous paper S and that invert the front and rear faces of the continuous paper S, where appropriate. Specifically, the inverting device55includes the first inverting roller551that guides the continuous paper S released from the first image forming device51(seeFIG. 1) toward the downstream side, and also includes the second inverting roller552around which the continuous paper S guided by the first inverting roller551is wound so as to change the traveling direction of the continuous paper S by 90°. Furthermore, the inverting device55includes the third inverting roller553around which the continuous paper S guided by the second inverting roller552is wound so as to change the traveling direction of the continuous paper S by 180°, and also includes the fourth inverting roller554around which the continuous paper S guided by the third inverting roller553is wound so as to change the traveling direction of the continuous paper S by 90°. Moreover, the inverting device55includes the fifth inverting roller555that transports the continuous paper S guided by the fourth inverting roller554toward the second image forming device52(seeFIG. 2).

As shown inFIG. 2, in the image forming apparatus5according to this exemplary embodiment, the first image forming device51, the second image forming device52, the paper feeding device53, the collecting device54, and the inverting device55are each provided with a mark M that is visually recognizable at the wearable terminal7by the operator and that is used for specifying a region (unit) of the image forming apparatus5.

In the image forming apparatus5, the marks M are provided inside the housings of the individual devices. For example, in the first image forming device51, a mark M attached to each unit is provided inside the housing516. When the openable-closable door516aof the housing516is opened, the marks M are exposed to the outside so as to be visually recognizable.

In the image forming system1according to this exemplary embodiment, a unit of the image forming apparatus5visually recognized by the operator is specified by detecting and analyzing an image of a mark M captured by an image capturing section72of the wearable terminal7. Units of the image forming apparatus5in this exemplary embodiment refer to component units of the image forming apparatus5that are differentiated from one another based on the functions and positions thereof. For example, the units of the image forming apparatus5correspond to the first image forming device51, the second image forming device52, the paper feeding device53, the collecting device54, the inverting device55, and the relay units.

Although a unit visually recognized through the wearable terminal7by the user is specified based on a unit included in an image captured by the image capturing section (i.e., based on an analysis result of the image captured by the image capturing section72) in this example, the unit may be specified by another method. For example, an ID (identification information) may be given to each unit and be transmitted to the wearable terminal7by using Bluetooth (registered trademark) Low Energy (BLE), and the unit may be specified by reading the ID of the unit by using a sensor.

Configuration of Wearable Terminal

FIG. 4schematically illustrates the configuration of the wearable terminal7according to this exemplary embodiment. As shown inFIG. 4, the wearable terminal7according to this exemplary embodiment has the shape of eyeglasses in its entirety and is used by being worn on the head of the operator.

The wearable terminal7includes lens sections71provided at positions corresponding to the left and right eyes of the operator when worn, the image capturing section72that captures an image of an entire or partial region visually recognized through the lens sections71by the operator, and display sections73that display an image over the view visually recognized through the lens sections71by the operator. The wearable terminal7also includes an operation receiving section74that receives an operation performed by the operator. Furthermore, the wearable terminal7includes a controller80(seeFIG. 5to be described later) that controls each unit.

The image capturing region of the image capturing section72may be larger than the region visually recognized through the lens sections71by the operator so that a larger amount of information is acquired, or the image capturing region of the image capturing section72may be smaller than the region visually recognized through the lens sections71by the operator so that detailed information is acquired.

The lens sections71are composed of a material having optical transparency. Thus, the operator wearing the wearable terminal7may visually recognize the front view through the lens sections71.

The image capturing section72is constituted of a compact camera, such as a charge coupled device (CCD) camera, and is provided adjacent to one of the lens sections71so as to be oriented in the direction of the line of vision of the operator wearing the wearable terminal7. The image capturing section72captures a moving image of the view visually recognized through the lens sections71by the operator and outputs the captured moving image to the controller80.

The display sections73are formed to overlap the lens sections71and are composed of a material having optical transparency when an image is not displayed thereon. Based on display control performed by the controller80, the display sections73display an image over the view (i.e., actual image) visually recognized through the lens sections71by the operator.

The operation receiving section74is constituted of a microphone that receives sound released by the operator and receives various types of operations performed on the wearable terminal7based on the sound released by the operator.

Functional Configuration of Image Forming System

FIG. 5is a block diagram illustrating a functional configuration of the image forming system1according to this exemplary embodiment.

As shown inFIG. 5, the print server3according to this exemplary embodiment includes a communication controller31that controls communication with the controller80of the wearable terminal7and the controller60of the image forming apparatus5. Furthermore, the print server3includes a polling unit33as an example of an acquiring unit that executes a polling operation on the image forming apparatus5based on information acquired from the controller80of the wearable terminal7via the communication controller31. Moreover, the print server3also includes an information storage unit35as an example of a retaining unit that stores, for example, information (i.e., device-status setting information, which will be described later) acquired as a result of the polling operation performed by the polling unit33and print-job-related information (i.e., operational information related to an image forming operation). Furthermore, the print server3includes an apparatus controller37that controls a printing operation performed in the image forming apparatus5.

The communication controller31acquires an item list that is related to the device statuses in the image forming apparatus5and that is output from the controller80of the wearable terminal7. Furthermore, the communication controller31outputs information, such as the device-status setting information acquired as a result of the polling operation performed by the polling unit33, to the controller80of the wearable terminal7. In the wearable terminal7, an image is displayed on the display sections73based on the information output from the communication controller31. This will be described in detail later. In other words, the communication controller31according to this exemplary embodiment functions as an image display that causes the display sections73of the wearable terminal7to display an image.

The polling unit33communicates with the controller60of the image forming apparatus5so as to sequentially acquire device-status-related setting information listed in the device-status-related item list.

The information storage unit35stores the device-status-related setting information acquired by the polling unit33and updates the setting information, where appropriate.

The apparatus controller37controls the printing operation in the image forming apparatus5based on a print job output by, for example, a client terminal (not shown).

The device statuses in the image forming apparatus5will be described later.

The controller80of the wearable terminal7includes a moving-image analyzer81that analyzes the moving image captured by the image capturing section72. The controller80of the wearable terminal7includes a list creating unit83that creates an item list related to information (i.e., the device statuses to be described later) necessary for creating an image to be displayed on the display sections73based on the analysis result obtained by the moving-image analyzer81. Moreover, the controller80of the wearable terminal7includes an image generating unit85that generates an assistance image for assisting the operator in operating each unit of the image forming apparatus5. Furthermore, the wearable terminal7includes a display controller87that controls the display sections73so as to make the display sections73display the assistance image generated by the image generating unit85. The controller80of the wearable terminal7also includes a communication controller89that controls communication with the print server3.

The moving-image analyzer81has a mark detector811that detects a mark M included in the moving image, which is a captured image result, captured by the image capturing section72and a unit specifying unit813that specifies a unit of the image forming apparatus5, which is image-captured by the image capturing section72, based on the mark M detected by the mark detector811.

The list creating unit83has a status storage unit831that stores information related to items of the statuses of the devices belonging to the image forming apparatus5(i.e., the statuses of units constituting the first image forming device51, the second image forming device52, the paper feeding device53, the collecting device54, and the inverting device55in this exemplary embodiment), and also has a status selecting unit833that selects a device status item related to a unit, which is specified by the unit specifying unit813of the moving-image analyzer81, from device status items stored in the status storage unit831based on the specified unit.

The image generating unit85has an image retaining unit851that retains image data related to an assistance image for assisting with an operation of each unit of the image forming apparatus5, and also has an image composing unit853that composes the image data retained in the image retaining unit851based on the device-status setting information output from the print server3so as to generate the assistance image related to the specified unit.

The display controller87causes the display sections73to display the assistance image generated by the image generating unit85over the view visually recognized through the lens sections71of the wearable terminal7by the operator.

The communication controller89outputs the device-status-related item list created by the list creating unit83to the print server3. Moreover, the communication controller89acquires the device-status setting information output from the print server3.

In the controller80according to this exemplary embodiment, the list creating unit83and the communication controller89constitute a requesting unit that requests the print server3to output the device-status setting information.

Because the image forming apparatus5is large in size in the image forming system1according to this exemplary embodiment, the path along which the continuous paper S is guided is long. For example, when loading the continuous paper S into the image forming apparatus5, the operator has to perform this operation while moving around the image forming apparatus5instead of performing the operation at a single location. Moreover, because the image forming apparatus5has a complicated structure and the loading operation of the continuous paper S is also complicated, for example, there is a high possibility that an inexperienced operator may perform the operation erroneously.

Furthermore, the loading operation of the continuous paper S may vary depending on, for example, the settings of the image forming apparatus5or the print job to be performed in the image forming apparatus5. However, it is difficult for the operator to constantly ascertain the settings of the image forming apparatus5or the print job to be performed in the image forming apparatus5. Therefore, it is difficult for the operator to determine whether there is an error in the contents of the operation performed by the operator or an error in the operation. For example, there is a possibility that the image forming apparatus5may start performing an image forming operation in a state where there is an error in the loading operation of the continuous paper S. This is not desirable since the continuous paper S may be cut and the loading operation of the continuous paper S may have to be performed again in the image forming apparatus5.

In contrast, in the image forming system1according to this exemplary embodiment, the display sections73of the wearable terminal7worn by the operator display information related to the operation for loading the continuous paper S into the image forming apparatus5and information related to the device settings set in the image forming apparatus5based on the information retained by the print server3. Thus, the operator may perform the operation while referring to the information displayed on the display sections73of the wearable terminal7, thereby reducing an erroneous operation.

A process performed in the image forming system1according to this exemplary embodiment will be described in detail below. The process performed in the image forming system1to be described below is realized as a result of software and hardware resources operating in cooperation with each other. Specifically, central processing units (CPUs) within control computers provided in the wearable terminal7and the print server3execute programs for realizing the functions of the wearable terminal7and the print server3, so that these functions are realized.

Process in Wearable Terminal

First, a process performed by the controller80of the wearable terminal7will be described.FIG. 6is a flowchart illustrating the process performed by the controller80of the wearable terminal7according to this exemplary embodiment.

When the wearable terminal7is activated by the operator, the image capturing section72starts an image capturing process in step S101. As mentioned above, in the wearable terminal7according to this exemplary embodiment, an image of the view visually recognized through the lens sections71by the operator wearing the wearable terminal7is captured as a moving image by the image capturing section72.

In step S102, the moving image captured by the image capturing section72is output to the moving-image analyzer81.

In step S103, the mark detector811in the moving-image analyzer81detects a mark M from the moving image captured by the image capturing section72. If a mark M is not detectable from the moving image (NO in step S103), the process returns to step S101so as to continuously perform the image capturing process by the image capturing section72, the output of the moving image, and the detection of a mark M.

If a mark M is detected by the mark detector811(YES in step S103), the unit specifying unit813specifies a unit of the image forming apparatus5included in the moving image captured by the image capturing section72in step S104based on the detected mark M. Specifically, the mark M detected by the mark detector811is image-analyzed. Then, it is specified whether any of the units of the image forming apparatus5is included in the moving image captured by the image capturing section72based on the type (e.g., shape, color, and pattern) of the mark M. In this example, any of the first image forming device51, the second image forming device52, the paper feeding device53, the collecting device54, and the inverting device55is specified as a unit based on the type of the mark M.

Subsequently, in step S105, an item list related to device statuses in the image forming apparatus5with respect to the unit specified in step S104is created by the list creating unit83. The term “device statuses in the image forming apparatus5” in this exemplary embodiment refers to information about the image forming apparatus5set with respect to the components constituting the image forming apparatus5, the functions that the image forming apparatus5has, and conditions for a print job to be executed in the image forming apparatus5. As mentioned above, the image forming apparatus5according to this exemplary embodiment is constituted of multiple devices (i.e., the first image forming device51, the second image forming device52, the paper feeding device53, the collecting device54, and the inverting device55). Therefore, the image forming apparatus5according to this exemplary embodiment has a large number (e.g., about several thousands) of device statuses. Examples of device statuses in the image forming apparatus5include the temperatures and the rotational speeds of the individual components, the enabled/disabled statuses of functions of the components, and the size (width) of the continuous paper S in a print job, but are not limited thereto in particular.

In step S105, the list creating unit83selects a device status related to the unit specified in step S104from among the multiple device statuses in the image forming apparatus5and creates a device-status-related item list. In other words, in step S105, the list is created by selecting a device status necessary for creating an assistance image related to the unit specified in step S104from among the multiple device statuses in the image forming apparatus5.

In step S106, the device-status-related item list created in step S105is output to the print server3by the communication controller89.

Upon acquiring the device-status-related item list from the controller80(i.e., the communication controller89) of the wearable terminal7, the print server3executes polling on the image forming apparatus5based on the device-status-related item list. This will be described in detail later. Thus, the print server3acquires setting information set with respect to the respective device statuses in the item list and outputs the acquired setting information to the controller80of the wearable terminal7.

Then, in step S107, the communication controller89determines whether or not the device-status-related setting information output from the print server3is received. If the device-status-related setting information is not received (NO in step S107), the communication controller89waits until the device-status-related setting information is received.

If the device-status-related setting information is received (YES in step S107), the image generating unit85generates an image to be displayed on the display sections73in step S108based on the received device-status-related setting information. In step S108, the image generating unit85generates an assistance image for assisting with an operation of the unit specified in step S102based on the received device-status-related setting information. More specifically, based on the device-status-related setting information, image data related to the unit specified in step S102is selected from the image data retained in the image retaining unit851of the image generating unit85. Then, the image data is composed by the image composing unit853so that an assistance image is generated. Although a specific example of the assistance image will be described later, examples of the assistance image include a guide image P1(seeFIG. 8Ato be described later) used as guidance for loading the continuous paper S in the specified unit and an image P2(seeFIG. 8Ato be described later) related to setting information related to an operation of the unit.

In step S109, the display controller87causes the display sections73to display the image generated by the image generating unit85.

Accordingly, the sequential process in the controller80of the wearable terminal7is completed.

Process in Print Server

Next, a process performed by the print server3will be described.FIG. 7is a flowchart illustrating the process performed by the print server3according to this exemplary embodiment.

First, in step S201, the print server3determines whether or not the device-status-related item list of the image forming apparatus5is acquired from the controller80of the wearable terminal7in step S106described above.

If the device-status-related item list is acquired from the controller80of the wearable terminal7(YES in step S201), a polling operation on the image forming apparatus5commences in step S202based on the acquired device-status-related item list.

Specifically, the polling unit33communicates with the controller60of the image forming apparatus5for a predetermined time period (e.g., several milliseconds). Then, the setting information set in the image forming apparatus5is sequentially acquired with respect to each of the device statuses in the device-status-related item list.

In step S203, it is determined whether or not the polling (i.e., the acquisition of the device-status-related setting information) by the polling unit33is performed for the first time.

If the acquisition of the device-status-related setting information by the polling unit33is performed for the first time (YES in step S203), the device-status-related setting information is stored into the information storage unit35in step S204. Then, in step S205, the communication controller31outputs the device-status-related setting information stored in the information storage unit35to the controller80of the wearable terminal7.

If the acquisition of the device-status-related setting information by the polling unit33is performed for the second time or onward (NO in step S203), it is determined in step S206whether or not the device-status-related setting information acquired in step S202has changed from the device-status-related setting information acquired as a result of the previous polling operation and stored in the information storage unit35.

Then, if the device-status-related setting information has changed (YES in step S206), the process proceeds to step S207where the device-status-related setting information stored in the information storage unit35is updated to the device-status-related setting information newly acquired in step S202. Then, in step S205, the communication controller31outputs the updated device-status-related setting information to the controller80of the wearable terminal7.

If the device-status-related setting information has not changed (NO in step S206), the updating and outputting of the device-status-related setting information are not performed, and the sequential process in the print server3ends.

Image Displayed on Display Sections

Next, an example of an assistance image displayed on the display sections73will be described.FIGS. 8A to 8Cillustrate examples of assistance images displayed on the display sections73of the wearable terminal7. Specifically,FIGS. 8A to 8Cillustrate examples of assistance images generated by the image generating unit85in step S108described above and displayed on the display sections73by the display controller87in step S109.

As shown inFIG. 8A, in this exemplary embodiment, the assistance images displayed include the guide image P1used as guidance for an operation of the unit specified in step S102and the image P2of the setting information related to the operation of the unit included in the device-status-related setting information received in step S107.

Examples of the image P2of the setting information related to the operation of the unit include information related to the settings of components constituting the unit, information related to enabled/disabled statuses of the functions that the unit has, and information with respect to the components constituting the unit and an error in the operation performed on the unit.

In this example, information related to B status, D status, A counter, B error, and E error is displayed as the setting information P2related to the operation of the unit.

FIGS. 8B and 8Cillustrate examples of guide images P1displayed on the display sections73. In this exemplary embodiment, different guide images P1are composed in accordance with the device-status-related setting information received in step S107described above. A composed guide image P1is displayed in the display sections73over the view visually recognized through the lens sections71by the operator.

For example, in the image forming apparatus5according to this exemplary embodiment, the method of loading the continuous paper S to a roller member (e.g., the transport rollers513of the first image forming device51, the transport rollers523of the second image forming device52, and the inverting rollers551to555of the inverting device55) varies depending on the width of the continuous paper S.

Therefore, in this exemplary embodiment, a different image is displayed as the guide image P1used as guidance for loading the continuous paper S to the roller members (i.e., the transport roller513of the first image forming device51in this example) in accordance with information related to the width of the continuous paper S included in the device-status-related setting information received in step S107.

For example, in a case where setting information indicating that the width of the continuous paper S used in image formation is “half width” is received as the device-status-related setting information, the guide image P1shown inFIG. 8Bis displayed. Specifically, in the case where the width of the continuous paper S is the half width, the guide image P1is displayed such that the continuous paper S is wound around the transport roller513from the lower side thereof (i.e., the far side ofFIG. 8B) to the upper side (i.e., the near side ofFIG. 8B) thereof, and the traveling direction of the continuous paper S is subsequently changed by 90° so as to be guided leftward, as shown inFIG. 8B.

In a case where setting information indicating that the width of the continuous paper S used in image formation is “full width” is received as the device-status-related setting information, the guide image P1shown inFIG. 8Cis displayed. Specifically, in the case where the width of the continuous paper S is the full width, the guide image P1is displayed such that the continuous paper S is extended below the transport roller513(i.e., at the far side ofFIG. 8C) from right to left, as shown inFIG. 8C.

Accordingly, in this exemplary embodiment, the image displayed on the display sections73is changed in accordance with the device-status-related setting information received from the print server3. Thus, the operator performing the operation for loading the continuous paper S into the image forming apparatus5may perform the operation while referring to the image displayed on the display sections73of the wearable terminal7even when, for example, not referring to a manual. As a result, even with a complicated operation, such as the loading operation of the continuous paper S, the operation may be performed readily, as compared with a case where this configuration is not employed. In addition, by performing the operation while referring to the image displayed in accordance with the device-status-related setting information received from the print server3, an erroneous operation in the image forming apparatus5may be reduced.

In the examples shown inFIGS. 8A to 8C, the image displayed on the display sections73is changed in accordance with the width of the continuous paper S as the device-status-related setting information. Alternatively, for example, the image displayed on the display sections73may be changed in accordance with a combination of multiple pieces of device-status-related setting information.

This exemplary embodiment may achieve reduced traffic and increased speed when generating an assistance image (AR image) to be displayed on the display sections73.

When displaying the assistance image, image data (i.e., an original image serving as a source of the assistance image) is generated by combining image data (including a three-dimensional model, such as polygonal data, and icon data) and font data. Moreover, in addition to the image data and the font data, information (image-formation-related information), such as the setting information of the image forming apparatus5and the setting information of a print job to be output from the image forming apparatus5, is used.

Meanwhile, when these images and information are managed by being distributed to multiple devices, the communication traffic increases. Moreover, the intervention of communication leads to lower image-generating speed.

In contrast, in this exemplary embodiment of the present invention, information, such as the image data and the font data for generating the assistance image as well as the setting information of the print job, is temporarily stored in the print server3, and these pieces of information are centrally managed. Thus, reduction in the communication traffic and reduction in the image-generating speed caused by communication are suppressed. In other words, traffic may be reduced or the processing time may be shortened, as compared with a case where the assistance-image-related information is managed by multiple devices connected to one another via a network. The term “network” refers to a common network, such as the Internet or an intranet, but does not include communication via a dedicated connection line.

As shown inFIG. 8Adescribed above, the error-related information is displayed on the display sections73of the wearable terminal7as the setting-information image P2related to an operation of the unit. In the image forming system1according to this exemplary embodiment, when an error occurs in the image forming apparatus5and the error-related information is displayed as the setting-information image P2on the display sections73of the wearable terminal7, the error may be removed in accordance with an operation performed on the operation receiving section74(seeFIG. 4) by the operator.

FIGS. 9A to 9Cillustrate examples of images displayed on the display sections73of the wearable terminal7when an error occurs in the image forming apparatus5. Specifically,FIGS. 9A to 9Cillustrate examples of assistance images generated by the image generating unit85in step S108described above and displayed on the display sections73by the display controller87in step S109.

In the example shown inFIG. 9A, the aforementioned guide image P1and the setting-information image P2related to an operation of the unit are displayed as assistance images for assisting with the operation performed by the operator. Furthermore, in the example shown inFIG. 9A, an operation menu image P3operable by the operator is also displayed.

In this example, B error and E error have occurred in the image forming apparatus5. As shown inFIGS. 9A, B error information and E error information are displayed as the setting-information image P2based on the device-status-related setting information received in step S107described above. Moreover, as shown inFIG. 9A, a reset section P31for resetting the errors is displayed as the operation menu image P3.

In this exemplary embodiment, when B error and E error that have occurred in the image forming apparatus5are physically removed based on an operation performed on the image forming apparatus5by the operator, the reset section P31in the operation menu image P3becomes selectable, as shown inFIG. 9B.

When the reset section P31is selected based on an operation performed on the operation receiving section74by the operator, B error and E error are removed. Specifically, the communication controller89in the controller80of the wearable terminal7provides an error-removal-related notification to the print server3. Thus, B-error-related information and E-error-related information in the device-status-related setting information stored in the information storage unit35of the print server3are updated. As a result, B error and E error in the image forming apparatus5are removed.

When B error and E error in the image forming apparatus5are removed and the device-status-related setting information is updated, the image displayed on the display sections73of the wearable terminal7is changed accordingly.

Specifically, as shown inFIG. 9C, the B error item and the E error item previously displayed as the setting-information image P2are deleted. Moreover, the reset section P31item is deleted from the operation menu image P3.

Accordingly, in the image forming system1according to this exemplary embodiment, when an error occurs in the operation of the image forming apparatus5, the error may be removed based on an operation performed on the wearable terminal7. Thus, for example, it is not necessary to perform an error removing operation using the display panel56of the image forming apparatus5after the error is physically removed in the image forming apparatus5. Consequently, this may allow for reduced wasteful movement of the operator and may achieve improved ease of operation of the image forming apparatus5.

In the wearable terminal7according to this exemplary embodiment, the guide image P1is displayed on the display sections73to overlap the view visually recognized through the lens sections71by the operator wearing the wearable terminal7based on control by the display controller87. Alternatively, for example, the image (actual image) of the view captured by the image capturing section72may be displayed on the display sections73, and the aforementioned guide image P1may be displayed over the actual image displayed on the display sections73.

Furthermore, in the wearable terminal7according to this exemplary embodiment, a mark M image-captured by the image capturing section72is detected, and a unit in the image forming apparatus5is specified based on the detected mark M. Alternatively, a mark M does not necessarily have to be used for specifying a unit in the image forming apparatus5. Specifically, a unit of the image forming apparatus5may be specified by pattern-analyzing the position and size of each component and the continuous paper S using the moving image of the unit of the image forming apparatus5captured by the image capturing section72.

Furthermore, although the image to be displayed on the display sections73of the wearable terminal7is composed by the controller80of the wearable terminal7in this exemplary embodiment, for example, the image may be composed by the print server3, and the composed image may be output to the wearable terminal7.

With regard to other processes, some or all of the processes performed by the controller80of the wearable terminal7may be performed in the print server3. In other words, in this exemplary embodiment, the controller80of the wearable terminal7may constitute an information processing device, the print server3may constitute an information processing device, or both the controller80of the wearable terminal7and the print server3may constitute an information processing device.

Furthermore, in this exemplary embodiment, the wearable terminal7worn and used by the operator is described as an example of a portable terminal displaying an image, such as an assistance image. Alternatively, the portable terminal may be, for example, a smartphone, a portable telephone, a tablet terminal, or a digital camera in place of the wearable terminal7so long as the portable terminal is, for example, a medium that is equipped with the display sections73displaying an image and the image capturing section72capturing a moving image and that is worn by the operator for operating the image forming apparatus5.