Patent ID: 12260293

DETAILED DESCRIPTION OF THE EMBODIMENT

Embodiments of the present invention will be described below with reference to the drawings. In the embodiments, a job management system will be described as an example in which management of a work process of a job in a printing factory is realized by a function (function of a work instruction) using a work instruction (slip). The work instruction includes a so-called “job ticket” in the field of printing technology.

First Embodiment

<Systems Configuration>

FIG.1illustrates an example of the configuration of the job management system according to the present embodiment.FIG.2illustrates an example of a work instruction used in the job management system according to the present embodiment. In the job management system1ofFIG.1, a customer system10, a work process management system14, a printer16, and one or more cameras18are connected via a network20such as the Internet or a LAN so as to be able to perform data communications.

The customer system10is an example of an existing system used by a customer, and creates a work instruction800for the customer system10illustrated inFIG.2Ain which a job ID is displayed. The job ID is an example of identification information for identifying a job. In the work instruction800for the customer system10, at least one bar code image801used by the customer system10is displayed.

The job ID may be displayed in the work instruction800for the customer system10with the bar code image801, or may be displayed in text. The customer system10provides users with existing functions implemented by work instructions800for the customer system10.

The work process management system14, the printer16, and the one or more cameras18constitute the information processing system12that adds a new function to the work instruction800. The work process management system14manages the progress of a job composed of a plurality of work processes as described later using a work instruction810for the information processing system12to which the color code image811ofFIG.2Bis added. The information processing system12can specify the job ID from the color code image811as described later.

The printer16prints the work instruction810for the information processing system12. The camera18is installed in the printing factory so as to be able to photograph a place corresponding to the job process in the printing factory. The location corresponding to the work process of the job is, for example, a location where the printed matter passes by the movement between the work processes, a temporary storage location where the printed matter is temporarily stored, or the like.

The camera18can be a PTZ camera or an IP camera. The PTZ camera is a camera capable of operation a PTZ (Pan Tilt Zoom) function via the network20, and capable of transmitting a photographed image or a photographed moving image via the network20. The IP camera is a camera that can be operated10via the network20, and can transmit a photographed image or a photographed moving image via the network20. The photographed image and the photographed moving image photographed by the camera18are transmitted to the work process management system14via the network20.

In the information processing system12that adds a new function to the work instruction800, the work instruction810for the information processing system12is attached to a printed matter that is an example of an intermediate product or a material of a job corresponding to the work instruction810. The work instruction810is attached to a printed matter that is easily photographed by the camera18, for example.

The work process management system14manages the progress (job state) of the work process of the job based on the work process of the job corresponding to the camera18that photographed the work instruction810and the job ID specified from the color code image811of the work instruction810. Further, the work process management system14manages a history of the work process of the job and a photographed image or a photographed moving image representing the state of photographing the work instruction810.

The configuration of the job management system1illustrated inFIG.1is an example. For example, the job management system1may include another system, or the work process management system14may have a different name. The work process management system14may be realized in one server environment or a plurality of server environments.

<Hardware Configuration>

The customer system10and the work process management system14are realized by, for example, a computer500having a hardware configuration illustrated inFIG.3.

FIG.3is a hardware configuration diagram of an example of a computer. The computer500ofFIG.3includes an input device501, a display device502, an external I/F503, a RAM504, a ROM505, a CPU506, a communication I/F507, a HDD508, and the like, which are connected to each other via a bus B. The input device501and the display device502may be connected and used when necessary.

The input device501includes a keyboard, a mouse, a touch panel, and the like, and is used by a user to input operation signals. The display device502includes a display or the like, and displays a result of processing by the computer500.

The communication I/F507is an interface for connecting the computer500to various networks. As a result, the computer500can perform data communications via the communication I/F507.

The HDD508is an example of a nonvolatile memory device that stores programs and data. The stored programs and data include an OS which is basic software for controlling the entire computer500, application software for providing various functions on the OS, and the like. The computer500may use a drive device (for example, a solid state drive (SSD)) using a flash memory as a memory medium instead of a HDD508.

The external I/F503is an interface with an external device. The external apparatus includes a recording medium503aand the like. As a result, the computer500can read and/or write the recording medium503avia the external I/F503. The recording medium503aincludes a flexible disk, a CD, a DVD, an SD memory card, a USB memory, and the like.

The ROM505is an example of a nonvolatile semiconductor memory (storage device) that can hold programs and data even when the power is turned off. The ROM505stores programs and data such as BIOS, operating system settings, and network settings that are executed when the computer500is activated. The RAM504is an exemplary volatile semiconductor memory (storage device) that temporarily stores programs and data.

The CPU506is an arithmetic unit which realizes control and functions of the entire computer500by reading programs and data from a storage device such as a ROM505and a HDD508on a RAM504and executing processes. The customer system10and the work process management system14can realize various types of processing described later by the hardware configuration of the computer500as illustrated inFIG.3, for example. The hardware configurations of the printer16and the camera18will not be described.

<Software Configuration>

FIG.4is a functional configuration diagram of an example of the work process management system. Incidentally, the functional configuration ofFIG.4is omitted as appropriate for the configuration unnecessary for the description of the present embodiment. The work process management system14ofFIG.4includes a UI unit30, a job ID detection unit32, a job management unit34, a color code image generation unit36, a color-coded work instruction creation unit38, a print instruction unit40, a photographed image acquisition unit42, a color code recognition unit44, a color code management table memory unit46, and a job management table memory unit48.

The CPU506illustrated inFIG.3implements a program stored in, for example, the ROM505to function as the UI unit30. The UI unit30controls the display of various screens, such as a screen that receives various necessary settings from a user, a job status list screen, a job detail history screen, a dashboard display screen, and a motion line display screen, which will be described later. The CPU506illustrated inFIG.3implements a program stored in, for example, the ROM505to function as the job ID detecting unit32. The job ID detecting unit32detects a job ID displayed in a bar code image801or text in a work instruction800for the customer system10illustrated inFIG.2A, for example. For example, information, such as the bar code image801or text in the work instruction800, captured by the camera18is received by the job ID detecting unit32, and the job ID detecting unit32detects the job ID from the received information.

The CPU506illustrated inFIG.3implements a program stored in, for example, the ROM505to function as the job management unit34. The ROM505or HDD508illustrated inFIG.3functions as the color code management table memory unit46. The job management unit34memories and manages the available color code ID in the color code management table memory unit46. The job management unit34limits the number of available color code IDs and narrows the range of values necessary for expressing the color code IDs, thereby maximizing the size of the color code image811and facilitating color code recognition to be described later.

If the color code ID that is not used remains in the color code management table memory unit46, the job management unit34selects the color code ID of the old last update from the color code management table memory unit46and reuses the selected color code ID. The job management unit34manages the job ID detected by the job ID detection unit32and the selected color code ID in association with each other in the color code management table memory unit46.

Further, the job management unit34memories and manages job information corresponding to the job ID and the color code ID in the job management table memory unit48. The job management table memory unit48manages progress information and history information of a work process of a job, a photographed image file and a photographed moving image file representing a state of photographing the work instruction810, and is used to display a job status list screen and the like, which will be described later.

The CPU506illustrated inFIG.3implements a program stored in, for example, the ROM505to function as the color code image generation unit36. The color code image generation unit36generates a color code image811, which will be described later, from the color code ID provided from the job management unit34. The CPU506illustrated inFIG.3implements a program stored in, for example, the ROM505to function as the color-coded work instruction creation unit38. The color-coded work instruction creation unit38creates data of a work instruction810for the information processing system12to which the color code image811ofFIG.2Bis added from the work instruction800for the customer system10ofFIG.2A. The data created by the color-coded work instruction creation unit38is to be printed by, for example, the printer16. The print instruction unit40instructs the printer16to print the work instruction810for the information processing system12to which the color code image811ofFIG.2Bis added.

The CPU506illustrated inFIG.3implements a program stored in, for example, the ROM505to function as the photographed image acquisition unit42. The photographed image acquisition unit42acquires a photographed image and a photographed moving image from the camera18. The CPU506illustrated inFIG.3implements a program stored in, for example, the ROM505to function as the color code recognition unit44. The color code recognition unit44decodes the color code ID from the color code image811that has been photographed in the photographed image or the photographed moving image. The color code recognition unit44provides the job management unit34with, for example, identification information for identifying the working process of the camera18or the job that photographed the color code image811, and the decoded color code ID. The job management unit34identifies the job ID corresponding to the decoded color code ID with reference to the job management table memory unit48.

The ROM505or HDD508illustrated inFIG.3functions as the color code management table memory unit46. As a result, the job management unit34can update the progress information (job status) of the job work process managed by the job management table memory unit48based on the job work process corresponding to the camera18that photographed the color code image811and the job ID corresponding to the decoded color code ID.

<Processing>

FIG.5is an image diagram showing an example of a job working process in a printing factory. The process ofFIG.5includes “printing”, “cutting”, “folding”, “binding”, “inspection”, “temporary storage1”, and “temporary storage2”. The camera18ais installed at a gate in front of a place where the work processes “printing”, “cutting”, “folding”, “binding” and “inspection” are performed. The camera18bis installed in a place where the work process “temporary storage1” and “temporary storage2” are performed.

The work instruction810for the information processing system12is photographed by the camera18aor the camera18bwhile moving between work processes or being stored in a temporary storage location. Note that, as illustrated inFIG.5, in the printing factory, the movement between the work processes is not certain, and the work instruction810for the information processing system12is not photographed by the job, and the work process in which detection and recording are not performed may be included. InFIG.5, arrows representing the movement of jobs for performing all the work processes and arrows representing the movement of jobs for skipping a part of the work processes are illustrated.

InFIG.5, after a printed matter is output by the work process “printing”, a work instruction810is attached to the printed matter. As a result, in the example ofFIG.5, the work instruction810attached to the printed matter is photographed by the camera18aor the camera18bwhile the printed matter passes through the gate or is stored in the temporary storage location.

<Creation of Color Coded Work Instructions»

FIG.6is a flowchart of an example of processing for creating a work instruction with a color code. In step S11, the job ID detection unit32of the work process management system14detects the job ID displayed in the work instruction800for the customer system10by the bar code image801or the text. The detection frame for detecting the job ID from the work instruction800may be set in advance by the operator, or may be automatically set by using OCR or the like.

In step S12, the job management unit34selects the color code ID to be used from the color code management table memory unit46, and manages the selected color code ID in association with the job ID detected by the job ID detection unit32.

In step S13, the color code image generation unit36generates a color code image811from the color code ID associated with the job ID in the procedure illustrated inFIG.7. The procedure illustrated inFIG.7uses, for example, the technique described in Japanese Laid-Open Patent Application No. 2017-199306.

FIG.7is a flowchart of an example of processing for generating a color code image. In step S21, the color code image generation unit36receives an input of a color code ID to be color coded. In step S22, the color code image generation unit36decomposes the character string of the color code ID into the values of the digits. In step S23, the color code image generation unit36converts the value of each separated digit into a value corresponding to the number of colors to be assigned to each cell of the optical symbol described in Japanese Laid-Open Patent Application No. 2017-199306. For example, if the number of colors assigned to each cell is four, the color code image generation unit36converts the value of each digit into a value of a ternary number according to a coding rule as illustrated inFIG.8, for example.

FIG.8explains a coding rule capable of expressing a ternary number.FIG.8shows an example of the coding rule when four colors of red color (hereinafter, referred to as “R”), green color (hereinafter, referred to as “G”), blue color (hereinafter, referred to as “B”), and black color (hereinafter, referred to as “K”) are used. In the case of using four colors, it is possible to express them in three values, that is, in a ternary number.

For example, as illustrated inFIG.8A, each transition from R to K, from K to B, from B to G, and from G to R represents a value “0”. In addition, each transition from R to G, G to B, B to K, and K to R in the counterclockwise direction represents a value “1”. Furthermore, bi-directional transitions along the diagonals, i.e. between R and B, and between K and G, respectively, represent the value “2”.

For example, referring toFIG.8B, a case where color transition of each cell is observed from left to right in a cell column connected in order of G, R, B, K, and G is considered. In this case, the transition from G to R represents the value “0”, the transition from R to B represents the value “2”, the transition from B to K represents the value “1”, and the transition from K to G represents the value “2”. Thus, the array ofFIG.8Brepresents a value “3d2120”, i.e. a decimal value “69”. The first “3d” in the notation of the values indicates that the next number is a three decimal value.

The coding rule using the four color transition is not limited to the example illustrated inFIG.8A, and may be, for example, the example illustrated inFIG.8D.FIG.8Eshows an example of a conversion table associating color transitions and values according to the coding rule illustrated inFIG.8D. InFIG.8E, for example, when it is desired to express the value “2” in R as the color of the cell of a transition source, the color of the cell of a transition destination adjacent to the cell of the transition source is set to B. Similarly, when the color of the cell of the transition source is K and the value “1” is to be expressed, the color of the cell of the transition destination is G.

In step S24following step S23ofFIG.7, the color code image generation unit36assigns colors to the respective cells of the optical symbol in accordance with the color of the cell of the transition source, the value of the ternary number converted in step S23, and the conversion table of the coding rule as illustrated inFIG.8A. The color code image generation unit36stores in advance the color arrangement of each cell in the cell string of the main code of the optical symbol.

A more specific example in the case where the number of colors assigned to each cell of the optical symbol is four will be described with reference toFIGS.9and10.FIG.9is a diagram showing an example of information to be coded into the optical symbol.FIG.10is a diagram showing an example of the optical symbol in the case where the number of colors assigned to each cell of the optical symbol is four.

FIG.9is an example of the values “3d1,” “3d1,” “3d0,” and “3d1” in each cell column of the sub-code unit301connected to “d1,” “d2,” “d3,” and “d4” of the main code unit300.

FIG.10shows an example of an optical symbol in which the information illustrated inFIG.9is coded according to the coding rule described with reference toFIGS.8A to8E. In this example, the cell row of the main code unit300includes an even number of cells, and is configured by alternately arranging K and R with the leading end cell as K.

In addition, for example, in the cell at the left end, the color of the cell is assigned to the sub-code unit301by using K of the cell of the main code unit300to which the cell is connected as the color of the first transition source. Referring toFIG.10, R is assigned to the cell of the leftmost sub-code unit301of the optical symbols by referring to the translation table of the coding rules ofFIG.8Ain accordance with K of the cell of the main code unit300which is the cell of the source of the transition and the value “3d1” of the cell of the sub-code unit301.

In step S14following step S13inFIG.6, the color-coded work instruction creation unit38creates a work instruction810for the information processing system12using the color code image811generated in step S13.

FIG.11is a diagram showing an image of processing for creating a work instruction with color code. The paper size and the layout frame may be set in advance by the operator. The work instruction800for the customer system10ofFIG.2Ais scaled down to create a free space. The work instruction810for the information processing system12illustrated inFIG.2Bis obtained by attaching a color code image811to an empty space generated by scaling down the work instruction800for the customer system10.

In the work instruction800for the customer system10illustrated inFIG.2A, at least one bar code image801used on the customer system10side is displayed. Therefore, simply reducing the work instruction800for the customer system10may cause the bar code image801to fail.

Therefore, in order to generate an empty space without impairing the function of the bar code image801, the color-coded work instruction creation unit38confirms the direction of the bar code image801in the procedure illustrated inFIG.12, and performs scaling and reduction in the direction in which the function of the bar code image801is not impaired.

FIG.12is a flowchart of an example of processing for reducing an image including a bar code image. In step S31, the color-coded work instruction creation unit38cuts out the position of the bar code image801of the work instruction800for the customer system10illustrated inFIG.2A. In step S32, the color-coded work instruction creation unit38determines whether the extracted bar code image as illustrated inFIG.13is a Bk (monochrome) image or an RGB (RGB) image.FIG.13illustrates an example of a bar code image.

If the image is not a Bk (monochrome) image, the color-coded work instruction creation unit38proceeds to step S33, converts the RGB image into a Lab image or a Luv image, creates a monochrome image in which only the L component is extracted after the conversion, and proceeds to step S34. If the image is a monochrome image, the color-coded work instruction creation unit38skips step S33and proceeds to step S34.

In step S34, the color-coded work instruction creation unit38raster scans all the pixels in the bar code image ofFIG.13. Here, it is assumed that the pixel position (x, y) is a position according to the X direction and the Y direction displayed inFIG.13. The color-coded work instruction creation unit38integrates the values of the pixels having the same pixel position x, that is, the values of the pixels in the Y direction.

In step S35, the color-coded work instruction creation unit38integrates all the pixels. The color-coded work instruction creation unit38obtains an average value by dividing the value obtained by integrating all the pixels by the number of all the pixels.

In step S36, as illustrated inFIG.18, the color-coded work instruction creation unit38confirms the number of changes by comparing the integrated value of the pixels having the same pixel position x obtained in step S34with the average value obtained in step S35.FIG.18is an explanatory diagram of an example of the number-of-changes checking process.

For example, the work instruction creation unit38with color code confirms the number of times of change obtained by totaling the number of times of change from the integrated value high than the average value to the integrated value lower than the average value and the number of times of change from the integrated value lower than the average value to the integrated value higher than the average value.

In step S37, the color-coded work instruction creation unit38determines whether or not the number of changes confirmed in step S36is 24 or more. If the number of changes is 24 or more, the process advances to step S38, and the color-coded work instruction creation unit38performs scaling in a direction in which the bar code image ofFIG.14is reduced in the vertical direction as in the bar code image ofFIG.15, for example.FIG.14illustrates an example of a bar code image before reduction in the vertical direction.FIG.15illustrates an example of a bar code image after being reduced in the vertical direction.

For example, when the bar code image illustrated inFIG.13is reduced in the X direction, black lines approach each other, and it becomes difficult to discriminate a change in black and white. On the other hand, since the interval between black lines does not change even if the bar code image illustrated inFIG.13is reduced in the Y direction, the discrimination of black and white is not affected.

Meanwhile, if the number of changes is not more than 24 times, the step S39proceeds, and the work instruction creation unit38with a color code reduces the bar code image shown inFIG.16in a direction that is reduced in a lateral direction, such as the bar code image shown inFIG.17.

The process of the flowchart ofFIG.12determines the direction of the bar code image based on the following idea. For example, in the case of a vertical bar code as illustrated inFIG.13, since there is the width of a black line, a change from a white line to a black line and a change from the black line to the white line occur in a set. The number of changes varies according to the number of displayed digits of the bar code, but when a typical bar code is examined, if the number of changes is 24 or more, it can be determined that the bar code is a vertical bar code as illustrated inFIG.13.

Similarly, in the case of a bar code in the horizontal direction as illustrated inFIG.19, in step S36, the color-coded work instruction creation unit38confirms the number of changes as illustrated inFIG.20.FIG.19illustrates an example of a bar code image.FIG.20explains an example of a process of checking the number of changes.

Referring toFIG.20, because the number of times of change obtained by totaling the number of times of change from the integrated value higher than the average value to the integrated value lower than the average value and the number of times of change from the integrated value lower than the average value to the integrated value higher than the average value is extremely small, even if information other than the bar code image is integrated, the number of times of change does not become 24 or more, for example. Therefore, if the number of changes is 24 or more, it can be determined that there presents a bar code in the lateral direction as illustrated inFIG.19.

Instead of the method of determining the direction of the bar code image described above, the direction of the bar code image can be determined by Fourier transform, Hough transform which is one of feature extraction methods, or the like. However, recent printers perform halftone processing. Especially in an electrophotographic printer, an all-wire dither may be used.

When the Hough transform is used, a line segment component in an image can be extracted. Although the line segment component of the bar code is dominant, it is difficult to eliminate the influence of halftone processing, especially the omni-line dither. In order to reduce the influence of the all-wire dither, the position of the bar code image801must be strictly specified in step S31.

Similarly, in the case of using Fourier transform, it becomes a problem whether the influence of the halftone processing around the bar code can be strictly eliminated.

On the other hand, in the method of determining the direction of the bar code image of the present embodiment, even if the omni-directional dither image or some character or image is included in the periphery of the bar code image cut out in step S31, the number of changes is not caused to be counted so as to cause no problem.

As described above, in the work process management system14of the present embodiment, it is possible to create an empty space by scaling in a direction that does not impair the function of the bar code image801, and to add the color code image811that can be read remotely to the empty space. Even if the work instruction800for the customer system10is scaled down, the function of the bar code image801is not impaired, and the function of the color code image811can be added to the work instruction810for the information processing system12while the function of the work instruction800for the customer system10remains.

In step S15following step S14inFIG.6, the print instruction unit40instructs the printer16to print the work instruction810for the information processing system12to which the color code image811created in step S14is added. The printer16prints a work instruction810for the information processing system12to which a color code image811as illustrated inFIG.2B, for example, is added in accordance with an instruction from the print instruction unit40.

«Updating Job Status when Passing Gates»

In the job management system1according to the present embodiment, the job status of the job management table memory unit48is updated as follows by photographing the work instruction810for the information processing system12to which the color code image811is added by the camera18a.

FIG.21is a flowchart of an example of job status update processing when a gate is passed. When the photographed image acquisition unit42of the work process management system14acquires a photographed image or a photographed moving image from the camera18a, the process proceeds to step S52.

In step S52, the color code recognition unit44tries to cut out the color code image811from the photographed image or the photographed moving image acquired by the photographed image acquisition unit42. In step S53, the color code recognition unit44performs recognition processing of the color code image811in the procedure described in, for example, Japanese Patent Laid-Open Patent Application No. 2017-199306.

When the color code image811is recognized, the color code recognition unit44detects an image of each cell from the color code image811. In step S54, the color code recognition unit44recognizes the color information of each cell detected in step S53and the connection information of each cell as symbol information. The color code recognition unit44proceeds to step S54, and decodes the symbol information according to the coding rule illustrated inFIG.8A, for example, to restore the color code ID coded in the color code image811.

In step S55, the color code recognition unit44provides, for example, identification information of the camera18athat photographed the color code image811and the color code ID restored by decoding to the job management unit34. The job management unit34refers to the job management table memory unit48and identifies the job ID corresponding to the color code ID.

Then, the job management unit34can update the job status managed in the job management table memory unit48from “undetected” to “current process” or “passed” based on, for example, the identification information of the camera18athat photographed the color code image811and the job ID corresponding to the color code ID restored from the color code image811.

«Updating Job Status during Storage in Temporary Storage Location»

In the job management system1according to the present embodiment, the job status of the job management table memory unit48is updated as follows by photographing the work instruction810for the information processing system12to which the color code image811is added by the camera18b.

FIG.22is a flowchart of an example of job status update processing at the time of storage in a temporary storage location. When the photographed image acquisition unit42of the work process management system14acquires the photographed image from the camera18b, the process proceeds to step S62.

In step S62, the color code recognition unit44tries to cut out the color code image811from the photographed image or the photographed moving image acquired by the photographed image acquisition unit42. In step S63, the color code recognition unit44performs recognition processing of the color code image811in the procedure described in, for example, Japanese Laid-Open Patent Application No. 2017-199306.

If the color code image811is recognized in step S63, the color code recognition unit44proceeds from step S64to step S65, and decodes the symbol information recognized from the color code image811to restore the color code ID encoded in the color code image811.

In step S66, the color code recognition unit44provides, for example, identification information of the camera18bthat photographed the color code image811and the color code ID restored by decoding to the job management unit34. The job management unit34refers to the job management table memory unit48and identifies the job ID corresponding to the color code ID.

Then, the job management unit34determines whether a predetermined time has elapsed without a change in the job status of the job ID based on, for example, the identification information of the camera18bthat photographed the color code image811and the job ID corresponding to the color code ID restored from the color code image811.

If the job status is not changed and the predetermined time has not elapsed, the job management unit34proceeds to step S70. In step S70, the job management unit34can update the job status managed by the job management table memory unit48from “undetected” to “current process”.

If the job status is unchanged and the predetermined time has elapsed, the job management unit34performs the processing to display the residence alert on the job detail history screen described later, and then proceeds to the processing of step S70. In step S70, the job management unit34can update the job status managed by the job management table memory unit48from the “current process” to the “alert” or the like.

If the predetermined period of time has elapsed without any change in the job status, the job management unit34performs a process for displaying a stay alert on a job detail history screen, which will be described later, and then proceeds to the process of step S70. If the predetermined time has not elapsed without any change in the job status, the job management unit34proceeds to step S70. In step S70, the job management unit34can update the job status managed by the job management table memory unit48from “undetected” to “current process”.

If the color code image811is not recognized in step S63, the color code recognition unit44proceeds from step S64to step S68, and if the color code image811cannot be recognized from the photographed image from the camera18binstalled in the temporary storage location, processing is performed to update the job ID that the job status is to be stored in the temporary storage location.

The color code recognition unit44provides, for example, identification information of the camera18bto the job management unit34. The job management unit34determines whether or not there is a job ID for which the color code image811has not been recognized from the photographed image continuously for a predetermined number of times, among job IDs for which the job status of the temporary storage location corresponding to the provided identification information of the camera18bis “current process”.

If there is a job ID for which the color code image811has not been recognized from the photographed image consecutively for a predetermined number of times among the job IDs whose job statuses of the temporary storage locations are “current process”, the job management unit34proceeds to step S69, sets the color code ID associated with the job ID to Null, and proceeds to step S70. In step S70, the job management unit34can update the job status managed by the job management table memory unit48from the “current process” to the “passed” or the like.

Further, there is a possibility that the work instruction810for the information processing system12is stored in a state in which it is impossible to take a picture from the camera18b, for example, the printed matter is superimposed on the temporary storage location. In consideration of this point, the job management unit34skips step S69and proceeds to step S70if there is no job ID whose color code image811has not been recognized from the photographed image consecutively for a predetermined number of times among the job IDs whose job status of the temporary storage location is “current process”. In step S70, the job management unit34can update the job status managed by the job management table memory unit48from the “current process” to the “stack”.

According to the processing of the flowcharts ofFIGS.21and22, by automatically updating the job status of the printed matter to which the work instruction810for the information processing system12is attached, it is possible to track the printed matter to which the work instruction810for the information processing system12is attached.

«Inquiry of Job»

The operator of the job management system1can inquire the progress information and the history information of the work process of the job in the printing factory, the photographed image file representing the state when the work instruction810is photographed, the photographed moving image file, and the like through various UI screens provided by the work process management system14.

FIG.23is a transition diagram of an example of a UI screen displayed by the work process management system. The UI unit30of the work process management system14displays, for example, a job status list screen1000on the display device502. The job status list screen1000displays a list of job information including a job ID, a color code ID, a job name, last update data, and progress information of one or more work processes.

The progress information of one or more work processes indicates whether the work process progress is “undetected”, “passed”, “current process”, “alert” or “stacked”. The progress “undetected” of the work process indicates that the work instruction810for the information processing system12is not photographed by the camera18corresponding to the work process. The progress “passed” of the work process indicates that the work instruction810for the information processing system12has been photographed by the camera18corresponding to the work process before the last update. The progress “current process” of the work process indicates that the work instruction810for the information processing system12has been photographed by the camera18corresponding to the work process in the final update. The progress “alert” of the work process indicates that an alert such as, for example, a stay alert has occurred. The progress “stacking” of the work process indicates that the camera18corresponding to the work process has taken the work instruction810for the information processing system12before the last update and that the camera18corresponding to the work process and other work processes has not taken the work instruction810for the information processing system12with the last update. The “stacking” of the progress of the work process indicates a condition in which it is anticipated that the printed matter to which the work instruction810is affixed could not be photographed with the camera18due to stacking or the like.

The key mark1002of the job status list screen1000indicates that the color code ID associated with, for example, a long-term storage job is locked so as not to be automatically released. In this manner, the process management system14provides the operator with a locking function in which the color code ID is not reused.

The operator can display the job detail history screen1010by selecting one job from the job status list screen1000. The job detail history screen1010displays buttons for shifting to a screen for displaying a start date and time, a completion date and time, and a photographed image or a photographed moving image for each work process. When the work process is “temporary storage1” or “temporary storage2”, an address representing a storage area in the temporary storage location is also displayed on the job detail history screen1010. Further, the job detail history screen1010displays a “traffic line display” button for transitioning to the traffic line display screen1050, which will be described later.

When a button for shifting to the screen1020for displaying the photographed image or the photographed moving image of the job detail history screen1010is pressed, the UI unit30shifts to the screen1020for displaying the photographed image or the photographed moving image. On the screen1020for displaying a photographed image or a photographed moving image, when the playback button is pressed, the photographed image file or the photographed moving image file representing the state of photographing the work instruction810is displayed.

When the button for transitioning to the map display screen1030for the job corresponding to the work process “temporary storage1” or “temporary storage2” is pressed, the UI unit30transitions to the map display screen1030illustrated inFIG.26.FIG.26illustrates an example of the map display screen of the temporary storage location. The UI unit30displays, for example, a photographed image of a temporary storage location on the background, and displays the image so that the storage area in which the printed matter is stored can be identified by the mark “□” or the like.

The job status list screen1000ofFIG.23may be displayed by performing grouping as illustrated inFIG.24, or may be configured to accept designation of a search condition as illustrated inFIG.25.

FIGS.24A to24Care explanatory diagrams illustrating an example of a grouping process in a UI screen.FIG.24Aillustrates an example of the job status list screen1000before the grouping process.FIGS.24B and24Care examples in which progress information of one or more work processes of the job status list screen1000after the grouping process is grouped for each of the “first floor area” and the “second floor area” to facilitate visual grasp.

InFIG.24C, the grouped “first floor area” is displayed in a folded manner. When the progress information of the grouped work process is displayed in a convoluted manner, the progress information and (logical conjunction/AND) of the work process included in the group are displayed as the progress information of the group so that the progress information of the work process included in the folded “1st floor area” group is understood.

For example, the progress information and of the work process included in the group is determined as “alert>current process>stacked>passed>undetected”.

FIGS.25A to25Cexplain examples of the search condition specifying process on the UI screen.FIGS.25A to25Cillustrate examples of a job status list screen1000in which a search line is provided. The search line is displayed, for example, by pressing the “search” button on the job status list screen1000.

The operator can search for a job that matches the search condition by specifying the search condition in the search line. The search lines provided as inFIGS.25A-25Chave the effect of improving immediacy and visibility due to the small screen transitions.

FIG.25Aillustrates an example in which a search condition is entered in the search line with a text item (partial matching).FIG.25Billustrates an example of inputting a search condition in a time and date and time item (specified range) on the search line.FIG.25Cillustrates an example in which the search condition is selected by pull-down in the search line in the work process item (matching).

Selection by pull-down may be made, for example, to allow multiple selection by the control key. When the “condition clear” button is pressed, all search conditions are cleared and all items are displayed. In addition, the progress information of one or more work processes of the job status list screen1000may be represented by a marker, for example, as shown inFIG.27. InFIG.27, the color of the marker is represented by a kanji character. The time has elapsed in the order of (a) to (e) inFIG.27. For example, inFIG.27, the second work process in (c), which was the progress “current process,” is the progress “accumulated” in (d). The progress information of the one or more work processes shown in (d) ofFIG.27is again photographed by the camera18in a work instruction810for the information processing system12, resulting in any of the conditions shown on the right side ofFIG.27.

The operator can also display the dashboard display screen1040by pressing the “dashboard” button on the job status list screen1000.

FIG.28is an explanatory diagram illustrating an example of a switching between a job status list screen and a dashboard display screen. When the “dashboard” button is pressed while the search condition is specified in the job status list screen1000, the dashboard display screen1040takes over the search condition specification and displays it. The operator can also display the job status list screen1000by pressing the “return to list” button on the dashboard display screen1040. The job status list screen1000may take over the original search condition specification before the transition to the dashboard display screen1040.FIG.29is an image diagram illustrating an example of a dashboard display screen.

The dashboard display screen1040displays information about the progress of multiple jobs by a marker (an example of a display object) representing the location on the map of the job and the number of jobs per location. For example,FIG.29shows the number of jobs and alerts in the process category for each of “process category A”, “process category B”, and “process category C”. The dashboard display screen1040ofFIG.29may enclose the process category in a frame and embed the factory map as a background image. The position where the marker is displayed indicates one or more work processes. The size of the marker indicates the number of jobs in the process. This feature distinguishes between the colors of normal markers (e.g., green) that do not contain the job where the alert occurred and the colors of alert markers (e.g., red) that contain the job where the alert occurred.

FIG.30is an illustrative view of an example of a marker. The marker inFIG.30is an example represented by a bubble (circle mark) and is represented by a circle of five level sizes corresponding to the number of jobs for a specified work process. The parameters of the marker inFIG.30include a range of job numbers, a central coordinate, a radius (size) and a color (normal marker/alert marker). Normal marker colors may vary from one level to another. The dashboard display screen1040provides a visually understandable display of the number of jobs in each work process and the work process that includes the job where the alert is occurring. In addition, the operator can display the traffic line display screen1050by pressing a “traffic line” button on the job detail history screen1010.

FIG.31is an image diagram illustrating an example of a traffic line display screen. The traffic line display screen1050displays the traffic line by connecting the job history with a curve on the map based on the information about the job history displayed on the job detail history screen1010. The curve is, for example, a Bezier curve. The Bezier curve is an (N−1)th order curve obtained from control points as many as N. The line display screen1050ofFIG.31illustrates the points of the work process in circles. Circles are displayed by specifying the center coordinate, radius, color, and transparency. The work process that the job has not passed is hidden. In addition, in the motion display screen1050ofFIG.31, the center coordinate of the work process through which the job has passed is connected by a Bezier curve so that the traffic line of the job can be visually represented. In the traffic line display screen1050ofFIG.31, In the traffic line display screen1050ofFIG.31, a mouse may be brought over the circle so as to display information such as the process name/transit time (all if any) of the work process corresponding to the circle.

As described above, according to the work process management system14of the present embodiment, the progress information of the work process of the job in the printing factory can be checked in the list. In addition, according to the work process management system14of the present embodiment, it is possible to confirm the history information of the work process of the job in the printing factory, the photographed image file representing the state when the work instruction810is photographed, the photographed moving image file, and the like by a simple operation.

Second Embodiment

In the first embodiment, the work process management system14creates the work instruction810for the information processing system12. In the second embodiment, the customer system10creates the work instruction810for the information processing system12. The second embodiment is the same as the first embodiment except for a part thereof. Therefore, descriptions of the same parts as those of the first embodiment are appropriately omitted.

<System Configuration>

FIG.32is a functional configuration diagram of another example of the work process management system. A work process management system14aillustrated inFIG.32is configured by excluding the color-coded work instruction creation unit38and the print instruction unit40from the work process management system14illustrated inFIG.4. On the other hand, a customer system10ahas a color-coded work instruction creation unit60and a print instruction unit62added thereto.

In the job management system1according to the second embodiment, the generation of the color code image811is performed by a work process management system14ain the same manner as in the first embodiment, and steps S14and S15ofFIG.6are performed by the color-coded work instruction creation unit60and the print instruction unit62of the customer system10.

Also in the job management system1according to the second embodiment, the same effect as that of the job management system1according to the first embodiment can be obtained.

Third Embodiment

The first and second embodiments described above are techniques realized by the work instruction810for the information processing system12in which a new code (color code image811) is added to the work instruction800for the customer system10. This technique can be applied to, for example, a technique of a conveyance system represented by an AGV (unmanned conveyance vehicle).

For example, in a conveyance system that conveys goods, the work instruction810for the information processing system12to which a color code image811is added is attached, and the image of an article being conveyed is photographed by the camera18, so that the work process of the article being conveyed by the conveyance device can be managed. In addition, since the position of the conveyance device that conveys the good and the conveyance destination of the article can be specified, the conveyance system can also control the movement of the conveyance device that conveys the article.

Fourth Embodiment

Although the above-described first and second embodiments have been described with respect to the management of the work process of the job in the printing factory, the present embodiment can be applied to the management of the work process of the article flowing on the belt conveyor, for example. For example, if the technique of the present embodiment is provided for the management of the working process of the goods flowing on the belt conveyor, the tracking of the articles flowing on the belt conveyor becomes possible, and the branching of the belt conveyor can be controlled.

The present invention is not limited to the embodiments specifically disclosed above, and various modifications and variations are possible without departing from the scope of the claims. The job ID is an example of the first identification information described in the claims. The color code image is an example of the second identification information. The job ID detection unit32is an example of a detection unit.

The color code image generation unit36is an example of a generating unit. The color-coded work instruction creation unit38is an example of a creation unit. The job management unit34is an example of a management unit. The camera18is an example of a photographing unit. The color code recognition unit44is an example of a recognition unit.

The present invention is not limited to the embodiments specifically disclosed above, and various modifications and variations are possible without departing from the scope of the claims. The work instruction800for the customer system10is an example of a first slip image as claimed. The work instruction810for the information processing system12is an example of a second slip image. The bar code image801is an example of a code image displayed on the first slip image. The color code image811is an example of a new code image.

The color-coded work instruction creation unit38for checking the direction of the bar code image801illustrated inFIG.12is an example of a determination unit. The color-coded work instruction creation unit38that performs scaling and reduction in a direction that does not impair the function of the bar code image801illustrated inFIG.12is an example of a reduction unit. The color-coded work instruction creation unit38that creates the work instruction810for the information processing system12by using the generated color code image811is an example of a creating unit. The color code image generation unit36is an example of a generating unit.

The present invention is not limited to the embodiments specifically disclosed above, and various modifications and variations are possible without departing from the scope of the claims. The color code image811is an example of a code image associated with the job described in the claims. The work instruction810for the information processing system is an example of a slip.

The camera18is an example of a photographing unit. The color code recognition unit44is an example of a recognition unit. The job management unit34is an example of a management unit. The UI unit30is an example of providing unit. The photographed image file and the photographed moving image file are examples of photographing data. The job status list screen1000is an example of a list screen. The job detail history screen1010is an example of a detail screen.

Effect of the Invention

According to the embodiment of the present invention, a function realized by a slip can be easily added.

According to the embodiment of the present invention, the code image displayed on the first slip image can be reduced in a readable state, and a second slip image on which a new code image is displayed can be created.

According to the embodiment of the present invention, it is possible to provide an information processing system in which a user can easily confirm information on the progress of a plurality of jobs composed of a plurality of work processes.

EXPLANATION OF REFERENCE SYMBOLS

1: Job management system10: Customer's system12: Information processing system14: Work process control system16: Printer18,18a,18b: cameras20: Network30: UI section32: Job ID detector34: Job Management Department36: Color code image generator38,60: Color-coded Work Instruction Preparation Department40,62Print Instruction Department42: Captured image acquisition unit44: Color code recognition unit46: Color code management table memory unit48: Job management table storage800: WORK INSTRUCTIONS FOR CUSTOMER SYSTEMS801: Bar-code image810: Work instructions for information processing systems811: Color code image1000: Job status list screen1010: Job detail history screen1020: Screen for displaying photographed images or videos1030: Job map screen1040: Dashboard display screen1050: Traffic line display screen

All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the principles of the invention and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions, nor does the organization of such examples in the specification relate to a showing of the superiority or inferiority of the invention.

Although claimed embodiments of the present invention has been described in detail, it should be understood that various changes, substitutions, and alterations could be made thereto without departing from the spirit and scope of the invention.