Patent ID: 12200173

DETAILED DESCRIPTION

In general, according to one embodiment, there are provided an image processing device and an image processing method capable of efficiently specifying an abnormal sound in case of the occurrence of malfunction that is an important element to clarify the cause of the malfunction.

An image processing device includes acquisition means, playing means, changing means, and determination means. The acquisition means acquires a plurality of kinds of sound data indicating sounds different from each other. The playing means plays one kind of sound data from the sound data. The changing means changes the one sound data to another kind of sound data. The determination means determines one kind of sound data from the sound data.

Hereinafter, an embodiment is described with reference to the drawings.

FIG.1is a block diagram illustrating a schematic configuration of an MFP10according to the embodiment. The MFP10is an example of the image processing device. The MFP10includes a scanner11, a printer12, a control system13, and an operation panel14. The scanner11, the printer12, and the operation panel14are connected to the control system13.

The scanner11is a device that optically reads an image of a document according to an operation instruction from the control system13and converts the image into image information. The scanner11outputs the image information of the read document to the control system13.

The printer12prints an image based on the image information supplied from the control system13on paper in various printing conditions designated from the control system13. As the printer12, printers of various image forming methods can be applied. For example, the printer12may be a printer in an electrophotographic method, and may be a printer in an inkjet method or a thermal transfer method.

The control system13collectively controls an operation of each unit such as the scanner11, the printer12, and the operation panel14. In addition, the control system13performs various processes such as image processing. The control system13includes a processor131, a random-access memory (RAM)132, a read-only memory (ROM)133, a data memory134, an image memory135, an image processing unit136, a facsimile (FAX) interface (I/F)137, and a communication interface (I/F)138.

The processor131performs various processes such as calculation and control according to programs. The processor131is, for example, a central processing unit (CPU). The processor131realizes various processing functions by executing programs stored in the ROM133or the data memory134. The RAM132is a working memory. The RAM132is, for example, a volatile memory. The ROM133is a program memory. The ROM133is, for example, a non-volatile memory.

The data memory134stores control data, a control program, setting information, and the like. The data memory134is, for example, a non-volatile memory. The image memory135is configured with a hard disk drive, a page memory, and the like. The image memory135stores image information. The image processing unit136performs image processing with respect to image information.

The FAX interface137is an interface for performing FAX communication. The communication interface138is a network interface for performing data communication with an external device such as a management server20via a network such as Internet1.

The operation panel14is a user interface. The operation panel14includes a touch panel141and an input device142. The touch panel141is obtained, for example, by stacking a display such as a liquid crystal display or an organic electro-luminescence (EL) display and a sensing device that detects touch input. The input device142is, for example, a button, keyboard, a keypad, or a touchpad.

The management server20provides a plurality of kinds of sound data respectively indicating different sounds that are required to specify abnormal sounds during a maintenance operation of the MFP10. The management server20provides a playlist and sound source files to the MFP10via the Internet1. The playlist and the sound source files are described below.

FIG.2is a block diagram illustrating a main circuit configuration of the management server20. The management server20includes, a processor21, a main memory22, an auxiliary storage device23, a communication interface24, and a system transmission line25. The system transmission line25includes an address bus, a data bus, a control signal line, and the like. The management server20connects the processor21, the main memory22, the auxiliary storage device23, and the communication interface24to the system transmission line25. In the management server20, a computer is configured with the processor21, the main memory22, the auxiliary storage device23, and the system transmission line25connecting them.

The processor21controls each unit so that various functions as the management server20can be realized according to the operating system or the application program. The processor21is, for example, a CPU.

The main memory22includes a non-volatile memory area and a volatile memory area. The main memory22stores an operating system or an application program in a non-volatile memory area. The main memory22stores data required for performing processes to control each unit by the processor21, in a volatile memory area. The data may be stored in the non-volatile memory area. The main memory22uses the volatile memory area as a work area where data is appropriately rewritten by the processor21. The non-volatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

The auxiliary storage device23is, for example, an electric erasable programmable read-only memory (EEPROM) (Registered Trademark), a hard disk drive (HDD), or a solid state drive (SSD). The auxiliary storage device23stores data used for performing various processes by the processor21, or data generated by processes in the processor21, or the like. The auxiliary storage device23may store the application program.

The communication interface24is an interface circuit for transmitting and receiving data according to a predetermined communication protocol with the MFP10connected via the Internet1.

The management server20of the corresponding configuration stores a playlist231(seeFIG.3) and a plurality of sound source files232in the auxiliary storage device23. The playlist231is a list showing a playback order of the plurality of sound source files232. The sound source files232store sound source records2321(seeFIG.4) for each sound source file name.

FIG.3is a schematic diagram illustrating an example of the playlist231. The playlist231illustrated inFIG.3includes areas for storing pointers N and sound source file names, respectively. The pointers N are unique values allocated for each sound source file232in order to identify the sound source files232. The files are played in an ascending order of the pointers N, that is, in an order from the beginning of the playlist231. The playback order is prioritized and the files are played in a descending order of the priority. Examples thereof include an order of the sound source files of abnormal sounds with higher generation frequencies in the market relating to the MFP10, an order of the sound source files with higher risk levels of the sound sources, an order of the sound source files with characteristic sounds, and an order of the sound source files relating to components of the MFP10with higher degrees of deterioration. In the present embodiment, the playback order is set in advance by an operator or the like. In addition, the storage destination of the playlist231and the sound source files232is not limited to the auxiliary storage device23. The playlist231and the sound source files232may be stored in the volatile memory area of the main memory22. The playlist231is not limited to the data of the items described above.

FIG.4is a schematic diagram illustrating an example of the data structure of the sound source record2321stored in the sound source files232. The sound source record2321illustrated inFIG.4includes sample sound data of the abnormal sound, relating component data, malfunction data, and a risk level of the sound source. The relating component data is, for example, information of a configuration component of the MFP10expected to be a generation source of the abnormal sound, and the like. The malfunction data is, for example, information in which the abnormal sound is generated, and also white streaks are generated during printing. The risk level of the sound source is a degree of the likeliness of the failure of the MFP10as the cause of the abnormal sound. The sound source record2321is not limited to the data of the item described above.

FIGS.5and6are flowcharts of the procedures of the main information process performed according to the control program by the processor131of the MFP10.FIG.7is a flowchart illustrating a procedure of a main information process performed according to the control program by the processor21of the management server20. Hereinafter, the operations of the MFP10and the management server20are described with reference to these figures. The procedure of the operations and the contents thereof are examples. The procedure and the contents are not limited as long as the same result can be obtained.

During the maintenance operation of the MFP10, the operator switches the operation mode of the MFP10from the normal mode to the malfunction mode. When the operator touches the malfunction button displayed on the touch panel141, the operation mode is switched to the malfunction mode.

That is, the processor131of the MFP10waits for the touch on the malfunction button displayed on the touch panel141in ACT1. When the malfunction button is touched, the processor131determines YES in ACT1and proceeds to ACT2. The processor131displays a malfunction report screen100(seeFIG.8) as the malfunction mode on the touch panel141in ACT2.

FIG.8is a schematic diagram illustrating an example of the malfunction report screen100. As illustrated inFIG.8, check fields101for selecting malfunction, a check field102for input when there is an abnormal sound in case of the occurrence of the malfunction, and an abnormal sound button103for specifying the sample sound of the abnormal sound are displayed on the malfunction report screen100. Examples of the malfunction include paper jams and white streaks. A transmission button104for instructing transmission confirmation after checks are input to the check field101, or the check field101and the check field102is displayed on the malfunction report screen100. The abnormal sound button103may be enabled when a check is input to the check field102. The displayed content of the text data inFIG.8is an example.

The description refers back toFIG.5. The processor131of the MFP10confirms whether the abnormal sound button103of the malfunction report screen100is touched in ACT3. When the abnormal sound button103is touched, the processor131determines YES in ACT3and proceeds to ACT4.

The processor131controls the communication interface138so as to request the playlist231and the sound source file232at the beginning of the playlist231from the management server20in ACT4. According to the control, a list request command is transmitted via the communication interface138.

The processor21of the management server20waits for the reception of the list request command from the MFP10via the communication interface138in ACT31ofFIG.7.

When the list request command is received, the processor21determines YES in ACT31and proceeds to ACT32. The processor21controls the communication interface24so as to transmit the playlist231and the sound source file232at the beginning of the playlist231to the MFP10in ACT32. According to this control, the playlist231and the sound source file232at the beginning of the playlist231are transmitted via the communication interface24.

The description refers back toFIG.5.

The processor131of the MFP10that controls the transmission of the list request command in ACT4waits for the playlist231and the sound source file232at the beginning of the playlist231from the management server20in ACT5. When the playlist231and the sound source file232at the beginning of the playlist231are received from the management server20, the processor131determines YES in ACT5and proceeds to ACT6.

The processor131stores the sound source file232in the data memory134in ACT6. The processor131displays an abnormal sound search screen200(seeFIG.9) on the touch panel141in ACT7.

FIG.9is a schematic diagram illustrating an example of the abnormal sound search screen200. As illustrated inFIG.9, a seek bar202is displayed on the abnormal sound search screen200together with a sound source file name201and data included in the sound source record2321. When the seek bar202is tapped or dragged by the operator, a sample sound at the selected point is played. An image of a forward button203, an image of a back button204, and an image of a selection button205are displayed on the abnormal sound search screen200. When the operator touches the forward button203, the current sound source file is changed to the sound source file232to be played one after. Then, a sample sound of the sound source file232is played. When the operator touches the back button204, the current sound source file is changed to the sound source file232played one before. Then, a sample sound of the sound source file232is played. The selection button205is touched when the sample sound of the sound source file232is the same as or close to the abnormal sound that the user has heard. The displayed content of the text data and the image inFIG.9are examples.

The description refers back toFIG.5.

The processor131initializes the pointer N of the playlist231to “1” in ACT8. The processor131plays the sample sound of the sound source file232of which the pointer N is “1” in ACT9.

The processor131confirms whether the forward button203is touched in ACT10ofFIG.6. When the forward button203is touched, the processor131determines YES in ACT10and proceeds to ACT11. The processor131adds “1” to the pointer N of the playlist231in ACT11.

The processor131confirms whether the sound source file232corresponding to an addition value “N+1” of the pointer N is stored in the data memory134in ACT12. When the sound source file232is stored, the processor131determines YES in ACT12and returns to ACT9ofFIG.5. That is, the processor131plays the sample sound of the sound source file232corresponding to the addition value “N+1” of the pointer N.

When the sound source file232is not stored, the processor131determines NO in ACT12and proceeds to ACT13. The processor131controls the communication interface138so that the sound source file232corresponding to the addition value “N+1” of the pointer N is requested from the management server20in ACT13. According to this control, the file request command is transmitted via the communication interface138. A sound source file name corresponding to the addition value “N+1” of the pointer N is included in the file request command.

The processor21of the management server20waits for the reception of the file request command from the MFP10via the communication interface138in ACT33ofFIG.7.

When the file request command is received, the processor21determines YES in ACT33and proceeds to ACT34. The processor21controls the communication interface24to transmit the sound source file232corresponding to the addition value “N+1” of the pointer N to the MFP10in ACT34. According to this control, the sound source file232corresponding to the addition value “N+1” of the pointer N is transmitted via the communication interface24. Then, the processor131returns to ACT33.

The description refers back toFIG.6.

The processor131of the MFP10that controls the transmission of the file request command in ACT13waits for the sound source file232corresponding to the addition value “N+1” of the pointer N from the management server20in ACT14. When the sound source file232is received from the management server20, the processor131determines YES in ACT14and proceeds to ACT15.

The processor131stores the sound source file232in the data memory134in ACT15. Then, the processor131returns to ACT9ofFIG.5. That is, the processor131plays the sample sound of the sound source file232stored in the process of ACT15.

When the forward button203is not touched, the processor131determines NO in ACT10ofFIG.6and proceeds to ACT16. The processor131confirms whether the back button204is touched in ACT16.

When the back button204is touched, the processor131determines YES in ACT16and proceeds to ACT17. The processor131confirms whether the pointer N is “1” in ACT17. When the pointer N is “1”, the sound source file232one before does not exist. Therefore, the processor131determines YES in ACT17and returns to ACT10.

When the pointer N is not “1”, the processor131determines YES in ACT17and proceeds to ACT18. The processor131subtracts “1” from the pointer N of the playlist231in ACT18. Then, the processor131returns to ACT9ofFIG.5. That is, the processor131plays the sample sound of the sound source file232corresponding to a subtraction value “N−1” of the pointer N.

When the back button204is not touched, the processor131determines NO in ACT16ofFIG.6and proceeds to ACT19. The processor131confirms whether the selection button205is touched in ACT19. When the selection button205is not touched, the processor131determines NO in ACT19and returns to ACT10.

When the selection button205is touched, the processor131determines YES in ACT19and returns to ACT2ofFIG.5. The processor131performs the processes of ACTS2and3described above.

Here, when the abnormal sound button103of the malfunction report screen100is not touched, the processor131determines NO in ACT3and proceeds to ACT20. The processor131confirms whether the transmission button104is touched in ACT20.

When the transmission button104is touched, the processor131determines YES in ACT20and proceeds to ACT21. The processor131controls the communication interface138so that the report command is transmitted to the management server20in ACT21. According to this control, the report command is transmitted via the communication interface138. The sound source file name of the sound source file232when the selection button205is touched and the information relating to the MFP10in which the malfunction occurs are included in the report command. The information relating to the MFP10in which the malfunction occurs includes, for example, the name and the model number of the corresponding MFP10and the date and time when the malfunction occurs. With the above, the processor131ends the information processes of the procedures illustrated in the flowcharts ofFIGS.5and6.

The processor21of the management server20waits for the reception of the report command from the MFP10via the communication interface138in ACT35ofFIG.7.

When the report command is received, the processor21determines YES in ACT35and proceeds to ACT36. The processor21generates a malfunction report based on the sound source file name and the information relating to the MFP10in which the malfunction occurs included in the report command in ACT36. A link to the corresponding sound source file232is included in the malfunction report. With the above, the processor21ends the information process of the procedure illustrated in the flowchart ofFIG.7.

As clearly described above, the MFP10that is an example of the image processing device configures acquisition means by performing processes of ACTS1to6ofFIG.5. That is, the MFP acquires a plurality of kinds of sound data indicating sounds different from each other.

The processor131of the MFP10configures playing means by performing the process of ACT9ofFIG.5. That is, the MFP plays one kind of sound data from the sound data.

The processor131of the MFP10configures changing means by performing the processes of ACTS10to18ofFIG.6. That is, the MFP10changes another kind of sound data from the one kind of sound data.

The processor131of the MFP10configures determination means by performing the process of ACT19ofFIG.6. That is, the MFP10determines one kind of sound data from the sound data.

According to the present embodiment, when the operator touches the malfunction button displayed on the touch panel141of the MFP10, the malfunction report screen100is displayed as the malfunction mode. Further, when the abnormal sound button103of the malfunction report screen100is touched, the abnormal sound search screen200is displayed, and the sample sound of the sound source file232is played. When the forward button203is touched, the current sound source file is changed to the sound source file232to be played one after, and the sample sound thereof is played. When the back button204is touched, the current sound source file is changed to the sound source file232played one before, and the sample sound thereof is played. When the sample sound of the sound source file232is the same as or close to the abnormal sound that the user has heard, the selection button205is touched. Therefore, the operator can specify the abnormal sound in case of the occurrence of the malfunction with a simple operation.

The processor131of the MFP10configures output means by performing the process of ACT21ofFIG.5. That is, the MFP outputs one kind of data determined by the determination means and the information relating to the image processing device in which the malfunction occurs, that is, the MFP10. Therefore, the operator does not have to generate a malfunction report of the MFP10and no effort and time are required.

The sound source files232are prioritized in the playlist231, and the sample sounds of the sound source files232are played in a descending order of the priority. Therefore, the operator can efficiently specify the sound source file232that is the same as or close to the abnormal sound at an early stage.

In the above embodiment, the image processing device and the image processing method are described. However, the embodiments are not limited thereto.

In the above embodiments, a case where the image processing device is the MFP10is exemplified. The image processing device is not limited to the MFP10. For example, the image processing device may be a copying machine or a printer.

In the above embodiments, the playback order is described to be set in advance by the operator or the like. In addition, for example, when the user plays one sound source file232for a long period of time, the sound source file subsequently played may be set as the sound source file232of the sound that is close to the sound played for a long period of time. That is, the playlist231may be dynamically generated based on the operation of the operator. The playlist231may be common in all the MFPs or may be different for each MFP10.

In the above embodiment, the case where one sound source file232that is the same as or close to the abnormal sound heard by the user is selected is exemplified. For example, the operator may select the plurality of sound source files232. In this case, sound source file names of the plurality of sound source files232are included in the report command.

While certain embodiments have been described, the embodiments have been presented by way of example only, and are not intended to limit the scope of the disclosure. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the disclosure. These embodiments and modifications fall within the scope and spirit of the disclosure and fall within the invention described in the claims and their equivalents.