Cooperative processing system and method for acquiring device attributes using QR codes and interface connection function

A cooperative processing system includes an operation terminal and a cooperative processing device connected to each other, and is connectable to a plurality of electronic devices. The cooperative processing system causes one of electric devices to function as an input device to cause electronic data to be input therefrom and one of the electric devices to function as an output device to output the electronic data. The cooperative processing system includes an obtaining unit to obtain input device information to specify the input device and output device information to specify the output device, an input control unit to cause the input device to input electronic data through a first interface according to the input device information, and an output control unit to cause the output device to output the electronic data through a second interface according to the output device information in an format appropriate for the output device.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a cooperative processing system and a cooperative processing method.

2. Description of the Related Art

Conventionally, a control system is known that causes devices connected to a network and handle data having different data formats from each other to cooperate with each other, as disclosed in Japanese Laid-Open Patent Application Publication No. 2005-292903.

In recent years, users are likely to utilize various electronic devices such as a printer, a complex machine, a projector and the like that output electronic data, or various operation terminals such as a mobile phone, a smartphone, a tablet terminal and the like. In a form that utilizes these electronic devices and operation terminals (i.e., a system), improvement of utility value is expected by causing the various electronic devices and operation terminals to cooperate with each other.

However, in the conventional system utilizing the electronic devices and the operation terminals, there has been no structure that provides a plurality of services by causing at least one electronic device among the plurality of electronic devices connected to the system to cooperate with each other.

SUMMARY OF THE INVENTION

Accordingly, embodiments of the present invention may provide novel and useful cooperative processing system and cooperative processing method solving or reducing one or more of the above-described problems.

More specifically, the embodiments of the present invention may provide a cooperative processing system and a cooperative processing method that can provide a plurality of services by causing at least one electronic device among a plurality of electronic devices.

According to one embodiment of the present invention, there is provided a cooperative processing system including an operation terminal and a cooperative processing device connected to each other. The cooperative processing system is connectable to a plurality of electronic devices. The cooperative processing system performs a cooperative process causing one of the plurality of electric devices to function as an input device to cause electronic data to be input therefrom and one of the plurality of electric devices to function as an output device to output the electronic data. The cooperative processing system includes an obtaining unit provided in the operation terminal and configured to obtain input device information from the input device to specify the input device from the plurality of electronic devices and output device information from the output device to specify the output device from the plurality of electronic devices, an input control unit configured to cause the input device specified by the input device information to input electronic data therefrom through a first interface according to the input device information, and an output control unit configured to cause the output device specified by the output device information to output the electronic data through a second interface according to the output device information in an output format appropriate for the output device.

According to another embodiment of the present invention, there is provided a cooperative processing method using a cooperative system including an operation terminal and a cooperative processing device connected to each other. The cooperative system is connectable to a plurality of electronic devices. The cooperative processing system performs a cooperative process causing one of the plurality of electric devices to function as an input device to cause electronic data to be input therefrom and one of the plurality of electric devices to function as an output device to output the electronic data. In the cooperative processing method, input device information is obtained from the input device to specify the input device from the plurality of electronic devices, and output device information is obtained from the output device to specify the output device from the plurality of electronic devices by the operation terminal. Next, an input is controlled by causing the input device specified by the input device information to input electronic data therefrom through a first interface according to the input device information, and an output is controlled by causing the output device specified by the output device information to output the electronic data through a second interface according to the output device information in an output format appropriate for the output device.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

A description is given, with reference to the accompanying drawings, of embodiments of the present invention.

FIG. 1is a configuration drawing of an example of a cooperative processing system according to an embodiment of the present invention. In the cooperative system1inFIG. 1, an information storage device10is connected to a network N1such as a LAN (Local Area Network). Moreover, the cooperative processing system1includes one or more smartphone11and one or more tablet terminal12that are connected to the network N1. Furthermore, the cooperative processing system1includes one or more MFP (Multifunction Peripheral)13and one or more projector14that are connected to the network N1. In addition, a digital camera15, a microphone16, a loudspeaker17or a server device18or an interactive whiteboard19may be connected to the cooperative processing system1. The cooperative processing system1is an example of a service providing system.

A private environmental network such as an intranet (office network) is available for the network N1. The smartphone11and the tablet terminal12are examples of an operation terminal that a user can carry and operate. The operation terminal may be a terminal device that a user can operate such as a mobile phone and a notebook PC (Personal Computer) in addition to the smartphone11and the tablet terminal12.

The MFP13and the projector14are examples of electronic devices that input and output electronic data (e.g., printing, scanning, projection and the like). Moreover, the digital camera15, the microphone16and the loudspeaker17are also examples of electronic devices that input and/or output electronic data. The electronic devices may be devices that input and/or output electronic data such as a printer, a scanner, a copier, a display and the like in addition to the MFP13and the projector14. The display is an example of an image display device.

The MFP13is an example of an image forming device. The MFP13has an imaging function, an image forming function and a communication function, and can be used as a printer, a facsimile, a scanner and a copier. The MFP13has a Web browser function, and displays a UI (User Interface) by drawing HTML (Hyper Text Markup Language) data in the information storage device10. Furthermore, the MFP13can receive a request such as printing and scanning from a user by running a Javascript (Trademark) program on the UI. The projector14is an example of an image projection device. The projector14has a projection function and a communication function. The projector14projects and outputs image data. The digital camera15is an example of an image taking device.

The microphone16and the loudspeaker17are examples of sound input and output devices. The server device18is an example of an apparatus that implements some process such a high functional process as the MFP13or the projector14cannot process, a process as a file server and the like. The interactive whiteboard19is an example of a device that displays electronic data such as image data and document data as an output, and creates electronic data such as image data and document data by receiving a writing input and the like from a user.

The information storage device10is an example of an information processing device. The information storage device10implements such a high functional process as the MFP13or the projector14cannot process, or a process as a file server. The information storage device10provides the input and/or output of electronic data by the electronic device such as the MFP13or the projector14as a service by cooperating with the operation terminal such as the smartphone11or the tablet terminal12. The information storage device10may be configured to be dispersed to a plurality of computers.

The information storage device10is implemented by, for example, a computer system having a hardware configuration illustrated inFIG. 2. The operation terminal such as the smartphone11or the tablet terminal12is configured to include the hardware configuration illustrated inFIG. 2.FIG. 2is a hardware configuration diagram of an example of the computer system of the present embodiment.

The computer system100inFIG. 2includes an input device101, a display102, an external I/F103, a RAM104, a ROM105, a CPU106, a communication I/F107and an HDD108, each of which is connected to each other by a bus B. The input device101includes a keyboard, a mouse and the like, and is used to input each manipulate signal to the computer system100.

The display device102includes a display and the like, and displays processing results by the computer system100. The communication I/F107is an interface that connects the computer system100to the network N1. This allows the computer system100to perform data communication with the operation terminal, the electronic device and the like through the communication I/F107.

The HDD108is a non-volatile storage that stores a program and data. The program and the data includes an OS (Operating System) that is basic software to control the whole computer system100, an application program that provides a variety of functions on the OS and the like. The HDD108manages the stored program and data by a predetermined file system and/or a DB (Data Base).

The external I/F103is an interface between the computer system100and an external device. The external device includes a recording medium103aand the like. This enables the computer system100to read and/or write to the recording medium103athrough the external I/F103. Here, the recording medium103aincludes a flexible disk, a CD (Compact Disc), a DVD (Digital Versatile Disk), an SD (Secure Digital) memory card, a USB (Universal Serial Bus) memory and the like.

The ROM105is a non-volatile semiconductor memory (storage device) that can retain a program and data even when the computer100is turned off. The ROM105stores a program and data such as a BIOS (Basic Input/Output System) that is executed when the computer100starts up, an OS setting, a network setting and the like. The RAM104is a volatile semiconductor memory (storage device) that holds a program and data temporarily.

The CPU106is an arithmetic device that implements control or a function of the whole computer system100by reading the program and data from the storage device such as the ROM105or the HDD108on the RAM104and by executing the process.

The computer system100of the present embodiment can implement a variety of processes by causing the hardware resource and the program to cooperate with each other by combining the above hardware resource, the program and the data.

The operation terminal such as the smartphone11or the tablet terminal12is, for example, implemented by a hardware configuration illustrated inFIG. 3.FIG. 3is a hardware configuration diagram illustrating an example of the operation terminal of the present embodiment. The operation terminal inFIG. 3includes a CPU601, a ROM602, a RAM603, an EEPROM604, a CMOS sensor605, an acceleration/direction sensor606, a media drive608.

The CPU601controls the whole operation of the operation terminal. The ROM602stores a basic input and output program. The RAM603is used as a work area of the CPU601. The EEPROM604reads or writes data in accordance with the control of the CPU601. The CMOS sensor605takes an image of an object of shooting in accordance with the control of the CPU601and obtains image data. The acceleration/direction sensor606is, for example, an electromagnetic compass, a gyrocompass, an acceleration sensor and the like.

The media drive608controls reading or writing (storing) data to a recording medium607such as a flash memory. The media drive608is configured to be able to receive and eject the recording medium607that stores readable data having been already recorded therein or stores new data to be written therein.

Here, the EEPROM604stores association information and the like necessary for an OS executed by the CPU601and network setting. An application to implement various processes in the embodiments of the present invention is stored in the EEPROM604, the recording medium607or the like.

Moreover, the CMOS sensor605is an electric charge coupling device that digitizes an image of an object of shooting by converting light to an electric charge. As long as the CMOS605can image the object of shooting, for example, the CMOS605can be replaced by a CCD (Charge Coupled Device) sensor.

Furthermore, the operation terminal includes a voice input part609, a voice output part610, an antenna611, a communication part612, a wireless LAN communication part613, a short-range wireless communication antenna614, a short-range wireless communication part615, a display616, a touch panel617, and a bus line619.

The voice input part609converts a voice to a voice signal. The voice output part610converts a voice signal to a voice. The communication part612communicates with the nearest base station device by a wireless communication signal by using the antenna611. The wireless LAN communication part613communicates with an access point by wireless LAN communication conforming to the IEEE 80411 standard. The short-range wireless communication part615performs a short-range wireless communication (Bluetooth (Trademark) communication) using the short-range wireless communication antenna614.

The display616is made of a liquid crystal display, organic EL (Electroluminescence) display or the like that displays an image of the object of shooting and a variety of icons. The touch panel671is placed on the display616, constituted of a sensitive type or electrostatic type panel, and detects a touched position on the display616based on a touch by a finger, a touch pen or the like. The bus line619is an address bus, a data bus or the like to electrically connect each part with each other.

In addition, the operation terminal includes a dedicated battery618. The operation terminal is driven by the battery618. The voice input part609includes a microphone to allow a voice to be input. The voice output part610includes a loudspeaker to output a voice.

Thus, the operation terminal of the present embodiment can implement a variety of processes as described later by the above hardware configuration.

The information storage device10of the present embodiment is implemented by, for example, a processing block as illustrated inFIG. 4.FIG. 4is a processing block diagram of an example of the information storage device of the present embodiment. The information storage device10implements an OS21, a Web server22, a UI for PC browser24, a UI for MFP25, a WebApi26, a shared folder27, a document management part28and a Web control part29by running a program.

The OS21is an operating system of the information storage device10, and controls the whole system. The OS21is, for example, Windows (Trademark), Linux (Trademark) or the like.

The Web server22is software that sends and receives information by HTTP (Hyper Text Transfer Protocol). The Web server22is Apache Tomcat (Trademark), IIS (Trademark) or the like.

The UI for PC browser24displays a system setting screen on the operation terminal by a HTTP request. A user can change the setting from the system setting screen by using a Web browser (not shown in the drawing).

The UI for MFP25displays a screen of QR code (Trademark), an example of code information, on the electronic device such as the MFP13in accordance with the HTTP request. The QR code is a matrix type two-dimensional code. Moreover, the UI for MFP25displays a print screen and a scanning screen by the HTTP request. The user can perform printing and scanning operation by utilizing the Web browser function of the MFP13.

The WebApi (Application Programming Interface)26is available through the network N1. The WebApi26receives the HTTP request, performs a process in accordance  with the HTTP request, and performs an HTTP response. The WebApi26also creates the QR code.

The WebApi26is a preliminarily defined interface provided to receive a request from the operation terminal such as the smartphone11and the tablet terminal12, and is, for example, constituted of a function, a class or the like.

Furthermore, the WebApi26of the information storage device10can be provided for a developer of an application installed in the operation terminal as an SDK (Software Development Kit). The application developer can develop the application by using the SDK. The SDK can be provided for a third vendor other than the provider of the information storage device10. The third vendor can develop an application by using the provided SDK. The application developed by using the SDK can be installed into the operation terminal.

By providing the WebApi of the information storage device10as the SDK, the operation terminal can install not only the application developed by the provider of the information storage device10, but also the application developed by the third vendor.

The shared folder27is a folder published on the network N1by a SMB (Server Message Block) protocol. A user can access to the shared folder27by using the operation terminal such as the smartphone11or the tablet terminal12.

The document management part28manages a file put in the shared folder, and performs a process of converting data in response to a request from the Web control part29. Here, the file in the present embodiment is one form of electronic data. The Web control part29performs a process of controlling the document management part28in response to a request from the WebApi26.

Here, there are roughly divided into two processes running in the information storage device10. One process functions as the Web server22, the UI for PC browser24, the UI for MPF25and the WebApi26. Another process functions as the shared folder27, the document management part28and the Web control part29. Accordingly, the WebApi26and the Web control part29perform interprocess communication.

The operation terminal30of the present embodiment is, for example, implemented by a processing block illustrated inFIG. 5.FIG. 5is a processing block diagram of an example of the operation terminal of according to the present embodiment. The operation terminal30implements an OS31, an information storage device communication part32, a printing management part33, a projector management part34, a file list display part35, a setting information display part36, an upload screen display part37, a QR code reading part38and a preview display part39by running a program.

The OS31is an operating system of the operation terminal30. The OS31is, for example, iOS (Trademark), Android (Trademark) or the like that controls the whole system.

The information storage communication part32sends and receives information to and from the WebApi26of the information storage device10by the HTTP. In addition, the information storage device communication part32can access the shared folder27of the information storage device10by the SMB.

For example, the file list display part35, the setting information display part36and the upload screen display part37obtains electronic data or information from the information storage device10or requests a process to the information storage device10by utilizing the information storage device communication part32.

The file list display part35displays a list of files in the information storage device10, and receives selection of a file from a user. The setting information display part36performs a connection setting with the information storage device10, and/or displays the setting information of the operation terminal30. The upload screen display part37displays a menu for uploading a file to the information storage device10, and uploads the file to the information storage device10.

For example, there is a method of reading the QR code on the MFP13and uploading the file to the information storage device10by causing the MFP13to scan the file as an uploading method to the information storage device10.

Moreover, for example, there is a method of uploading the data of the operation terminal30to the information storage device10as an uploading method to the information storage device10. Furthermore, for example, there is a method of uploading picture data taken by a camera function of the operation terminal30as an uploading method to the information storage device10.

When a user selects a file from the list of the files displayed by the file list display part35, the preview display part39previews the selected file. In addition, the preview display part39displays a menu of projection and/or printing. The projector management part34performs search and registration of the projector14, and a process of causing the projector14to project the selected file. The printing management part33performs search and registration of the MFP13, and a process of causing the MFP13to print the selected file.

When the operation terminal30reads the QR code, the QR code reading part38is utilized by the preview display part39, the setting information display part36and the upload screen display part37. The QR code that the QR code reading part38reads includes a QR code for connecting the operation terminal30to the information storage device10, a QR code for specifying the MFP13to be caused to print or scan, a QR code for specifying the projector to be caused to project and the like.

Detailed description is given below of a process by the cooperative processing system1according to the present embodiment.

More specifically, a description is given below of a process when causing data to be input from an input device40and the input data to be output by an output device50.FIG. 5is a sequence diagram of an example of illustrating a processing procedure of a cooperative processing system of the present embodiment.

In step S1, a user operates the input device40to allow the user to input data, and requests the input device to display a QR code screen. In step S2, the input device40displays the QR code screen including a QR code. The QR code displayed by the input device40includes input device information (e.g., an IP address and capability information of the input device40) for specifying the input device40. Here, the capability information only has to be information from which an interface or a function that the input device40retains can be determined. The capability information may be an ID of the input device40or a character string formed by listing the interface or the function retained by the input device40. The IP address functions as connection information to be connected to the input device40.

In step S3, the user operates the output device50to output data, and requests the output device50to display a QR code. In step S4, the output device50displays a QR code screen including the QR code. The QR code displayed by the output device50includes output device information (e.g., an IP address and capability information of the output device50) for specifying the output device50. Here, the capability information only has to be information from which an interface or a function that the output device50retains can be determined. The capability information may be an ID of the output device50or a character string formed by listing the interface or the function retained by the output device50. The IP address functions as connection information to be connected to the output device50.

Here, a description is given of an example of displaying the QR code screens including the QR codes in the sequence diagram inFIG. 6, but for example, a QR code preliminarily printed on a sheet of paper and the like and attached to a casing may be available.

In step S5, the user operates the operation terminal30, and selects input and output as a service to be utilized, for example, from a screen illustrated inFIG. 7.FIG. 7is a schematic diagram of an example of a service list screen. One of the services of the input, the output, and the input and output is selected by the user from the service list screen ofFIG. 7on the operation terminal30.

The operation terminal30determines that the service selected by the user is the input and output, and that the IP address, the capability information and input and output conditions of the input device40and the output device50are information necessary for the input and output service.

To begin with, the operation terminal30displays a selection screen of the input device40illustrated inFIG. 8, and requests the user to specify the input device40.FIG. 8is a schematic diagram of an example of the selection screen of the input device40. The operation terminal30receives the selection of the input device40by the user from the selection screen of the input device40. For example, the user operates the operation terminal30and requests the operation terminal30to read the QR code of the input device40. Here, as illustrated inFIG. 8, the user may select the input device40from a device list displayed on the selection screen of the input device40.

In response to the request of reading the QR code from the user, the operation terminal30takes a picture of the QR code by using a camera function in step S6(seeFIG. 6), and reads the QR code. The operation terminal30obtains the IP address and the capability information of the input device40from the QR code.

Next, the operation terminal30displays a selection screen of the output device50similar to the selection screen of the input device40, and requests the user to specify the output device50. The operation terminal30receives the selection of the output device50by the user from the selection screen of the output device50.

For example, the user operates the operation terminal30and requests the operation terminal30to read the QR code of the output device50to specify the output device50. In response to the request of reading the QR code from the user, the operation terminal30takes a picture of the QR code by using a camera function in step S7, and reads the QR code. The operation terminal30obtains the IP address and the capability information of the output device50from the QR code. Here, as illustrated inFIG. 9, the user may select the output device50from a device list displayed on a selection screen of the output device50, or may select the output device50by reading the QR code.

In step S9, the operation terminal30displays an output condition setting screen that sets output conditions of the output device50selected by the user and is similar to the input condition setting screen inFIG. 11. The operation terminal30receives a setting of the output conditions from the output condition setting screen by the user.

In step S10, the operation terminal30sends the input device information and the output device information set by the user to the information storage device10, and requests execution of the input and output service. Here, the input device information includes the capability information, the IP address and the input conditions of the input device40. The output device information includes the capability information, the IP address and the output conditions of the output device50.

In step S11, the information storage device10confirms an interface utilized by the input device40and a file format available for the input device40from the capability information included in the input device information as illustrated inFIG. 12.

Moreover, the information storage device10confirms an interface utilized by the output device50and a file format available for the output device50from the capability information included in the output device information as illustrated inFIG. 13. Then, the information storage device10determines the interface available for the input device40and the output device50. In addition, the information storage device10determines a file format to be utilized based on the format available for the input device40and the output device50and further determines whether data conversion is necessary or not.

Here, when there is a plurality of interfaces available for the input device40and the output device50, the interface to be utilized may be determined by preliminarily established priority or the like. When there is a plurality of file formats that the input device40and the output device50can handle, the information storage device10may determine the file format to be used by the input device40and the output device50by preliminarily established priority or the like.

In step S12, the information storage device10provides an input instruction according to the input conditions for the input device40by way of the interface determined to be used in step S11. Upon receiving the input instruction from the information storage device10, the input device40executes an input process according to the input conditions in step S13. After finishing the input process, the input device40sends obtained input data to the information storage device10as input process results in step S14to the information storage device10.

In step S15, the information storage device10converts the input data received from the input device40to the file format of the output device50that the information storage device10has determined to use in step S11.

In step S16, the information storage device10provides an output instruction according to the output conditions for the output device50by way of the interface determined to be used in step S11. Upon receiving the output instruction from the information storage device10, the output device50executes an output process according to the output conditions in step S17.

Here, a description is given below of a process of the operation terminal30in steps S5through S9by using a flowchart describing the process in detail illustrated inFIG. 14.

The operation terminal30displays a screen such asFIG. 7, and allows the user to select a service the user wants to use from the displayed screen (step S31). Next, the operation terminal determines whether the selected service is the input service or not (step S32).

When the selected service is the input service (step S32: YES), the operation terminal30obtains capability information of the input device40by taking a picture of the QR code displayed on (or attached to) the input device40(step S33). Furthermore, the operation terminal30displays an input condition setting screen as illustrated inFIG. 10to set input conditions of the input device40selected by the user, and receives an input of the input conditions from the user (step S34).

With respect to the output conditions, for example, the operation terminal30may preliminarily store the conditions set for each device as illustrated inFIG. 15, and may display setting items corresponding to the capability information of the output device50having been obtained in step S33as the setting items of the output conditions. Moreover, the capability information of the output device50having been obtained in step S33may include the setting items of the output conditions, and the operation terminal30may display the setting items contained in the obtained capability information of the output device50. The operation terminal30sends the capability information that the operation terminal30has obtained in step S37and the input conditions that the operation terminal30has accepted as the input in step S38to the information storage device10(step S39).

When the selected service is not the output service (step S36: NO), the operation terminal30obtains capability information of the input device40similarly to step S33(step S40). Next, the operation terminal30obtains the capability information of the output device50similarly to step S37(step S41). Subsequently, the operation terminal30receives the setting of the input conditions similarly to step S34(step S42). Next, the operation terminal30receives the setting of the output conditions similarly to step S38(step S43).

After that, the operation terminal30sends the capability information that the operation terminal30has obtained insteps S40and S41, and the input conditions and the output conditions that the operation terminal30has accepted in steps S42and S43, respectively, to the information storage device10(step S44).

<<Other Process Procedure of Cooperative Processing System1>>

The cooperative processing system1of the present embodiment is not limited to the above. A variety of configurations can be implemented such as a configuration of providing an input and output instruction for the input and output device40,50from the information storage device10by way of the operation terminal30, a configuration of the operation terminal30converting the input data, and a configuration of sending the output data to the output device50by way of the output device50.

Moreover, capability information of an electronic device may contain information of interfaces corresponding to the electronic device, and the information storage device10may determine an interface to connect with the electronic device based on received capability information.

As described above, according to the cooperative processing system1of embodiments of the present invention, a user can obtain information to specify an electronic device such as a QR code by passing the operation terminal30such as the smartphone1or the tablet terminal12over the electronic device such as the MFP13or the projector14. The user can readily specify an electronic device to input electronic data and an electronic device to output electronic data from a plurality of electronic devices. The information storage device10can determine an interface to be utilized by the electronic device to input the electronic data and the electronic device to output the electronic data, and can control the electronic devices through the interface.

Accordingly, according to the cooperative processing system1of the embodiments of the present invention, the user can provide a variety of services by causing the operation terminal30and an information processing device such as the information storage device10to cooperate to control one or more electronic device.

Thus, according to the embodiments of the present invention, a plurality of services can be provided by cooperating one or more electronic device among a plurality of electronic devices.

The present invention is not limited to the specifically disclosed embodiments, and variations and modifications may be made without departing from the scope of the present invention. For example, an obtaining unit recited in claims corresponds to the setting information display part36and the QR code reading part38. In addition, for example, an available interface determination unit and a data conversion necessity determination unit correspond to the WebApi26. For example, a cooperative processing device corresponds to the information storage device10.

The present application is based on and claims the benefit of priority of Japanese Priority Patent Application No. 2013-100634, filed on May 10, 2013, and Japanese Priority Patent Application No. 2014-90952, filed on Apr. 25, 2014, the entire contents of which are incorporated herein by reference.