Patent Description:
Known systems distribute a video image captured using an image capturing device, and a state of a site where the image capturing device is provided is viewable from other sites in real time.

In addition, techniques for storing, in an external storage service, data acquired by a device such as an image capturing device participating in a remote communication are known.

For example, <CIT> discloses a method of storing settings of an external storage service for each user in a server device and reading setting information stored in the server device by an electronic whiteboard, for a purpose of reducing time and effort for selecting an external storage service that is to be a transmission destinatior.

Patent application <CIT> discloses a system and method that allows users to store, retrieve, and manipulate on-demand media content and data stored on a remote server network in an on-demand media delivery system. More particularly, the system allows a user to access their on-demand media account from user equipment in different locations as long as the current user equipment can communicate with a remote server that stores user-specific information. Users may upload personal images or files to an on-demand delivery server for later retrieval and display.

However, in such a conventional method, in a case where data acquired by a device such as an image capturing device or an electronic whiteboard that is participating in an event such as a remote communication is uploaded to external storage with user authority, processing including user authentication with the device occurs, and the processing takes time and effort.

An embodiment of the invention includes a management system according to claim <NUM>. Other embodiments of the invention include a method according to claim <NUM> and carrier means according to claim <NUM>.

According to one or more embodiments of the present disclosure, time and effort taken by processing in uploading data acquired by a device to external storage with user authority is reduced.

Hereinafter, embodiments of the present disclosure are described with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant descriptions thereof are omitted.

Referring to <FIG>, an overview of a communication system <NUM> according to an embodiment is described below. <FIG> is a diagram illustrating an example of an overall configuration of the communication system <NUM> according to the present embodiment. The communication system <NUM> illustrated in <FIG> is a system in which a captured image such as a video image distributed from a distribution site is displayed at a plurality of browsing sites by participating in a predetermined event such as a remote communication provided by a management system <NUM>, and thereby a state of the distribution site is viewable in real time. The browsing site, which may be referred to as a viewer site, is a site where a user who views the image resides. In the description of the present embodiment, examples of the predetermined event include a remote conference, a remote class, a remote medical examination, a meeting or consultation, inspection for a remote site, monitoring for a remote site, and patrol for remote site that are implemented by communication between remote sites via the management system <NUM>.

As illustrated in <FIG>, the communication system <NUM> includes a communication terminal <NUM> located at a browsing site, an image capturing device <NUM> located at a site being as a distribution site, a management server <NUM>, and an authorization server <NUM>. The communication terminal <NUM>, the image capturing device <NUM>, the management server <NUM>, and the authorization server <NUM> included in the communication system <NUM> are communicably connected to each other via a communication network <NUM>. The communication network <NUM> includes, for example, the Internet, a mobile communication network, a local area network (LAN). The communication network <NUM> includes a network by not only wired communications but also a network by wireless communications such as 3rd generation (<NUM>), 4th generation (<NUM>), 5th generation (<NUM>), WIRELESS FIDELITY (registered trademark) (Wi-Fi), Worldwide Interoperability for Microwave Access (WiMAX) or Long Term Evolution (LTE).

The communication terminal <NUM> is a computer such as a notebook Personal Computer (PC) used by a user at the browsing site. For example, the communication terminal <NUM> participates in a predetermined event provided by the management server <NUM> after user authentication performed by the management server <NUM>. The communication terminal <NUM> displays a captured image (image) captured, or obtained, by the image capturing device <NUM> installed at the distribution site, and allows the user to browse a state of the distribution site.

The communication terminal <NUM> is not limited to the notebook PC, and may be, for example, a desktop PC, a smartphone, a tablet terminal, a wearable terminal, a Head Mount Display (HMD), or an Interactive White Board (IWB: an electronic whiteboard having mutual communication capability).

The image capturing device <NUM> is a device that is installed at the distribution site that is a site such as an office or a factory and participates in a predetermined event provided by the management server <NUM>. The image capturing device <NUM> is registered, in advance, with the management server <NUM>. When an event is started in response to a request from a user, the image capturing device <NUM> activates an installed application and participates in the event as a participant. The image capturing device <NUM> captures an image of an object or surroundings such as scenery in the distribution site, obtains the captured image (image), and transmits the captured image (image) to the communication terminal <NUM> participating in the event via the management server <NUM>. The captured image (image) obtained by the image capturing device <NUM> may be a video image or a still image, or may include both of a video image and a still image. Further, the captured image (image) may be provided with audio.

The image capturing device <NUM> is an example of a device that participates in an event provided by the management server <NUM>. The device participating in an event is not limited to an image capturing device, and may be a video conference terminal, an Interactive White Board (IWB: an electronic whiteboard having mutual communication capability), or a mobile object such as a robot that moves around within a distribution site.

In addition, the distribution site where the image capturing device <NUM> is installed is not limited to an office, a factory, or the like, and may be, for example, an outdoor site such as a business facility, a construction site, a substation, a farmstead, a field, an agricultural farm, a cultivated land, or a disaster site, or an indoor site such as a school, a warehouse, a commercial facility, a hospital, or a nursing facility. That is, the distribution site where the image capturing device <NUM> is installed may be any site where a user desires to execute an event such as a remote conference or a remote inspection from a browsing site.

The management server <NUM> is a server computer that provides and manages events executed between the communication terminal <NUM> and the image capturing device <NUM>. The management server <NUM> manages and controls communication between the communication terminal <NUM> and the image capturing device <NUM>, and relays image data to be transmitted or received. The authorization server <NUM> is a server computer that performs authentication and authorization processing for a user who is to participate in an event provided by the management server <NUM>. The authorization server <NUM> also cooperates with an external storage service that provides external storage <NUM> and stores an authorization token (access information for the external storage <NUM>) associated with a user who has a contract to use the external storage <NUM>.

The management server <NUM> and the authorization server <NUM> are included in a management system <NUM>. The management system <NUM> may be, for example, a computer in which all or some of the functions of the management server <NUM> and the authorization server <NUM> are combined. In addition, each of the management server <NUM> and the authorization server <NUM> may be implemented by a plurality of computers in manner that the functions of each of the management server <NUM> and the authorization server <NUM> are distributed among the plurality of computers. In the description of the present embodiment, the management server <NUM> and the authorization server <NUM> are server computers being in a cloud environment. In some embodiments, the management server <NUM> and the authorization server <NUM> are server computers being in an on-premises environment.

The external storage <NUM> is a storage service (or online storage) provided by an external providing service via the communication network <NUM>. The external storage <NUM> is, for example, a storage destination for storing a data file on a cloud, and a user who has a contract to use an external storage service may store and browse data using his/her own authorization token.

Referring to <FIG> and <FIG>, examples of usage scenes of the communication system <NUM> are described below. <FIG> and <FIG> are diagrams each illustrating an example of an overview of the communication system <NUM> according to the present embodiment.

<FIG> is a diagram illustrating an example of a usage scene of the communication system <NUM> in which remote communication is established between a plurality of image capturing devices <NUM> (30A to 30C) installed in a distribution site and a communication terminal 10A used by an administrator A who is a user at a browsing site A.

The distribution site illustrated in <FIG> is, for example, a site such as a factory or a warehouse where predetermined work is performed by a plurality of workers. As illustrated in <FIG>, the plurality of image capturing devices <NUM> (30Ato 30C) are installed at the distribution site. Among them, the image capturing device 30A and the image capturing device 30B are installed so as to be fixed on, for example, working benches in the site and perform image capturing processing in relation to the surroundings of the installation positions. The image capturing device 30C is provided in a robot that travels within the distribution site, and performs image capturing while the robot travels. Each of the image capturing devices <NUM> (30Ato 30C) transmits an acquired captured image (image) to the communication terminal 10A used by the administrator A so as to be displayed in an event being executed among the image capturing devices <NUM> and the communication terminal 10A, which is used by the administrator A. In addition, the administrator A, who is a user at the browsing site A that is a remote location, uses the communication terminal <NUM> A to perform the remote communication with the image capturing device <NUM>, which is installed at the distribution site, thereby viewing a captured image (image) representing a state of the distribution site, or performing maintenance management of the distribution site.

In addition, as illustrated in <FIG>, a plurality of users located at different browsing sites may participate in an event and perform remote communication with the image capturing devices <NUM> installed at a distribution site. <FIG> is a diagram illustrating an example of a usage scene of the communication system <NUM> in which the administrator A who is a user at the browsing site A and an administrator B who is a user at a browsing site B respectively use the communication terminal 10A and a communication terminal 10B to establish remote communication with the image capturing devices <NUM> installed in the distribution site by participating in the same event.

In each of the use scenes illustrated in <FIG> and <FIG>, a device such as an image capturing device is participating in an event as a site-participant in the same manner as a user participant participating in an event such as a web conference using a communication terminal. In such use scenes, there may be a desire to have a device at a remote location take a photograph (image) according to an instruction from a user participating in the event and upload the photograph (image) to external storage in relation to which the user has a contract.

However, conventionally, in order to upload, to external storage of a specific user, data acquired by a device such as an image capturing device participating in an event such as a remote conference, the device is caused to have authentication information of the user so that the device directly uploads the data to the external storage with user authority, or the device transfers the data to a communication terminal used by the user before uploading the data. Accordingly, processing of uploading data acquired by the device to the external storage with the user authority includes, for example, processing for user authentication with the device, and thereby the processing takes time and effort.

To deal with this, in the communication system <NUM>, the management server <NUM> acquires an authorization token for accessing the external storage <NUM> with user authority based on a request from a user who is a contractor of the external storage <NUM>, and the image capturing device <NUM> transmits information for specifying the authorization token together with the acquired data to the management server <NUM>. More specifically, on the premise that the management server <NUM> operates as a resource server of Open Authorization (OAuth) <NUM> and acquires an access token of a user, the management server <NUM> temporarily stores an authorization token and provides the authorization token to the external storage <NUM> together with data acquired from the image captured device <NUM>, thereby the data is to be uploaded without passing access information of the user such as the authorization token for the external storage <NUM> to the image capturing device <NUM>.

Accordingly, the communication system <NUM> directly uploads the data acquired by the device to the external storage <NUM> without performing a device operation by the user and user authentication with the device. For example, image data or the like acquired from a device installed at a distribution site as illustrated in <FIG> and <FIG> is uploaded from the device to the external storage <NUM> in relation to which a user at a browsing site has a contract, and thereby time and effort for the processing of uploading may be reduced.

Next, referring to <FIG>, hardware configurations of each apparatus, device, and terminal of the communication system <NUM> are described according to the present embodiment. In the hardware configuration illustrated in <FIG>, components or elements may be added or deleted as appropriate.

A hardware configuration of the communication terminal <NUM> according to the present embodiment is described with reference to <FIG> is a block diagram illustrating an example of a hardware configuration of the communication terminal <NUM> according to the present embodiment. The communication terminal <NUM> is implemented by a computer, and as illustrated in <FIG>, includes a central processing unit (CPU) <NUM>, a read only memory (ROM) <NUM>, a random access memory (RAM) <NUM>, a hard disk (HD) <NUM>, a hard disk drive (HDD) controller <NUM>, a display <NUM>, an external device connection interface (I/F) <NUM>, a network I/F <NUM>, a bus line <NUM>, a keyboard <NUM>, an audio output/input I/F <NUM>, a microphone <NUM>, a speaker <NUM>, a camera <NUM>, a pointing device <NUM>, a digital versatile disc rewritable (DVD-RW) drive <NUM> and a medium I/F <NUM>.

The CPU <NUM> controls entire operation of the communication terminal <NUM>. The ROM <NUM> stores a program used for driving the CPU <NUM>, such as an initial program loader (IPL). The RAM <NUM> is used as a work area of the CPU <NUM>. The HD <NUM> stores various data such as a program. The HDD controller <NUM> controls reading or writing of various data to the HD <NUM> under the control of the CPU <NUM>. The display <NUM> is an example of a display unit (display means) that displays various types of information such as a cursor, a menu, a window, characters, or an image. In one example, the display <NUM> is a touch panel display provided with an input device (input means). The external device connection I/F <NUM> is an interface for connecting various external devices. The network I/F <NUM> is an interface for performing data communication using the communication network <NUM>. The bus line <NUM> is, for example, an address bus or a data bus, which electrically connects the elements such as the CPU <NUM> illustrated in <FIG>.

The keyboard <NUM> is an example of an input device (input means) including a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device <NUM> is an example of the input device (input means) that allows a user to select or execute various instruction, select a target for processing, or move a cursor being displayed. The input device (input means) is not limited to the keyboard <NUM> and the pointing device <NUM>, and may be a touch panel, a voice input device, or the like. The audio input/output I/F <NUM> is a circuit for inputting or outputting an audio signal between the microphone <NUM> and the speaker <NUM> under control of the CPU <NUM>. The microphone <NUM> is an example of a built-in audio collecting unit (audio collecting means) to input audio. The speaker <NUM> is an example of a built-in output unit (output means) to output an audio signal. The camera <NUM> is an example of a built-in image capturing unit (image capturing means) to capture an image of an object to obtain image data. Note that the microphone <NUM>, the speaker <NUM>, or the camera <NUM> may be an external device in alternative to the built-in device of the communication terminal <NUM>. The DVD-RW drive <NUM> controls reading or writing of various data to or from a DVD-RW <NUM>, which is an example of a removable recording medium. The removable recording medium is not limited to the DVD-RW and may be a digital versatile disk-recordable (DVD-R), or a BLU-RAY (registered trademark) disc (BLU-RAY disk), for example.

The medium I/F <NUM> controls reading or writing (storing) of data from or to a storage medium (recording medium) <NUM> such as a flash memory.

Referring to <FIG>, a hardware configuration of the image capturing device <NUM> according to the present embodiment is described below. <FIG> is a block diagram illustrating an example of a hardware configuration of an image capturing device according to the present embodiment. In <FIG>, as an example of the image capturing device <NUM>, a spherical image capturing device that acquires a spherical image by capturing an image of an object or surroundings such as scenery is illustrated. In some embodiments, the image capturing device <NUM> is a general-purpose digital camera or a camera of a smartphone that acquires a general planar image. In some embodiments, the image capturing device <NUM> is a wide-angle camera that acquires a wide-angle image having an angle of view equal to or larger than a predetermined value. In the following description of the embodiment, the image capturing device <NUM> that is a spherical (omnidirectional) image capturing device having two imaging elements is used. However, the image capturing device <NUM> may have more than two imaging elements. In addition, the image capturing device <NUM> is not necessarily an image capturing device dedicated to omnidirectional image capturing. Alternatively, an external omnidirectional image capturing unit may be attached to a general-purpose digital camera or a smartphone to implement an image capturing device having substantially the same function as that of the image capturing device <NUM> according to the present embodiment.

As illustrated in <FIG>, the image capturing device <NUM> includes an imaging unit <NUM>, an image processor <NUM>, an imaging controller <NUM>, a microphone <NUM>, an audio processor <NUM>, a CPU <NUM>, a ROM <NUM>, a static random access memory (SRAM) <NUM>, a dynamic random access memory (DRAM) <NUM>, an operation unit <NUM>, an input/output I/F <NUM>, a short-range communication circuit <NUM>, an antenna 317a for the short-range communication circuit <NUM>, an electronic compass <NUM>, a gyro sensor <NUM>, an acceleration sensor <NUM>, and a network I/F <NUM>.

The imaging unit <NUM> includes two wide-angle lenses (so-called fish-eye lenses) 302a and 302b (collectively referred to as lens <NUM> unless they need to be distinguished from each other), each having an angle of view of equal to or greater than <NUM> degrees so as to form a hemispherical image. The imaging unit <NUM> further includes the two imaging elements 303a and 303b corresponding to the lenses 302a and 302b respectively. The imaging elements 303a and 303b each includes an imaging sensor such as a complementary metal oxide semiconductor (CMOS) sensor and a charge-coupled device (CCD) sensor, a timing generation circuit, and a group of registers. The imaging sensor converts an optical image formed by the lenses 302a and 302b into electric signals to output image data. The timing generation circuit generates horizontal or vertical synchronization signals, pixel clocks and the like for the imaging sensor. Various commands, parameters and the like for operations of the imaging elements 303a and 303b are set in the group of registers.

Each of the imaging elements 303a and 303b of the imaging unit <NUM> is connected to the image processor <NUM> via a parallel I/F bus. In addition, each of the imaging elements 303a and 303b of the imaging unit <NUM> is connected to the imaging controller <NUM> via a serial I/F bus such as an Inter Integrated Circuit (I2C) bus. The image processor <NUM>, the imaging controller <NUM>, and the audio processor <NUM> are each connected to the CPU <NUM> via a bus <NUM>. Furthermore, the ROM <NUM>, the SRAM <NUM>, the DRAM <NUM>, the operation unit <NUM>, the input/output I/F <NUM>, the short-range communication circuit <NUM>, the electronic compass <NUM>, the gyro sensor <NUM>, the acceleration sensor <NUM>, and the network I/F <NUM> are also connected to the bus <NUM>.

The image processor <NUM> acquires image data from each of the imaging elements 303a and 303b via the parallel I/F bus and performs predetermined processing on each image data. Thereafter, the image processor <NUM> combines these image data to generate data of an equirectangular projection image.

The imaging controller <NUM> usually functions as a master device while each of the imaging elements 303a and 303b usually functions as a slave device. The imaging controller <NUM> sets commands or the like in the group of registers of each of the imaging elements 303a and 303b via the I2C bus. The imaging controller <NUM> receives various commands from the CPU <NUM>. In addition, the image controller <NUM> obtains status data of the group of registers of each of the imaging elements 303a and 303b through the I2C bus and transmits the status data to the CPU <NUM>.

The imaging controller <NUM> instructs the imaging elements 303a and 303b to output the image data at a time when the shutter button of the operation unit <NUM> is pressed. In some cases, the image capturing device <NUM> displays a preview image on a display (e.g., a display of an external terminal such as a smartphone that performs short-range communication with the image capturing device <NUM> through the short-range communication circuit <NUM>) or displays a moving image (video image, movie). In case of displaying movie, image data are continuously output from the imaging elements 303a and 303b at a predetermined frame rate (frames per minute).

Furthermore, the imaging controller <NUM> operates in cooperation with the CPU <NUM>, to synchronize the time when the imaging element 303a outputs image data and the time when the imaging element 303b outputs the image data. In the present embodiment, the image capturing device <NUM> does not include a display unit (display). However, in some embodiments, the image capturing device <NUM> may include a display. The microphone <NUM> converts sound into audio data (signals). The audio processor <NUM> obtains audio data output from the microphone <NUM> via an I/F bus and performs predetermined processing on the audio data.

The CPU <NUM> controls entire operation of the image capturing device <NUM>, for example, by performing predetermined processing. The ROM <NUM> stores various programs for execution by the CPU <NUM>. Each of the SRAM <NUM> and the DRAM <NUM> operates as a work memory to store programs loaded from the ROM <NUM> for execution by the CPU <NUM> or data in current processing. More specifically, in one example, the DRAM <NUM> stores image data currently processed by the image processor <NUM> and data of the equirectangular projection image on which processing has been performed.

The operation unit <NUM> collectively refers to various operation keys, a power switch, the shutter button, and a touch panel having functions of both displaying information and receiving input from a user, which can be used in combination. The user operates the operation unit <NUM> to input various image capturing (photographing) modes or image capturing (photographing) conditions.

The input/output I/F <NUM> collectively refers to an interface circuit such as a universal serial bus (USB) I/F that allows the image capturing device <NUM> to communicate data with an external medium such as a secure digital (SD) card or an external personal computer. The input/output I/F <NUM> supports at least one of wired and wireless communications. The data of the equirectangular projection image, which is stored in the DRAM <NUM>, is stored in the external medium via the input/output I/F <NUM> or transmitted to an external terminal (apparatus) via the input/output I/F <NUM>, as appropriate.

The short-range communication circuit <NUM> communicates data with the external terminal (apparatus) via the antenna 317a of the image capturing device <NUM> by short-range wireless communication such as near field communication (NFC), BLUETOOTH (registered trademark), and Wi-Fi. The short-range communication circuit <NUM> transmits the data of equirectangular projection image to an external terminal (apparatus).

The electronic compass <NUM> calculates an orientation of the image capturing device <NUM> from the Earth's magnetism to output orientation information. This orientation and tilt information is an example of related information, which is metadata described in compliance with Exchangeable image file format (Exif). This information is used for image processing such as image correction of captured images. The related information also includes a date and time when the image is captured by the image capturing device <NUM>, and a data size of the image data. The gyro sensor <NUM> detects the change in tilt of the image capturing device <NUM> (roll, pitch, yaw) with movement of the image capturing device <NUM>. The change in angle is one example of related information (metadata) described in compliance with Exif. This information is used for image processing such as image correction of captured images. The acceleration sensor <NUM> detects acceleration in three axial directions. The image capturing device <NUM> calculates position (an angle with respect to the direction of gravity) of the image capturing device <NUM>, based on the acceleration detected by the acceleration sensor <NUM>. With the acceleration sensor <NUM>, the image capturing device <NUM> corrects tilt of image with high accuracy. The network I/F <NUM> is an interface for performing data communication, via such as a router, using the communication network <NUM> such as the Internet.

Next, a hardware configuration of the management server <NUM> is described with reference to <FIG> is a block diagram illustrating an example of a hardware configuration of the management server <NUM> according to the present embodiment. Each of the elements of hardware configuration of the management server <NUM> is denoted by a reference numeral in <NUM> series. The management server <NUM> is implemented by a computer, and as illustrated in <FIG>, includes a CPU <NUM>, a ROM <NUM>, a RAM <NUM>, an HD <NUM>, an HDD controller <NUM>, a display <NUM>, an external device connection I/F <NUM>, a network I/F <NUM>, a bus line <NUM>, a keyboard <NUM>, a pointing device <NUM>, a DVD-RW drive <NUM>, and a medium I/F <NUM>.

The CPU <NUM> controls entire operation of the management server <NUM>. The ROM <NUM> stores a program such as an Initial Program Loader (IPL) used for driving the CPU <NUM>. The RAM <NUM> is used as a work area for the CPU <NUM>. The HD <NUM> stores various data such as a program. The HDD controller <NUM> controls reading or writing of various data to or from the HD <NUM> under control of the CPU <NUM>. The display <NUM> displays various types of information such as a cursor, a menu, a window, characters, or an image. In one example, the display <NUM> is a touch panel display provided with an input device (input means). The external device connection I/F <NUM> is an interface for connecting to various external devices. The network I/F <NUM> is an interface for performing data communication using the communication network <NUM>. The bus line <NUM> is, for example, an address bus or a data bus, which electrically connects the elements such as the CPU <NUM> illustrated in <FIG>.

The keyboard <NUM> is one example of an input device (input means) including a plurality of keys for inputting characters, numerical values, various instructions, and the like. The pointing device <NUM> is an example of the input device (input means) that allows a user to select or execute various instructions, select a target for processing, or move a cursor being displayed. The input device (input means) is not limited to the keyboard <NUM> and the pointing device <NUM>, and may be a touch panel, a voice input device, or the like. The DVD-RW drive <NUM> controls reading or writing of various data to or from a DVD-RW <NUM>, which is an example of a removable recording medium. The removable recording medium is not limited to the DVD-RW and may be a DVD-R, or a BLU-RAY (registered trademark) disc (BLU-RAY disk), for example. The medium I/F <NUM> controls reading or writing (storing) of data from or to a storage medium (recording medium) <NUM> such as a flash memory.

<FIG> is a diagram illustrating an example of a hardware configuration of the authorization server <NUM> according to the present embodiment. Each hardware element of the authorization server <NUM> is denoted by a reference numeral in <NUM> series. The authorization server <NUM> is implemented by a computer and has the same configuration as that of the management server <NUM> as illustrated in <FIG>, and thus the description of each of the elements of the hardware configuration is omitted.

Further, any one of the above-described control programs may be recorded in a file in a format installable or executable on a computer-readable recording medium for distribution. Examples of the recording medium include a Compact Disc Recordable (CD-R), a DVD, a BLU-RAY Disc, an SD card, and a USB memory. In addition, such recording media may be provided in the domestic markets or foreign markets as program products. For example, the management system <NUM> implements a method according to the present disclosure by executing a program according to the present disclosure.

A description is now given of a functional configuration of the communication system <NUM> according to the present embodiment of the disclosure, with reference to <FIG>. <FIG> is a block diagram illustrating an example of a functional configuration of the communication system <NUM> according to the present embodiment. A part that is related to processing or operation, which is described later, of the devices and terminals of <FIG> is illustrated in <FIG>.

Referring to <FIG>, a functional configuration of the communication terminal <NUM> is described below. The communication terminal <NUM> includes a transmission/reception unit <NUM>, a reception unit <NUM>, a display control unit <NUM>, a determination unit <NUM>, and a storing/reading unit <NUM>. Each of these units is a function or a means that is implemented by operating any of the elements illustrated in <FIG> with instructions from the CPU <NUM> according to the control program for a communication terminal expanded from the HD <NUM> to the RAM <NUM>. The communication terminal <NUM> further includes a storage unit <NUM> that is implemented by the ROM <NUM>, the HD <NUM>, or the storage medium <NUM> illustrated in <FIG>.

The transmission/reception unit <NUM> is mainly implemented by processing of the CPU <NUM> in relation to the network I/F <NUM> and transmits or receives various data or information to or from other devices or terminals through the communication network <NUM>.

The reception unit <NUM> is implemented mainly by processing of the CPU <NUM> and the keyboard <NUM> or the pointing devices <NUM> and receives various selections or inputs from users.

The display control unit <NUM> is implemented mainly by processing of the CPU <NUM> and causes the display <NUM> to display various screens by accessing the management server <NUM> using a web browser. Specifically, for example, the display control unit <NUM> starts and executes an application or a browser installed on the communication terminal <NUM> to access the management server <NUM>. Then, the display control unit <NUM> downloads, for example, Web Application (WebAPP) that includes at least Hyper Text Markup Language (HTML) and further includes Cascading Style Sheets (CSS) or JAVA SCRIPT, and causes the display <NUM> to display various image data generated using the WebAPP. For example, the display control unit <NUM> causes the display <NUM> to display image data generated by HTML5 that includes data in a format of Extensible Markup Language (XML), JavaScript Object Notation (JSON), or Simple Object Access Protocol (SOAP).

The determination unit <NUM> is implemented by processing of the CPU <NUM> and executes various determinations.

The storing/reading unit <NUM> is implemented mainly by processing of the CPU <NUM> and stores various types of data (or information) in the storage unit <NUM> or reads various types of data (or information) from the storage unit <NUM>.

Referring to <FIG>, a functional configuration of the image capturing device <NUM> according to the present embodiment is described below. The image capturing device <NUM> includes a transmission/reception unit <NUM>, an application activation unit <NUM>, an imaging control unit <NUM>, and a storing/reading unit <NUM>. Each of these units is a function or a means that is implemented by operating any of the elements illustrated in <FIG> with instructions from the CPU <NUM> according to the control program for an image capturing device expanded from the SRAM <NUM> to the DRAM <NUM>. The image capturing device <NUM> further includes a storage unit <NUM> that is implemented by the ROM <NUM>, the SRAM <NUM>, or the DRAM <NUM> illustrated in <FIG>. The storage unit <NUM> stores a Globally Unique Identifier (GUID) identifying the own device (i.e., the image capturing device <NUM>).

The transmission/reception unit <NUM> is mainly implemented by processing of the CPU <NUM>, and transmits or receives various data or information to or from other devices or terminals. The transmission/reception unit <NUM> communicates data with other devices or terminals through the communication network <NUM> via the network I/F <NUM>.

The application activation unit <NUM> is mainly implemented by processing of the CPU <NUM>, and activates an application to participate in an event provided by the management server <NUM> in response to a request from the management server <NUM>. The image capturing device <NUM> participates in an event provided by the management server <NUM> by activating an application installed by the application activation unit <NUM>.

The imaging control unit <NUM> is mainly implemented by the imaging unit <NUM>, the image processor <NUM>, and the imaging controller <NUM> each illustrated in <FIG> and operating according to instructions of the CPU <NUM>. The image control unit <NUM> captures an image of the object or surroundings (for example, scenery) to obtain captured image data.

The storing/reading unit <NUM> is implemented mainly by processing of the CPU <NUM> and stores various types of data (or information) in the storage unit <NUM> or reads various types of data (or information) from the storage unit <NUM>. In addition, in the storage unit <NUM>, captured image data acquired by the imaging control unit <NUM> performing image capturing processing. The captured image data stored in the storage unit <NUM> is associated with an image capturing time of the captured image as metadata.

Referring to <FIG>, a functional configuration of the management server <NUM> is described below. The management server <NUM> includes a transmission/reception unit <NUM>, a determination unit <NUM>, an authorization processing unit <NUM>, an operation information generation unit <NUM>, a message processing unit <NUM>, an upload processing unit <NUM>, and a storing/reading unit <NUM>. Each of these units is a function or a means that is implemented by operating any of the elements illustrated in <FIG> with instructions from the CPU <NUM> according to the control program for a management server expanded from the HD <NUM> to the RAM <NUM>. The management server <NUM> further includes a storage unit <NUM> that is implemented by the ROM <NUM>, the HD <NUM>, or the storage medium <NUM> illustrated in <FIG>.

The determination unit <NUM> is implemented by processing of the CPU <NUM> and performs various determinations. The authorization processing unit <NUM> is mainly implemented by processing of the CPU <NUM>, and performs authentication for a user by using the authorization server <NUM>.

The operation information generation unit <NUM> is mainly implemented by processing of the CPU <NUM>, and generates operation information related to an operation requested with respect to a device such as the image capturing device <NUM> based on an operation request, which is with respect to the device, transmitted from the communication terminal <NUM>. For example, the operation information generation unit <NUM> generates operation information in which operation identification information for identifying a device operation corresponding to the received operation request is associated with an authorization token for the external storage <NUM> of the user who is a request source. The management server <NUM> stores the operation information generated by the operation information generation unit <NUM>, and uses the authorization token included in the stored operation information in a subsequent step.

The message processing unit <NUM> is mainly implemented by processing of the CPU <NUM>, and executes processing for performing arbitrary message exchange between participants participating in an event. For example, in response to a message transmission request transmitted from the communication terminal <NUM> used by the user who is a participant of an event, the message processing unit <NUM> transmits a message to a device such as the image capturing device <NUM> that is another participant of the event.

The upload processing unit <NUM> is mainly implemented by processing of the CPU <NUM>, and uses the authorization token included in the operation information generated by the operation information generation unit <NUM> to upload information acquired in accordance with an operation of the image capturing device <NUM> or the like to the external storage <NUM> to which the user being the request source has access authority.

The storing/reading unit <NUM> is implemented mainly by processing of the CPU <NUM> and stores various types of data (or information) in the storage unit <NUM> or reads various types of data (or information) from the storage unit <NUM>. Note that the storage unit <NUM> may be configured as a storage device external to the management server <NUM>.

<FIG> is a conceptual diagram illustrating an example of a user information management table, according to the present embodiment. The storage unit <NUM> includes a user information management database (DB) <NUM> including the user information management table as illustrated in <FIG>.

In the user information management table, user information in which user identification information (user identification (ID) and user name) for identifying a user managed by the management server <NUM> and an authorization token for the external storage <NUM> are associated with each other is stored. The authorization token is access information for accessing the external storage <NUM> with respect to which the user has a contract, that is, the external storage <NUM> to which the user has access authority. That is, the authorization token is uniquely specified for each user. The user information management table stores, as the user information, an authorization token that is access information for accessing the external storage <NUM> in association with each user.

<FIG> is a conceptual diagram illustrating an example of a device management table, according to the present embodiment. The device management table is a table for managing devices such as the image capturing device <NUM> registered with the management server <NUM>. The storage unit <NUM> includes a device management DB <NUM> including the device management table as illustrated in <FIG>.

In the device management table, a device ID for identifying a device installed at a distribution site and a device name are associated with each other for each site ID for identifying the corresponding distribution site. When an event having a predetermined distribution site as a participant is started, the management server <NUM> activates an application installed on each device managed in the device management table, and allows each device to participate in the event using the activated application.

<FIG> is a conceptual diagram illustrating an example of an operation information management table, according to the present embodiment. The operation information management table is a table for managing operation information related to an operation requested to a device such as the image capturing device <NUM>. The storage unit <NUM> includes an operation information management DB <NUM> including the operation information management table as illustrated in <FIG>.

In the operation information management table, operation identification information (operation ID) for identifying a device operation requested to a device, a device ID for identifying the device to which the device operation is requested, and an authorization token for the external storage <NUM> of a user who is a request source of the device operation are associated with each other. The management server <NUM> stores, in the operation information management table, the operation information generated by the operation information generation unit <NUM> in response to a request according to a user operation of the user.

Referring to <FIG>, a functional configuration of the authorization server <NUM> is described below. The authorization server <NUM> includes a transmission/reception unit <NUM>, an authentication unit <NUM>, and a storing/reading unit <NUM>. Each of these units is a function or a means that is implemented by operating any of the elements illustrated in <FIG> with instructions from the CPU <NUM> according to the control program for an authorization server expanded from the HD <NUM> to the RAM <NUM>. The authorization server <NUM> further includes a storage unit <NUM> that is implemented by the ROM <NUM>, the HD <NUM>, or the storage medium <NUM> illustrated in <FIG>.

The transmission/reception unit <NUM> is mainly implemented by processing of the CPU <NUM> in relation to the network I/F <NUM> and transmits or receives various data or information to or from other devices or terminals through the communication network <NUM>. The authentication unit <NUM> is implemented by processing of the CPU <NUM>, and performs authentication processing for users managed by the authorization server <NUM>.

<FIG> is a conceptual diagram illustrating an example of an authentication information management table, according to the present embodiment. The storage unit <NUM> includes an authentication information management DB <NUM> including the authentication information management table as illustrated in <FIG>.

In the authentication information management table, authorization information in which user information (user ID and user name) for identifying a user managed by the authorization server <NUM> and a password are associated with each other is stored. For example, the authentication information management table illustrated in <FIG> indicates that a user name of "Alice" is corresponding to a user ID of "A001" and a password of "a0101. " The user identification information may include any one of a user ID for identifying a user and a user name.

Referring to <FIG>, processes and operations of the communication system <NUM> according to the present embodiment is described below. First, referring to <FIG>, a process of authentication for allowing a user to participate, by using the communication terminal <NUM>, in an event executed via the management server <NUM> is described. <FIG> is a sequence diagram illustrating an example of a user authentication process according to the present embodiment. The communication system <NUM> is to be described on the assumption that the management server <NUM> transfers authentication to the authorization server <NUM> based on processing of OAuth <NUM>/OpenID Connect and the use of the external storage <NUM> is also authorized. In the example of <FIG>, in order to start an event including remote communication, the communication terminal <NUM> accesses the management system <NUM>, and authentication and authorization processing is performed to start the event. In the example of <FIG>, the authentication and permission processing is performed for a user "Alice" who uses a communication terminal 10A.

First, the reception unit <NUM> of the communication terminal 10A receives a predetermined input operation by the user (step S11). More specifically, for example, the reception unit <NUM> activates an application, which is installed on the communication terminal 10A, or a browser and receives an input of a predetermined Uniform Resource Locator (URL).

Next, the transmission/reception unit <NUM> transmits a screen display request for requesting participation in the event to the management server <NUM> (step S12). Then, the authorization processing unit <NUM> of the management server <NUM> redirects with respect to the received screen display request to the communication terminal 10A that is a request source (step S13).

Next, the transmission/reception unit <NUM> of the communication terminal 10A transmits a log-in request for the event to the authorization server <NUM> (step S14). Accordingly, the transmission/reception unit <NUM> of the authorization server <NUM> receives the log-in request transmitted from the communication terminal 10A. Next, the transmission/reception unit <NUM> of the authorization server <NUM> transmits log-in screen information to the communication terminal 10A, which is the request source (step S15). Accordingly, the transmission/reception unit <NUM> of the communication terminal 10A receives the log-in screen information transmitted from the authorization server <NUM>.

Next, the display control unit <NUM> of the communication terminal 10A causes the display <NUM> to display a log-in screen based on the log-in screen information received in step S15 (step S16). When the user inputs the authentication information to the log-in screen, the reception unit <NUM> receives the input of the authentication information (step S17). In this case, the user of "Alice" inputs his or her user identification information (user ID or user name) and password, and the reception unit <NUM> receives the input user identification information and password as the authentication information.

Next, the transmission/reception unit <NUM> transmits the authentication information input to the log-in screen in step S17 to the authorization server <NUM> (step S18). Accordingly, the transmission/reception unit <NUM> of the authorization server <NUM> receives the authentication information transmitted from the communication terminal 10A. Next, the authentication unit <NUM> of the authorization server <NUM> searches the authentication information management DB <NUM> (see <FIG>) using the user ID and the password included in the authentication information received in S18 as search keys. Then, the authentication unit <NUM> performs authentication processing by determining whether the same pair of the user ID and the password is stored in the authentication information management DB <NUM> or not (step S19). In the following, a case in which the authentication unit <NUM> determines that the user "Alice" is a user who has a legitimate use authority is described.

Next, the transmission/reception unit <NUM> of the authorization server <NUM> transmits an authentication success notification indicating that the authentication for the user "Alice" indicates successful to the communication terminal 10A that is a transmission source of the authentication information (step S20). Accordingly, the transmission/reception unit <NUM> of the communication terminal 10A receives the authentication success notification transmitted from the authorization server <NUM>.

Next, the transmission/reception unit <NUM> of the communication terminal 10A participates in the authenticated event by communicating with the management server <NUM> (step S21). When the event is started, the communication terminal 10A displays an event screen <NUM>, which is described later, via a browser.

In addition, the authorization processing unit <NUM> of the management server <NUM> transmits, to the authorization server <NUM>, an authorization token acquisition request for requesting to acquire an authorization token (access token) for the external storage <NUM> of the user "Alice" who has participated in the event (step S22). Accordingly, the transmission/reception unit <NUM> of the authorization server <NUM> receives the authorization token acquisition request transmitted from the management server <NUM>. Then, the authorization server <NUM> transmits the authorization token for the external storage <NUM> of the user "Alice" and the user identification information for identifying the user "Alice" to the management server <NUM> that is a request source (step S23). Accordingly, the authorization processing unit <NUM> of the management server <NUM> receives the authorization token and the user identification information transmitted from the authorization server <NUM>.

Then, the storing/reading unit <NUM> of the management server <NUM> stores, in the user information management DB <NUM>, the user information in which the authorization token and the user identification information, which are received in step S23, are associated with each other (step S23).

As described above, the communication system <NUM> performs authentication processing for a user being to participate in an event by using the management system <NUM>, and stores an authorization token (access token) for external storage of the authenticated user. When an event is started, a device such as the image capturing device <NUM> starts an application in response to a request from the management server <NUM> and directly communicates with the management server <NUM>, thereby participating in the event.

Next, reference to <FIG>, a process of uploading an image captured by the image capturing device <NUM>, which is an example of a device, to external storage in response to a request from a communication terminal 10A participating in an event is described. <FIG> and <FIG> are sequence diagrams each illustrating an example of a process of uploading a file to external storage according to the present embodiment. In the following description of the example, the communication terminal 10A participates in a remote inspection for a site where the image capturing device <NUM> is installed, by the authentication process for the user "Alice" illustrated in <FIG>. The remote inspection is an example of an event. It is assumed that a plurality of image capturing devices <NUM> (for example, an image capturing device 30A and an image capturing device 30B) and another communication terminal <NUM> (for example, a communication terminal 10B) also participate in the event in which the communication terminal 10A participates. Each of the communication terminals <NUM> and the image capturing devices <NUM> participating in the event transmits and receives a captured image (image) captured or obtained at each site via the management server <NUM>.

First, the display control unit <NUM> of the communication terminal 10A causes the display <NUM> to display an event screen <NUM> by participating in the event after the authentication processing illustrated in <FIG>. <FIG> and <FIG> are diagrams each illustrating an example of the event screen, according to the present embodiment. The event screen <NUM> illustrated in <FIG> is a display screen displayed in the event implemented by remote communication via the management server <NUM> between the communication terminals <NUM> used by each user who is an event participant and each device such as the image capturing device <NUM> which is a participant of the event. The event screen <NUM> includes a site image display area <NUM> for displaying a captured image (image) of each site that participates in the event, a participant display area <NUM> for displaying participants who participate in the event, and an operation request button <NUM> that is pressed when a device operation is requested.

The site image display area <NUM> includes the captured image (image) of each site captured or obtained by a device such as the communication terminal <NUM> used by the user participating in the event or the image capturing device <NUM> participating in the event. In the example illustrated in <FIG>, in the site image display area <NUM>, a captured image 215a captured or obtained by the image capturing device 30A that is a "device A" and a captured image 215b captured or obtained by the communication terminal 10A used by the user "Alice" are displayed. The participant display area <NUM> includes information indicating a participant name (a user name or a device name) that indicates a participant who participates in the event or information with which a participant is identifiable, such as an icon indicating a participant. In the example of <FIG>, the participant display area <NUM> indicates that the user "Alice," "device A," "device B," and a user "Mary" are participating in the event.

In the example of <FIG>, the number of captured images of participants displayed in the site image display area <NUM> are two, but the number of captured images displayed in the site image display area <NUM> is not limited to this. For example, the site image display area <NUM> may display captured images of all participants participating in the event, or may display a captured image of a participant whose user name or the like displayed in the participant display area <NUM> is selected by the user.

Next, when the user presses the operation request button <NUM> on the event screen <NUM>, the reception unit <NUM> receives an operation instruction to a device such as the image capturing device <NUM> (step S32). More specifically, when the user presses the operation request button <NUM>, the display control unit <NUM> displays a device selection screen <NUM> as illustrated in <FIG>. The device selection screen <NUM> is a display screen for selecting a device (receiving a selection of a device) for executing a capturing operation for a captured image to be uploaded as an image data file of captured image data to the external storage <NUM>. The capturing operation is an example of the device operation. The device selection screen <NUM> includes a selection area <NUM> for selecting a device to which a device operation is to be instructed, an "OK" button <NUM> that is pressed to execute an operation instruction to a device, and a "close" button <NUM> that is pressed when an operation instruction to a device is canceled or stopped. When a user selects a user name or a device name displayed in the selection area <NUM> and presses the "OK" button <NUM>, the reception unit <NUM> receives an operation instruction to the selected device.

In the description of the example, in the selection area <NUM>, not only devices such as the image capturing devices <NUM> but also the user "Alice" and the user "Mary" are displayed in a selectable manner. The communication terminal <NUM> used by the user other than the user "Alice" who uses the communication terminal 10A may be regarded as a device in the same way as the image capturing device <NUM>. That is, a device in a broad sense according to the present embodiment includes a terminal or an apparatus that is not authenticated by a user who performs an operation instruction.

In the example illustrated in <FIG>, a state in which the user has selected the image capturing device 30Athat is "device A. " An example case in which a device operation request is issued to the image capturing device 30A in response to an operation instruction from the user "Alice" is described below.

The transmission/reception unit <NUM> transmits, to the management server <NUM>, an operation information generation request for requesting to generate operation information related to an operation requested to the image capturing device 30A (step S33). The operation information generation request includes the user identification information (user ID or user name) of the authenticated user, the device identification information (device ID or device name) for identifying the image capturing device 30A in relation to which the request has been received in step <NUM>, and information indicating content of an operation to be executed by the image capturing device 30A. The operation information generation request is, for example, a request to generate operation information related to an operation corresponding to a capturing request for the image capturing device 30A to capture a captured image. Accordingly, the transmission/reception unit <NUM> of the management server <NUM> receives the operation information generation request transmitted from the communication terminal 10A.

Next, the storing/reading unit <NUM> of the management server <NUM> searches the user information management DB <NUM> (see <FIG>) using the user identification information received in step S33 as a search key, thereby reading an authorization token (access token) associated with the received user identification information (step S34). Next, the operation information generation unit <NUM> generates an operation ID for specifying an operation to be executed by the image capturing device <NUM> (step S35). In addition, the operation information generation unit <NUM> generates operation information in which the device identification information received in step S33, the authorization token read in step S34, and the operation ID generated in step S35 are associated with each other. Then, the operation information generation unit <NUM> stores the generated operation information in the operation information management DB <NUM> (see <FIG>) via the storing/reading unit <NUM> (step S36). As described above, the management server <NUM> stores the authorization token for accessing the external storage <NUM> of the user in association with the operation ID so that the authorization token may be used in processing in a subsequent step.

Next, the transmission/reception unit <NUM> transmits, to the communication terminal 10A, address information indicating a temporary storage destination of data for transferring an operation result from the image capturing device 30A (step S37). The address information is uniquely specified for each device operation corresponding to the device operation request received in step S32. The address information is, for example, a URL indicating an address on the management server <NUM>. Accordingly, the transmission/reception unit <NUM> of the communication terminal 10A receives the address information transmitted from the management server <NUM>.

Next, the transmission/reception unit <NUM> of the communication terminal 10A transmits, to the management server <NUM>, a message transmission request requesting to transmit a message to the image capturing device 30A (step S38). The message transmission request includes a device ID (D001) for identifying the image capturing device 30A to which the message is to be transmitted, an operation command for requesting the image capturing device 30A, and the address information received in step S37. Accordingly, the transmission/reception unit <NUM> of the management server <NUM> receives the message transmission request transmitted from the communication terminal 10A.

Next, the message processing unit <NUM> of the management server <NUM> transmits the message (an example of a first message) corresponding to the message transmission request received in step S38 to the image capturing device 30A identified by the device ID indicated in the received message transmission request (step S39). The message includes the operation command and the address information included in the message transmission request received in step S38. Accordingly, the transmission/reception unit <NUM> of the image capturing device 30A receives the message transmitted from the management server <NUM>.

Next, the image capturing device 30A performs processing based on the operation command indicated in the message received in step S39 (step S40). In this case, since the received operation command is "capturing," the image capturing device 30A performs image capturing processing by the imaging control unit <NUM>.

Next, the transmission/reception unit <NUM> of the image capturing device 30A transmits an image data file corresponding to captured image data acquired by the processing of step S40 to the management server <NUM>, by using the address information indicated in the message received in step S39 (step S41). Accordingly, the transmission/reception unit <NUM> of the management server <NUM> receives the image data file transmitted from the image capturing device 30A.

Next, the storing/reading unit <NUM> of the management server <NUM> reads the access token (access token) associated with the operation ID generated in step <NUM> from the operation information management DB <NUM> (step S42). Then, the upload processing unit <NUM> transmits a file upload request to the external storage <NUM> (step S43). The file upload request includes the authorization token read in step S42 and the image data file received in step S41.

The external storage <NUM> performs authentication processing using the authorization token transmitted from the management server <NUM>. Since the authorization token corresponds to the user "Alice," the authorization token is authenticated using the authentication information of "Alice. " Then, the external storage <NUM> stores the image data file transmitted from the management server <NUM> in a folder associated with the authenticated user "Alice.

Then, the external storage <NUM> transmits an upload completion notification to the management server <NUM> (step S44). Accordingly, the transmission/reception unit <NUM> of the management server <NUM> receives the upload completion notification transmitted from the external storage <NUM>.

Next, the transmission/reception unit <NUM> of the management server <NUM> transmits a processing completion notification to the image capturing device 30A that has transmitted the image data file in step S41 (step S45). Accordingly, the transmission/reception unit <NUM> of the image capturing device 30A receives the processing completion notification transmitted from the management server <NUM>.

Next, the transmission/reception unit <NUM> of the image capturing device 30A transmits, to the management server <NUM>, a message transmission request requesting to transmit a message to the communication terminal 10A (step S46). The message transmission request includes the operation command and the address information included in the message received in step S39, and information indicating that the device operation has been completed. Accordingly, the transmission/reception unit <NUM> of the management server <NUM> receives the message transmission request transmitted from the image capturing device 30A.

Next, the message processing unit <NUM> of the management server <NUM> transmits the message, which indicates the completion of the image data file upload by the image capturing device 30A, (an example of a second message) corresponding to the message transmission request received in step S46 to the communication terminal 10A used by the user "Alice" who is identified by the user ID indicated with the received message transmission request (step S47). Accordingly, the transmission/reception unit <NUM> of the communication terminal 10A receives the message transmitted from the management server <NUM>. Then, the communication terminal 10A displays, according to the received message, a predetermined display screen indicating that the upload has been completed to notify the user "Alice" of the completion of the requested operation.

In addition, the communication terminal 10A accesses the external storage <NUM> with the access authority of the user "Alice" to perform browsing processing for the uploaded file (step S48). <FIG> is a diagram illustrating an example of a file browsing screen, according to the present embodiment. The display control unit <NUM> of the communication terminal 10A accesses the external storage <NUM> with the access authority of the user "Alice," thereby causing the display <NUM> to display a file browsing screen <NUM> illustrated in <FIG>.

The file browsing screen <NUM> includes a list display area <NUM> that indicates a list of data files (file list) uploaded to the folder of the user "Alice" in the external storage <NUM>, and an "OPEN" button <NUM> that is pressed when content of the uploaded file is viewed. The list display area <NUM> includes a file name of an uploaded data file and a date and time when the data file is uploaded.

When the user "Alice" selects a data file indicated in the list display area <NUM> and presses the "OPEN" button <NUM>, the display control unit <NUM> displays the selected data file. In the example illustrated in <FIG>, a state in which the uploaded file "deviceAyyyy. jpg" is selected is indicated.

As described above, in response to a device operation request from a user who participates in an event, the communication system <NUM> temporarily stores an authorization token for the external storage <NUM> of the user in the management server <NUM>. Then, the management server <NUM> uploads data acquired by a requested device operation to the external storage <NUM> corresponding to the user using the temporarily saved authorization token.

As described above, with the communication system <NUM>, data acquired by a device is uploaded to the external storage <NUM> to which the user has authority by merely selecting a device participating in an event, resulting in reduction of time and effort in upload processing for a user.

In addition, with the communication system <NUM>, data acquired by the device is directly uploaded to the external storage <NUM> of the user without performing a device operation by the user and user authentication with the device. Accordingly, upload processing is performed without passing access information such as an authorization token of the user of the external storage <NUM> to the device.

As described above, the management system <NUM> according to an embodiment of the disclosure manages a predetermined event executed by communication between the communication terminal <NUM> used by a user and a device (for example, the image capturing device <NUM>) that performs remote communication with the communication terminal <NUM>. The management system <NUM> receives an operation request for a specific device transmitted from a communication terminal <NUM> used by the user who is authenticated by the management system <NUM> and stores operation identification information for identifying a device operation associated with the received operation request and an authorization token (an example of access information) associated with the user for accessing external storage <NUM> in association with each other. Then, the management system <NUM> uploads data acquired by the specific device according to the device operation corresponding to the operation identification information to the external storage <NUM> using the authorization information associated with the operation identification information. This allows the management system <NUM> to reduce processing time and effort when uploading data acquired by a device to external storage with user authority.

In addition, the management system <NUM> according to an embodiment of the disclosure generates operation information based on the received operation request to be stored. The operation information includes the operation identification information, the access information, and device identification information identifying the specific device in association with each other. In addition, the management system <NUM> transmits address information (for example, a URL) to be used to transfer the data acquired according to the device operation associated with the received operation request, and transmits a first message to the specific device in response to a message transmission request including the address information. The message transmission request is transmitted from the communication terminal <NUM> and is a request to transmit the first message to the specific device. In addition, the management system <NUM> receives from the specific device, the data acquired according to the device operation according to the transmitted first message, and uploads the received data to the external storage <NUM> using the stored authorization token. As described above, the management system <NUM> directly uploads data acquired by the device to the external storage <NUM> of the user without performing a device operation by the user and user authentication with the device. Accordingly, upload processing is performed without passing access information such as an authorization token of the user of the external storage <NUM> to the device.

Further, the communication system according to an embodiment of the disclosure includes the management system <NUM> and the communication terminal <NUM>. The communication terminal <NUM> displays a captured image captured, or obtained, by a device (for example, the image capturing device <NUM>) installed at a remote site on the display <NUM> (an example of a display unit), receives a selection of a specific device to which a capturing request with respect to the displayed captured image is instructed, and transmits an operation request associated with the received specific device to the management system <NUM>. As described above, the communication system <NUM> uploads data acquired by a device to the external storage <NUM> to which the user has authority by merely selecting a device participating in an event, resulting in reduction of time and effort in upload processing for a user.

Further, in the communication system according to an embodiment of the present disclosure, the communication terminal <NUM> causes the display <NUM> (an example of a display unit) to display a browsing screen (an example of a file browsing screen <NUM>) corresponding to the data uploaded to the external storage <NUM> based on the authorization token (an example of access information) of a user authenticated by the management system <NUM>. As a result, with the communication system <NUM>, the data directly uploaded from a device is browsed and viewed, when a user having access authority accesses the external storage <NUM>.

Each of the functions of the above-described embodiments may be implemented by one or more processing circuits or circuitry. Processing circuitry includes a programmed processor, as a processor includes circuitry. A processing circuit also includes devices such as an application specific integrated circuit (ASIC), digital signal processor (DSP), field programmable gate array (FPGA), system on a chip (SOC), graphics processing unit (GPU), and conventional circuit components arranged to perform the recited functions.

Each of the tables of the above-described embodiments may be generated by learning effect of machine learning. In addition, in alternative to using the tables, the data of each related item may be classified by the machine learning. In the present disclosure, the machine learning is defined as a technology that makes a computer to acquire human-like learning ability. In addition, the machine learning refers to a technology in which a computer autonomously generates an algorithm used for determination such as data identification from learning data loaded in advance and applies the generated algorithm to new data to make a prediction. Any suitable learning method is applied for the machine learning, for example, any one of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or a combination of two or more of these learning.

Although the management system, the communication system, the processing method, and the program according to one or more embodiments of the present disclosure have been described above, the present disclosure may be modified within the scope of the claims.

Claim 1:
A management system (<NUM>), comprising:
an operation request reception unit (<NUM>) configured to receive a request for an operation for a specific device (<NUM>) of one or more image capturing devices (<NUM>) from a communication terminal (<NUM>) used by a user for who user authentication has been successfully performed by the management system (<NUM>), the one or more devices (<NUM>) and the communication terminal (<NUM>) being configured for communicating with each other to execute an event managed by the management system (<NUM>), wherein the event is a remote communication provided by the management system (<NUM>);
a storage unit (<NUM>) configured to store operation identification information and access information in association with each other, the operation identification information identifying the requested operation associated with the request received by the operation request reception unit (<NUM>) and the access information being associated with the user and used to access external storage (<NUM>); and
an upload processing unit (<NUM>) configured to upload data acquired by the specific device (<NUM>) according to the requested operation corresponding to the operation identification information to the external storage (<NUM>) using the access information associated with the operation identification information; wherein
the request is a capturing request to capture a captured image obtained by the specific device (<NUM>), and
the upload processing unit (<NUM>) is configured to upload, to the external storage (<NUM>), the data that is captured image data acquired according to the requested operation,
wherein the storage unit (<NUM>) is configured to temporarily store an authorization token for the external storage (<NUM>) of the user in response to the request from the user,
wherein the upload processing unit (<NUM>) is configured to upload the data acquired by the requested operation to the external storage (<NUM>) corresponding to the user using the temporarily saved authorization token.