IMAGE CAPTURING APPARATUS, COMMUNICATION SYSTEM, DATA DISTRIBUTION METHOD, AND NON-TRANSITORY RECORDING MEDIUM

An image capturing apparatus includes an imaging device and circuitry. The imaging device captures an image of a subject to acquire image data. The circuitry reads a two-dimensional code displayed on a communication terminal and acquired with the imaging device, and acquires setting information for using a service provided by a content distribution system that distributes content via a communication network. The setting information is represented by the read two-dimensional code. The circuitry further connects the image capturing apparatus to the communication network with network connection information included in the acquired setting information, and distributes the image data acquired by the imaging device to the content distribution system via the communication network connected to the image capturing apparatus.

CROSS-REFERENCE TO RELATED APPLICATION

This patent application is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application No. 2019-159326 filed on Sep. 2, 2019 in the Japan Patent Office, the entire disclosure of which is hereby incorporated by reference herein.

BACKGROUND

Technical Field

The present invention relates to an image capturing apparatus, a communication system, a data distribution method, and a non-transitory recording medium.

Description of the Related Art

In recent years, a technique has been widely used which enables an image captured with an image capturing apparatus to be distributed via a content distribution service on the Internet. There is also a system that directly connects the image capturing apparatus to the Internet, without via a communication terminal such as a personal computer (PC) or a smartphone, to enable the image distribution.

Such image distribution is implemented with the settings of information such as information for connecting to a network and authorization information for using the content distribution service. A typical image capturing apparatus, however, is not equipped with an input device and a display, unlike a PC or a smartphone, making it difficult to input a lot of information with the image capturing apparatus. To address this issue, there is a technique of forming a local network between the image capturing apparatus and the communication terminal such that various settings are input with the communication terminal and the information of the input settings is reflected in the image capturing apparatus via the local network.

According to this technique, however, the connection to the Internet is unavailable during the communication between the image capturing apparatus and the communication terminal. The setting information for using the content distribution service is typically obtained via the Internet, and the distribution of the image captured by the image capturing apparatus involves the connection to the Internet. According to the existing technique, therefore, the network connection is frequently switched during an operation, complicating the settings for the image distribution with the image capturing apparatus.

SUMMARY

In one embodiment of this invention, there is provided an improved image capturing apparatus that includes, for example, an imaging device and circuitry. The imaging device captures an image of a subject to acquire image data. The circuitry reads a two-dimensional code displayed on a communication terminal and acquired with the imaging device, and acquires setting information for using a service provided by a content distribution system that distributes content via a communication network. The setting information is represented by the read two-dimensional code. The circuitry further connects the image capturing apparatus to the communication network with network connection information included in the acquired setting information, and distributes the image data acquired by the imaging device to the content distribution system via the communication network connected to the image capturing apparatus.

In one embodiment of this invention, there is provided an improved communication system that includes, for example, the above-described image capturing apparatus and a communication terminal. The communication terminal includes second circuitry. The second circuitry receives an input of setting request information for requesting settings for using the content distribution system, transmits the received setting request information to the content distribution system, and controls a display to display the two-dimensional code representing the setting information. The setting information includes the setting request information and service provision information for providing the service to a user.

In one embodiment of this invention, there is provided an improved data distribution method that includes, for example, capturing an image of a subject with an imaging device of the image capturing apparatus to acquire image data, reading a two-dimensional code displayed on a communication terminal and acquired with the imaging device, acquiring setting information for using a service provided by a content distribution system that distributes content via a communication network, connecting the image capturing apparatus to the communication network with network connection information included in the acquired setting information, and distributing the image data acquired by the imaging device to the content distribution system via the communication network connected to the image capturing apparatus. The setting information is represented by the read two-dimensional code.

In one embodiment of this invention, there is provided a non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, cause the processors to perform the above-described data distribution method.

DETAILED DESCRIPTION

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. In the drawings illustrating embodiments of the present invention, members or components having the same function or shape will be denoted with the same reference numerals to avoid redundant description.

A system configuration of a communication system1aof the first embodiment will first be described withFIG. 1.

FIG. 1is a diagram illustrating an exemplary system configuration of the communication system1aof the first embodiment. The communication system1aillustrated inFIG. 1is a system that uploads an image captured by an image capturing apparatus10to a content distribution system50to enable content distribution via a communication network5.

The communication system1aincludes the image capturing apparatus10, a communication terminal30, the content distribution system50, a client program distribution system70, and a router90. The content distribution system50, the client program distribution system70, and the router90are communicably connected to each other via the communication network5. The communication network5is implemented by the Internet, a mobile communication network, or a local area network (LAN), for example. The communication network5may include, as well as a wired communication network, a wireless communication network conforming to a standard such as third generation (3G), fourth generation (4G), fifth generation (5G), worldwide interoperability for microwave access (WiMAX) or long term evolution (LTE), for example.

The image capturing apparatus10is a digital camera capable of capturing the image of a subject to acquire a captured image of the subject. For example, the image capturing apparatus10is a special digital camera for obtaining a 360-degree omnidirectional panoramic image. The image capturing apparatus10may be a typical digital camera (e.g., a single-lens reflex camera or a compact digital camera). If the communication terminal30is equipped with a camera, the communication terminal30may serve as a digital camera. It is assumed in the following description of the present embodiment that the image capturing apparatus10is a digital camera for obtaining the omnidirectional panoramic image (i.e., a later-described special image capturing apparatus). The image capturing apparatus10accesses the communication network5such as the Internet via the router90to upload the captured image to the content distribution system50. The captured image may be a video image or a still image, or may include both the video image and the still image. Further, the captured image may be accompanied by sound.

The communication terminal30is a terminal apparatus used by a user U, such as a smartphone. The communication terminal30accesses the communication network5such as the Internet via the router90to communicate data with the content distribution system50and the client program distribution system70. Further, the communication terminal30is connected to the image capturing apparatus10via a cable conforming to a standard such as universal serial bus (USB) or high-definition multimedia interface (HDMI). Alternatively, the image capturing apparatus10and the communication terminal30may wirelessly communicate with each other, without the cable, with a near field wireless communication technology conforming to a standard such as Bluetooth (registered trademark) or near field communication (NFC), for example. The communication terminal30is not limited to the smartphone, and may be a tablet terminal, a mobile phone, or a personal computer (PC), for example.

The content distribution system50is a system that provides a content distribution service to the user U via the communication network5such as the Internet. The term “content” refers to an image such as a video image or a still image, music, a world wide web (Web) site, an application (i.e., an application program), or a text file, for example. The content distribution service may be YouTube (registered trademark), Instagram (registered trademark), or Twitter (registered trademark), for example. The content distribution system50distributes the image uploaded from the image capturing apparatus10to the user U via the Internet, for example.

The client program distribution system70is a system that distributes a program for using the content distribution service with the image capturing apparatus10. The client program distribution system70transmits a client program to the image capturing apparatus10via the content distribution system50.

Herein, the content distribution system50and the client program distribution system70are provided for each content distribution service. That is, the communication system1amay include a plurality of pairs of the content distribution system50and the client program distribution system70.

The content distribution system50may be implemented by a single computer, or may be implemented by a plurality of computers to which units (e.g., functions, devices, and memories) of the content distribution system50are divided and allocated as desired. The same is true of the client program distribution system70. The content distribution system50and the client program distribution system70form a service providing system2. The service providing system2may be implemented by a single computer including units (e.g., functions and devices) of the content distribution system50and the client program distribution system70.

Respective hardware configurations of apparatuses and terminal forming the communication system1awill be described withFIGS. 2 to 4. A component may be added to or deleted from each of hardware configurations illustrated inFIGS. 2 to 4.

A hardware configuration of the communication terminal30will be described withFIG. 2.

FIG. 2is a diagram illustrating an exemplary hardware configuration of the communication terminal30of the first embodiment. The communication terminal30includes a central processing unit (CPU)301, a read only memory (ROM)302, a random access memory (RAM)303, an electrically erasable programmable ROM (EEPROM)304, a complementary metal oxide semiconductor (CMOS) sensor305, an imaging element interface (I/F)313a, an acceleration and orientation sensor306, a medium I/F308, and a global positioning system (GPS) receiver309.

The CPU301controls an overall operation of the communication terminal30. The ROM302stores a program used to drive the CPU301such as an initial program loader (IPL). The RAM303is used as a work area for the CPU301. The EEPROM304performs reading or writing of various data of a program for the communication terminal30, for example, under the control of the CPU301.

The CMOS sensor305captures the image of a subject (normally the image of the user) under the control of the CPU301to obtain image data. The imaging element I/F313ais a circuit that controls the driving of the CMOS sensor305. The acceleration and orientation sensor306includes various sensors such as an electromagnetic compass that detects geomagnetism, a gyrocompass, and an acceleration sensor. The medium I/F308controls writing (i.e., storage) and reading of data to and from a recording medium307such as a flash memory. The GPS receiver309receives a GPS signal from a GPS satellite.

The communication terminal30further includes a telecommunication circuit311, an antenna311a, a CMOS sensor312, an imaging element I/F313b, a microphone314, a speaker315, an audio input and output I/F316, a display317, an external apparatus connection I/F318, a near field communication circuit319, an antenna319afor the near field communication circuit319, a touch panel321, and a bus line310.

The telecommunication circuit311is a circuit that communicates with another apparatus via the communication network5. The CMOS sensor312is a built-in imaging device capable of capturing the image of a subject under the control of the CPU301to obtain image data. The imaging element I/F313bis a circuit that controls the driving of the CMOS sensor312. The microphone314is a built-in sound collecting device for inputting sound. The audio input and output I/F316is a circuit that processes input of audio signals from the microphone314and output of audio signals to the speaker315under the control of the CPU301.

The display317is implemented as a liquid crystal or organic electroluminescence (EL) display, for example, that displays the image of the subject and various icons, for example. The external apparatus connection I/F318is an interface for connecting the communication terminal30to various external apparatuses. The near field communication circuit319is a communication circuit conforming to a standard such as NFC or Bluetooth. The touch panel321is an input device for the user to operate the communication terminal30by pressing the display317. The bus line310includes an address bus and a data bus for electrically connecting the CPU301and the other components.

A hardware configuration of each of the content distribution system50, the client program distribution system70, and the router90will be described withFIG. 3.

FIG. 3is a diagram illustrating an exemplary hardware configuration of each of the content distribution system50, the client program distribution system70, and the router90of the first embodiment. Each of the content distribution system50, the client program distribution system70, and the router90is implemented by a typical computer. A computer as an example of the content distribution system50includes a CPU501, a ROM502, a RAM503, a hard disk (HD)504, a hard disk drive (HDD)505, a medium I/F507, a network I/F508, a display511, a keyboard512, a mouse513, a digital versatile disk rewritable (DVD-RW) drive515, and a bus line510.

The CPU501controls an overall operation of the content distribution system50. The ROM502stores a program used to drive the CPU501. The RAM503is used as a work area for the CPU501. The HDD505controls writing and reading of various data to and from the HD504under the control of the CPU501. The HD504stores various data of a program, for example. The medium I/F507controls writing (i.e., storage) and reading of data to and from a recording medium506such as a flash memory.

The network I/F508is an interface for performing data communication via the communication network5. The display511displays various information such as a cursor, menus, windows, text, and images. The keyboard512is an input device including a plurality of keys for inputting text, numerical values, and various instructions, for example. The mouse513is an input device used to select and execute various instructions, select a processing target, and move the cursor, for example. The DVD-RW drive515controls reading of various data from a DVD-RW514as an example of a removable recording medium. The DVD-RW514may be replaced by a DVD-recordable (DVD-R), for example. Further, the DVD-RW drive515may be a Blu-ray (registered trademark) drive or a compact disc (CD)-RW drive, for example, for controlling writing (i.e., storage) and reading of data to and from a disc such as a Blu-ray disc rewritable (BD-RE) or a CD-RW. The bus line510includes an address bus and a data bus for electrically connecting the CPU501and the other components illustrated inFIG. 3.

The client program distribution system70, which is implemented by a typical computer, includes a CPU701, a ROM702, a RAM703, an HD704, an HDD705, a medium I/F707, a network I/F708, a display711, a keyboard712, a mouse713, a DVD-RW drive715, and a bus line710, as illustrated inFIG. 3. These components are similar in configuration to the CPU501, the ROM502, the RAM503, the HD504, the HDD505, the medium I/F507, the network I/F508, the display511, the keyboard512, the mouse513, the DVD-RW drive515, and the bus line510of the content distribution system50, and thus description thereof will be omitted. In the client program distribution system70, the HD704stores a program for the client program distribution system70.

The router90, which is implemented by a typical computer, includes a CPU901, a ROM902, a RAM903, an HD904, an HDD905, a medium I/F907, a network I/F908, a display911, a keyboard912, a mouse913, a DVD-RW drive915, and a bus line910, as illustrated inFIG. 3. These components are similar in configuration to the CPU501, the ROM502, the RAM503, the HD504, the HDD505, the medium I/F507, the network I/F508, the display511, the keyboard512, the mouse513, the DVD-RW drive515, and the bus line510of the content distribution system50, and thus description thereof will be omitted. In the router90, the HD904stores a program for the router90.

A hardware configuration of the image capturing apparatus10will be described withFIG. 4.

FIG. 4is a diagram illustrating an exemplary hardware configuration of the image capturing apparatus10of the first embodiment. In the present example, the image capturing apparatus10is an omnidirectional (i.e., all-directional) image capturing apparatus with two imaging elements. However, the number of imaging elements included in the image capturing apparatus10may be three or more. Further, the image capturing apparatus10is not necessarily required to be an apparatus dedicated to the purpose of capturing the all-directional image. Therefore, an all-directional imaging device may be additionally attached to a regular digital camera or smartphone, for example, to provide substantially the same function as the function of an omnidirectional image capturing apparatus.

As illustrated inFIG. 4, the image capturing apparatus10includes an imaging device101, an image processing device104, an imaging control device105, a microphone108, an audio processing device109, a CPU111, a ROM112, a static RAM (SRAM)113, a dynamic RAM (DRAM)114, an operation device115, an input and output I/F116, a near field communication circuit117, an antenna117afor the near field communication circuit117, an acceleration and orientation sensor118, and a network I/F119.

The imaging device101includes two wide-angle (i.e., fisheye) lenses102aand102b(hereinafter referred to as the lenses102where distinction therebetween is unnecessary) and two imaging elements103aand103bcorresponding thereto. Each of the lenses102has an angle of view of at least 180 degrees to form a hemispherical image. The lenses102are an example of an optical imaging system. Each of the imaging elements103aand103bincludes an image sensor, a timing signal generating circuit, and a group of registers, for example. The image sensor may be a CMOS or charge coupled device (CCD) sensor that converts an optical image formed by the lens102aor102binto image data in the form of electrical signals and outputs the image data. The timing signal generating circuit generates a horizontal or vertical synchronization signal or a pixel clock signal for the image sensor. Various commands and parameters for the operation of the imaging element103aor103bare set in the group of registers.

Each of the imaging elements103aand103bof the imaging device101is connected to the image processing device104via a parallel I/F bus, and is connected to the imaging control device105via a serial I/F bus (e.g., an inter-integrated circuit (I2C) bus). The image processing device104, the imaging control device105, and the audio processing device109are connected to the CPU111via a bus110. The bus110is further connected to the ROM112, the SRAM113, the DRAM114, the operation device115, the input and output I/F116, the near field communication circuit117, the acceleration and orientation sensor118, and the network I/F119, for example.

The image processing device104receives image data items from the imaging elements103aand103bvia the parallel I/F bus, performs a predetermined process on the image data items, and combines the processed image data items to generate the data of a later-described equirectangular projection image.

The imaging control device105sets commands in the groups of registers of the imaging elements103aand103bvia the serial I/F bus such as the I2C bus, with the imaging control device105and the imaging elements103aand103bnormally acting as a master device and slave devices, respectively. The imaging control device105receives the commands from the CPU111. The imaging control device105further receives data such as status data from the groups of registers in the imaging elements103aand103bvia the serial I/F bus such as the I2C bus, and transmits the received data to the CPU111.

The imaging control device105further instructs the imaging elements103aand103bto output the image data when a shutter button of the operation device115is pressed down. The image capturing apparatus10may have a preview display function or a video display function using a display (e.g., a display of a smartphone). In this case, the imaging elements103aand103bcontinuously output the image data at a predetermined frame rate. The frame rate is defined as the number of frames per minute.

The imaging control device105also functions as a synchronization controller that cooperates with the CPU111to synchronize the image data output time between the imaging elements103aand103b. In the present embodiment, the image capturing apparatus10is not equipped with a display. The image capturing apparatus10, however, may be equipped with a display.

The microphone108converts sound into audio (signal) data. The audio processing device109receives the audio data from the microphone108via an I/F bus, and performs a predetermined process on the audio data.

The CPU111controls an overall operation of the image capturing apparatus10, and executes various processes. The ROM112stores various programs for the CPU111. The SRAM113and the DRAM114, which are used as work memories, store programs executed by the CPU111and data being processed. The DRAM114particularly stores image data being processed in the image processing device104and processed data of the equirectangular projection image.

The operation device115collectively refers to operation buttons including the shutter button. The user operates the operation device115to input various image capture modes and image capture conditions, for example.

The input and output I/F116collectively refers to interface circuits (e.g., a USB I/F circuit) connectable to an external recording medium (e.g., a secure digital (SD) card) and a PC, for example. The input and output I/F116may be a wireless or wired interface. Via the input and output I/F116, the data of the equirectangular projection image stored in the DRAM114may be recorded on an external recording medium, or may be transmitted as necessary to an external terminal (apparatus).

The near field communication circuit117communicates with the external terminal (apparatus) via the antenna117aof the image capturing apparatus10in accordance with a near field wireless communication technology conforming to a standard such as NFC or Bluetooth. The near field communication circuit117is capable of transmitting the data of the equirectangular projection image to the external terminal (apparatus).

The acceleration and orientation sensor118calculates the orientation of the image capturing apparatus10from the geomagnetism, and outputs orientation information. The orientation information is an example of related information (i.e., metadata) conforming to the exchangeable image file format (Exif) standard. The orientation information is used in image processing such as image correction of the captured image. The related information includes data such as the date and time of capturing the image and the data capacity of the image data. The acceleration and orientation sensor118also detects changes in angles (i.e., the roll angle, the pitch angle, and the yaw angle) of the image capturing apparatus10accompanying the movement of the image capturing apparatus10. The changes in the angles are an example of the related information (i.e., metadata) conforming to the Exif standard, and are used in image processing such as image correction of the captured image. The acceleration and orientation sensor118further detects the respective accelerations in three axial directions. The image capturing apparatus10calculates the attitude thereof (i.e., the angle of the image capturing apparatus10relative to the gravitational direction) based on the accelerations detected by the acceleration and orientation sensor118. Equipped with the acceleration and orientation sensor118, the image capturing apparatus10is improved in the accuracy of image correction.

The network I/F119is an interface for performing data communication using the communication network5such as the Internet via the router90.

Each of the above-described programs may be distributed as recorded on a computer readable recording medium in an installable or executable file format. Examples of the recording medium include a CD-R, a DVD, a Blu-ray disc, and an SD card. The recording medium may be shipped to the market as a program product. For example, the image capturing apparatus10executes a program according to an embodiment of the present invention to implement a data distribution method according to an embodiment of the present invention.

An example of the omnidirectional image acquired by a special image capturing apparatus will be described withFIGS. 5A, 5B, and 5CtoFIG. 9. The special image capturing apparatus is an example of the image capturing apparatus10.

WithFIGS. 5A, 5B, and 5CandFIGS. 6A and 6B, a description will first be given of an overview of a process of generating an equirectangular projection image EC from images captured by the special image capturing apparatus and then generating an omnidirectional image CE from the equirectangular projection image EC.

FIG. 5Ais a diagram illustrating a front hemispherical image captured by the special image capturing apparatus.FIG. 5Bis a diagram illustrating a rear hemispherical image captured by the special image capturing apparatus.FIG. 5Cis a diagram illustrating an image generated from the hemispherical images by equirectangular projection (hereinafter referred to as the equirectangular projection image EC).FIG. 6Ais a conceptual diagram illustrating the equirectangular projection image EC covering a sphere.FIG. 6Bis a diagram illustrating the omnidirectional image CE obtained from the equirectangular projection image EC.

As illustrated inFIG. 5A, the front hemispherical image, which is obtained by the imaging element103a, is distorted by the lens102a. Further, as illustrated inFIG. 5B, the rear hemispherical image, which is obtained by the imaging element103b, is distorted by the lens102b. The special image capturing apparatus combines the front hemispherical image and the rear hemispherical image rotated therefrom by 180 degrees, to thereby generate the equirectangular projection image EC as illustrated inFIG. 5C.

Then, with an application programming interface (API) such as open graphics library for embedded systems (OpenGL ES, registered trademark), the special image capturing apparatus places the equirectangular projection image EC on the surface of a sphere to cover the spherical surface, as illustrated inFIG. 6A. Thereby, the omnidirectional image CE as illustrated inFIG. 6Bis generated. The omnidirectional image CE is thus expressed as the equirectangular projection image EC facing the center of the sphere. OpenGL ES is a graphics library used to visualize two-dimensional (2D) or three-dimensional (3D) data. The omnidirectional image CE may be a still or video image.

As described above, the omnidirectional image CE is an image placed on a sphere to cover the spherical surface, and thus is perceived as unnatural to human eyes. Therefore, the special image capturing apparatus controls a particular display to display a part of the omnidirectional image CE as a planar image with less distortion so that the displayed image is perceived as natural to human eyes. Hereinafter, the above-described part of the omnidirectional image CE will be described as the viewable area, and the image of the viewable area will be described as the viewable area image.

Display of the viewable area image will be described withFIG. 7andFIGS. 8A and 8B.

FIG. 7is a diagram illustrating the respective positions of a virtual camera IC and a viewable area T when the omnidirectional image CE is expressed as a three-dimensional solid sphere CS. The position of the virtual camera IC corresponds to the position of the viewpoint of the user viewing the omnidirectional image CE expressed as the three-dimensional solid sphere CS, i.e., the position of the user's viewpoint relative to the omnidirectional image CE.FIG. 8Ais a perspective view of the omnidirectional image CE inFIG. 7expressed as the solid sphere CS.FIG. 8Bis a diagram illustrating a viewable area image Q displayed on a display. InFIG. 8A, the omnidirectional image CE inFIG. 7is illustrated as the three-dimensional solid sphere CS. When the omnidirectional image CE generated as described above is expressed as the solid sphere CS, the virtual camera IC is located inside the omnidirectional image CE, as illustrated inFIG. 7. The viewable area T of the omnidirectional image CE corresponds to an image capturing area of the virtual camera IC, and is identified by viewable area information. The viewable area information represents the image capturing direction and the angle of view of the virtual camera IC in a three-dimensional virtual space including the omnidirectional image CE. The viewable area T may be zoomed in or out with the virtual camera IC moved toward or away from the omnidirectional image CE. The viewable area image Q is the image of the viewable area T of the omnidirectional image CE. The viewable area T is therefore identified with an angle of view a of the virtual camera IC and a distance f from the virtual camera IC to the omnidirectional image CE (seeFIG. 9).

As illustrated inFIG. 8B, the viewable area image Q illustrated inFIG. 8Ais displayed on a particular display as the image of the image capturing area of the virtual camera IC.FIG. 8Billustrates the viewable area image Q represented by initially set (i.e., default) viewable area information. In the following description of the viewable area T, the image capturing direction (ea, aa) and the angle of view a of the virtual camera IC will be used. The viewable area T, however, may be expressed not with the angle of view a and the distance f but with the image capturing area (X, Y, Z) of the virtual camera IC corresponding to the viewable area T.

The relationship between the viewable area information and the image of the viewable area T will be described withFIG. 9.

FIG. 9is a diagram illustrating the relationship between the viewable area information and the image of the viewable area T. As illustrated inFIG. 9, ea represents the elevation angle, and aa represents the azimuth angle. Further, a represents the angle of view. That is, the attitude of the virtual camera IC is changed such that the point of interest of the virtual camera IC represented by the image capturing direction (ea, aa) corresponds to a center point CP of the viewable area T as the image capturing area of the virtual camera IC. As illustrated inFIG. 9, when the diagonal angle of view of the viewable area T is expressed as the angle of view a of the virtual camera IC, the center point CP corresponds to (x, y) parameters of the viewable area information. The viewable area image Q is the image of the viewable area T of the omnidirectional image CE inFIG. 7. Further, f represents the distance from the virtual camera IC to the center point CP, and L represents the distance between a given vertex of the viewable area T and the center point CP. Thus, 2L represents the length of a diagonal of the viewable area T. Further, inFIG. 9, a trigonometric function typically expressed as equation (1) given below holds.

The above-described special image capturing apparatus is an example of an image capturing apparatus capable of acquiring a wide-angle image. The omnidirectional image is an example of the wide-angle image. The wide-angle image is typically captured with a wide-angle lens capable of capturing an image in a range wider than the viewing range of the human eye. Further, the wide-angle image normally refers to the image captured with a lens having a focal length of 35 mm or less in 35 mm film equivalent.

A functional configuration of the communication system1aof the first embodiment will be described withFIGS. 10A and 10BandFIGS. 11A, 11B, and 11C.

FIGS. 10A and 10Bare diagrams illustrating an exemplary functional configuration of the communication system1aof the first embodiment.FIGS. 10A and 10Billustrate parts of the terminal and apparatuses inFIG. 1related to later-described processes and operations.

A functional configuration of the image capturing apparatus10will first be described withFIG. 10A.

The image capturing apparatus10includes a transmitting and receiving unit11, a receiving unit12, an image capturing unit13, a reading unit14, a setting information processing unit15, a network control unit16, a client program managing unit17, a content transmission control unit18, a storing and reading unit19, and a connection unit21. Each of these units is a function or functional unit implemented when at least one of the components illustrated inFIG. 4operates in response to a command from the CPU111in accordance with a program deployed on the DRAM114. The image capturing apparatus10further includes a storage unit1000implemented by the ROM112illustrated inFIG. 4.

The transmitting and receiving unit11is a function implemented by a command from the CPU111and the network I/F119inFIG. 4to transmit and receive various data and information to and from another apparatus via the router90. For example, the transmitting and receiving unit11transmits the captured image acquired by the image capturing unit13to the content distribution system50.

The receiving unit12is a function implemented by a command from the CPU111and the operation device115inFIG. 4to receive an operation input by the user.

The image capturing unit13is a function implemented by a command from the CPU111, the imaging device101, the image processing device104, the imaging control device105, the microphone108, and the audio processing device109inFIG. 4to capture the image of the subject (e.g., an object or surroundings) and acquire the captured image. The captured image acquired by the image capturing unit13may be a video image or a still image. Further, the captured image may be accompanied by sound. The image capturing unit13captures the image of a two-dimensional code displayed on the display317of the communication terminal30(seeFIG. 14), for example.

The reading unit14is a function implemented by a command from the CPU111and devices such as the image processing device104inFIG. 4to read the two-dimensional code in the captured image acquired by the image capturing unit13.

The setting information processing unit15is a function implemented by a command from the CPU111inFIG. 4to acquire setting information for using the content distribution service with the two-dimensional code read by the reading unit14.

The network control unit16is a function implemented by a command from the CPU111and the network I/F119inFIG. 4to control the connection to the communication network5such as the Internet. For example, the network control unit16accesses the router90to connect to the communication network5.

The client program managing unit17is a function implemented by a command from the CPU111inFIG. 4to manage the client program executed by the image capturing apparatus10. For example, the client program managing unit17manages the client program installed for each available content distribution service.

The content transmission control unit18is a function implemented by a command from the CPU111inFIG. 4to control the transmission of content to the content distribution system50. For example, the content transmission control unit18transmits the captured image acquired by the image capturing unit13to the content distribution system50.

The connection unit21is a function implemented by a command from the CPU111and the input and output I/F116or the near field communication circuit117inFIG. 4to receive power supply from the communication terminal30and perform data communication.

The storing and reading unit19is a function implemented by a command from the CPU111inFIG. 4to store various data in the storage unit1000or read various data therefrom. The storage unit1000also stores the data of the captured image acquired by the image capturing unit13. The data of the captured image stored in the storage unit1000may be deleted from the storage unit1000after a predetermined time has elapsed since the acquisition of the data of the captured image by the image capturing unit13or after the data of the captured image has been transmitted to the content distribution system50.

A functional configuration of the communication terminal30will be described withFIG. 10B.

The communication terminal30includes a transmitting and receiving unit31, a receiving unit32, a display control unit33, a determination unit34, a setting information generating unit35, a two-dimensional code generating unit36, a connection unit37, and a storing and reading unit39. Each of these units is a function or functional unit implemented when at least one of the components illustrated inFIG. 2operates in response to a command from the CPU301in accordance with a program deployed on the RAM303. The communication terminal30further includes a storage unit3000implemented by the ROM302or the recording medium307illustrated inFIG. 2.

The transmitting and receiving unit31is a function implemented by a command from the CPU301and the telecommunication circuit311inFIG. 2to transmit and receive various data and information to and from another apparatus via the router90.

The receiving unit32is a function implemented by a command from the CPU301and an input device such as the touch panel321inFIG. 2to receive various selections and operations input to the communication terminal30.

The display control unit33is a function implemented by a command from the CPU301inFIG. 2to control the display317of the communication terminal30to display various screens. The display control unit33controls the display317to display the two-dimensional code generated by the two-dimensional code generating unit36.

The determination unit34is a function implemented by a command from the CPU301inFIG. 2to make various determinations.

The setting information generating unit35is a function implemented by a command from the CPU301inFIG. 2to generate the setting information for using the content distribution service.

The two-dimensional code generating unit36is a function implemented by a command from the CPU301inFIG. 2to generate the two-dimensional code with the setting information generated by the setting information generating unit35. The two-dimensional code is a code such as a quick response (QR) code (registered trademark), DataMatrix (DataCode) (registered trademark), MaxiCode (registered trademark), or portable document format (PDF)417, for example.

The connection unit37is a function implemented by a command from the CPU301and the external apparatus connection I/F318or the near field communication circuit319inFIG. 2to supply power to the image capturing apparatus10and perform data communication.

The storing and reading unit39is a function implemented by a command from the CPU301inFIG. 2to store various data in the storage unit3000or read various data therefrom.

A functional configuration of the content distribution system50will be described withFIG. 10A.

The content distribution system50includes a transmitting and receiving unit51, an authentication unit52, a determination unit53, an authorization information managing unit54, a content distribution managing unit55, and a storing and reading unit59. Each of these units is a function or functional unit implemented when at least one of the components illustrated inFIG. 3operates in response to a command from the CPU501in accordance with a program deployed on the RAM503. The content distribution system50further includes a storage unit5000implemented by the ROM502, the HD504, or the recording medium506illustrated inFIG. 3.

The transmitting and receiving unit51is a function implemented by a command from the CPU501and the network I/F508inFIG. 3to transmit and receive various data and information to and from another apparatus via the communication network5.

The authentication unit52is a function implemented by a command from the CPU501inFIG. 3to perform an authentication process for an authentication request source apparatus based on a connection request received by the transmitting and receiving unit51. For example, the authentication unit52performs a search through an authentication management database (DB)5001in the storage unit5000with a search key set to authorization information (i.e., a user identifier (ID) and a password) included in the connection request received by the transmitting and receiving unit51. The authentication unit52then performs the authentication process for the authentication request source apparatus by determining whether the same user ID and password as those in the connection request are managed in the authentication management DB5001.

The determination unit53is a function implemented by a command from the CPU501inFIG. 3to make various determinations.

The authorization information managing unit54is a function implemented by a command from the CPU501inFIG. 3to manage authorization information representing an access right to the content distribution service. For example, the authorization information managing unit54performs a search through an authorization information management DB5003in the storage unit5000with a search key set to the user ID included in the setting information received by the transmitting and receiving unit51, to thereby identify an authorization code associated with the user ID.

The content distribution managing unit55is a function implemented by a command from the CPU501inFIG. 3to manage the content distribution by the content distribution service.

The storing and reading unit59is a function implemented by a command from the CPU501inFIG. 3to store various data in the storage unit5000or read various data therefrom. The storage unit5000also stores client program identification information (i.e., a client program ID)5005for identifying the client program provided by the client program distribution system70(seeFIG. 11C). The client program identification information5005is an example of dedicated program identification information.

FIG. 11Ais a conceptual diagram illustrating an authentication management table. The storage unit5000stores the authentication management DB5001configured as the authentication management table as illustrated inFIG. 11A. In the authentication management table, passwords are managed in association with user IDs for identifying users, which are managed by the content distribution system50. For example, the authentication management table illustrated inFIG. 11Aindicates that the user ID and the password of a user A are “01aa” and “aaaa,” respectively. In the example described below, the user ID is used in the settings for using the content distribution service. Alternatively, an apparatus ID (terminal ID) for identifying the image capturing apparatus10may be used in the settings for using the content distribution service. In this case, the apparatus IDs (terminal IDs) replace the user IDs in the authentication management table to be managed in association with the passwords.

FIG. 11Bis a conceptual diagram illustrating an authorization information management table. The storage unit5000stores the authorization information management DB5003configured as the authorization information management table as illustrated inFIG. 11B. In the authorization information management table, the authorization information and the authorization code are managed in association with the corresponding user ID of the user managed in the content distribution service. The authorization information represents the access right to the content distribution service. For example, the authorization information management table illustrated inFIG. 11Bindicates that the user A with the user ID “01aa” has a “full” access right to the content distribution service, and that a user B with a user ID “01ba” has a “limited” access right to the content distribution service, i.e., the user B has a limited range of accessibility to the content distribution service. The authorization information management table inFIG. 11Bfurther indicates that a user C with a user ID “01ca” has “no” access right to the content distribution service.

A functional configuration of the client program distribution system70will be described withFIG. 10B.

The client program distribution system70includes a transmitting and receiving unit71, a client program managing unit72, and a storing and reading unit79. Each of these units is a function or functional unit implemented when at least one of the components illustrated inFIG. 3operates in response to a command from the CPU701in accordance with a program deployed on the RAM703. The client program distribution system70further includes a storage unit7000implemented by the ROM702, the HD704, or a recording medium706illustrated inFIG. 3.

The transmitting and receiving unit71is a function implemented by a command from the CPU701and the network I/F708inFIG. 3to transmit and receive various data and information to and from another apparatus via the communication network5. For example, the transmitting and receiving unit71transmits a client program7001(an example of a dedicated program) stored in the storage unit7000to the content distribution system50in response to a request from the image capturing apparatus10.

The client program managing unit72is a function implemented by a command from the CPU701inFIG. 3to manage the client program7001for enabling the use of the content distribution service. The client program managing unit72accepts the registration of the client program7001, and stores (i.e., registers) the client program7001in the storage unit7000.

The storing and reading unit79is a function implemented by a command from the CPU701inFIG. 3to store various data in the storage unit7000or read various data therefrom. The storage unit7000also stores the client program7001for enabling the image capturing apparatus10to use the content distribution service.

A functional configuration of the router90will be described withFIG. 10B.

The router90includes a transmitting and receiving unit91, a determination unit92, and a storing and reading unit99. Each of these units is a function or functional unit implemented when at least one of the components illustrated inFIG. 3operates in response to a command from the CPU901in accordance with a program deployed on the RAM903. The router90further includes a storage unit9000implemented by the ROM902, the HD904, or a recording medium906illustrated inFIG. 3.

The transmitting and receiving unit91is a function implemented by a command from the CPU901and the network I/F908inFIG. 3to transmit and receive various data and information to and from another apparatus via the communication network5.

The determination unit92is a function implemented by a command from the CPU901inFIG. 3to make various determinations. For example, in response to a request from the image capturing apparatus10, the determination unit92determines whether the image capturing apparatus10is connectable to the communication network5.

The storing and reading unit99is a function implemented by a command from the CPU901inFIG. 3to store various data in the storage unit9000or read various data therefrom.

Processes and operations performed in the communication system1aof the first embodiment will be described withFIGS. 12 to 21.

A description will first be given of a process of uploading content from the image capturing apparatus10to the content distribution system50.

FIGS. 12 and 15are sequence diagrams illustrating an exemplary content distribution process performed in the communication system1aof the first embodiment. In response to receipt of a predetermined input operation performed by the user of the communication terminal30, the receiving unit32of the communication terminal30receives a user selection of a content distribution service provided by the content distribution system50(step S11). Examples of the content distribution service, which distributes content such as a video image or an application, include YouTube, Instagram, and Twitter.

Then, the transmitting and receiving unit31of the communication terminal30transmits a setting start request to the content distribution system50(step S12). The setting start request requests settings for starting the use of the content distribution service. Then, the transmitting and receiving unit51of the content distribution system50receives the setting start request transmitted from the communication terminal30. The transmitting and receiving unit51then transmits to the communication terminal30setting screen data to be used in the settings for starting the use of the content distribution service (step S13). Then, the transmitting and receiving unit31of the communication terminal30receives the setting screen data transmitted from the content distribution system50.

Then, the display control unit33of the communication terminal30controls the display317to display a setting screen200(seeFIG. 13) based on the setting screen data received at step S13(step S14).

The setting screen200displayed on the communication terminal30will be described withFIG. 13.

FIG. 13is a diagram illustrating an example of the setting screen200displayed on the communication terminal30of the first embodiment. The setting screen200illustrated inFIG. 13is displayed on the communication terminal30when the user performs setting to start using the content distribution service. The setting screen200includes a network connection information input field201, an authentication information input field203, a channel information input field205, an OK button207, and a CLOSE button209. The network connection information input field201is used to input network connection information for connecting to the communication network5. The authentication information input field203is used to input the user ID and the password, which are used in a user authentication process performed in the content distribution system50. The channel information input field205is used to input information of the channel of the content distribution service. The OK button207is pressed to start the setting process. The CLOSE button209is pressed to cancel the setting process.

The network connection information includes the service set identifier (SSID) and the pass phrase of the router90for connecting to the communication network5, for example. The channel information is information for identifying the distribution implemented on the content distribution service. The content distribution system50may implement multiple distributions on the same content distribution service, and thus distinguishes the respective distributions by channel. In the example described here, the channel information is input by the user. Alternatively, the channel information may be generated by the content distribution system50in accordance with the mode of use of the content distribution service. In this case, the channel information generated by the content distribution system50is included in later-described service provision information to be transmitted to the communication terminal30.

The user may input information to each of the input fields by directly inputting the information with an input device such as the touch panel321or by selecting one of presented information items. The input fields may be displayed on separately displayed different setting screens. Further, information read from a recording medium connected to the communication terminal30, such as a subscriber identity module (SIM) card or a secure digital (SD) card, may be input to the input fields.

In response to the data input to the input fields in the setting screen200by the user of the communication terminal30, the receiving unit32of the communication terminal30receives input of setting request information (step S15). Then, the transmitting and receiving unit31of the communication terminal30transmits the setting request information received at step S15to the content distribution system50(step S16). The setting request information includes the channel information for identifying the channel of the content distribution service to be used, the authentication information for the content distribution system50to use in the user authentication, and the network connection information to be used to connect to the communication network5. Then, the transmitting and receiving unit51of the content distribution system50receives the setting request information transmitted from the communication terminal30.

Then, the storing and reading unit59of the content distribution system50reads from the storage unit5000the service provision information for providing the content distribution service to the user (step S17). Specifically, the storing and reading unit59reads the client program identification information5005stored in the storage unit5000. Further, the authorization information managing unit54performs a search through the authorization information management DB5003in the storage unit5000with the search key set to the user ID included in the setting request information received by the transmitting and receiving unit51, for example, to thereby read the authorization code associated with the user ID. That is, the service provision information includes the client program identification information5005and the authorization code.

With the setting request information received at step S16and the service provision information read at step S17, the content distribution managing unit55then makes preparations for the content distribution (step S18). Specifically, the content distribution managing unit55creates a virtual room or channel for the content distribution, for example.

Then, the transmitting and receiving unit51of the content distribution system50transmits the service provision information read at step S17to the communication terminal30(step S19). Then, the transmitting and receiving unit31of the communication terminal30receives the service provision information transmitted from the content distribution system50.

The setting information generating unit35of the communication terminal30then generates the setting information for using the content distribution service (step S20). The setting information includes the setting request information received at step S15and the service provision information received at step S19.

Then, the two-dimensional code generating unit36generates the two-dimensional code with the setting information generated at step S20(step S21). Then, the display control unit33controls the display317to display the two-dimensional code generated at step S21(step S22).

The two-dimensional code displayed on the communication terminal30will be described withFIG. 14.

FIG. 14is a diagram illustrating an example of the two-dimensional code displayed on the communication terminal30of the first embodiment. A two-dimensional code450aillustrated inFIG. 14is a QR code generated by the two-dimensional code generating unit36. The setting information generated by the setting information generating unit35is embedded in the two-dimensional code450a. Hereinafter, the two-dimensional code450aand later-described two-dimensional codes450band450c(seeFIGS. 19 and 21) may each be referred to as the two-dimensional code450where distinction therebetween is unnecessary.

Then, as illustrated inFIG. 15, the image capturing unit13of the image capturing apparatus10captures the image of the two-dimensional code450adisplayed on the display317of the communication terminal30(step S31). Then, the image capturing apparatus10executes a setting information acquisition process with the two-dimensional code in the image captured at step S31(step S32).

The setting information acquisition process will be described in detail withFIG. 16.

FIG. 16is a flowchart illustrating an exemplary setting information acquisition process performed in the communication terminal30of the first embodiment.

The image capturing unit13first acquires the captured image of the two-dimensional code450a(step S32-1). Then, the reading unit14determines whether the two-dimensional code450ain the acquired captured image is unreadable (step S32-2). Herein, the image capturing apparatus10is the special image capturing apparatus illustrated inFIGS. 4 to 9. Therefore, the acquired captured image of the two-dimensional code450ais distorted, as illustrated inFIG. 17A. In this distorted state, the two-dimensional code450ain the captured image is unreadable. If the two-dimensional code450ain the acquired captured image is readable (NO at step S32-2), the reading unit14proceeds to the process of step S32-5. If the two-dimensional code450ain the acquired captured image is unreadable (YES at step S32-2), the reading unit14proceeds to the process of step S32-3.

The reading unit14then identifies the projection method of the lenses102of the image capturing apparatus10(step S32-3). In the present example, the image capturing apparatus10is the special image capturing apparatus illustrated inFIGS. 4 to 9. Therefore, the reading unit14identifies the projection method of the lenses102of the image capturing apparatus10as the equirectangular projection method. The reading unit14then performs conversion with equation (2) given below, to thereby generate a corrected image (step S32-4).

[Math.2]{xc=xED?+?ftan?+?fyc=yED?+?ftan?+?f?indicates text missing or illegible when filed(2)

Specifically, with equation (2), the reading unit14generates the corrected image by converting the coordinates of the captured image according to the equirectangular projection method identified at step S32-3into the coordinates according to the central projection method. In equation (2), x and y represent the coordinates on the image capturing plane (seeFIG. 17B), and xcand ycrepresent the coordinates according to the central projection method. Further, xEDand yEDrepresent the coordinates according to the equirectangular projection method. With equation (2), the reading unit14thus converts the coordinates xEDand yEDof the acquired captured image according to the equirectangular projection method into the coordinates xcand ycaccording to the central projection method, to thereby generate the corrected image represented by the converted coordinates xcand ycaccording to the central projection method. Equation (2) described above varies depending on the type of the lenses102employed in the image capturing apparatus10. An appropriate conversion equation is selected based on the projection method identified at step S32-3. Consequently, the image capturing apparatus10is capable of acquiring the setting information embedded in the two-dimensional code450aregardless of the type of the lenses102employed in the image capturing apparatus10.

The reading unit14reads the two-dimensional code450ain the captured image acquired at step S32-1or in the corrected image generated at step S32-4(step S32-5). Then, the setting information processing unit15deploys the two-dimensional code450aread at step S32-5, to thereby acquire the setting information embedded in the two-dimensional code450a(step S32-6).

As described above, the image capturing apparatus10acquires the setting information for using the content distribution service by reading the two-dimensional code450adisplayed on the communication terminal30.

The setting information acquired at step S32-6will be described withFIG. 18.

FIG. 18is a conceptual diagram illustrating exemplary setting information included in the two-dimensional code450of the first embodiment. The setting information acquired by the setting information processing unit15includes the channel information for identifying the channel of the content distribution service to be used, the authentication information for the content distribution system50to use in the user authentication, the network connection information to be used to connect to the communication network5, the client program identification information (i.e., client program ID)5005for identifying the client program7001for enabling the image capturing apparatus10to use the content distribution service, and the authorization code for identifying the access right of the user to the content distribution service. The channel information, the authentication information including the user ID and the password, and the network connection information including the SSID and the pass phrase are information input by the user on the setting screen200displayed on the communication terminal30. The client program ID and the authorization code are information managed by the content distribution system50. The image capturing apparatus10reads the two-dimensional code450ato acquire the setting information embedded in the two-dimensional code450a.

Referring back toFIG. 15, the transmitting and receiving unit11of the image capturing apparatus10transmits a network connection request to the router90to request connection to the communication network5(step S33). The network connection request includes the network connection information included in the setting information acquired at step S32-6. Then, the transmitting and receiving unit91of the router90receives the network connection request transmitted from the image capturing apparatus10. With the network connection information received at step S33, the router90performs network connection to the image capturing apparatus10(step S34). Thereby, the network control unit16of the image capturing apparatus10establishes the connection to the communication network5via the router90.

Then, the transmitting and receiving unit11of the image capturing apparatus10transmits a client program acquisition request to the client program distribution system70to request download of the client program7001(step S35). The client program acquisition request includes the client program identification information5005included in the setting information acquired at step S32-6. Then, the transmitting and receiving unit71of the client program distribution system70receives the client program acquisition request transmitted from the image capturing apparatus10. The transmitting and receiving unit71then transmits the client program7001stored in the storage unit7000to the image capturing apparatus10(step S36). Then, the transmitting and receiving unit11of the image capturing apparatus10receives (i.e., downloads) the client program7001.

The client program managing unit17of the image capturing apparatus10installs and starts the client program7001received at step S36(step S37). Then, with the started client program7001, the transmitting and receiving unit11transmits a connection request to the content distribution system50to request connection to the content distribution service (step S38). The connection request includes the authentication information (i.e., the user ID and the password) included in the setting information acquired at step S32-6. Then, the transmitting and receiving unit51of the content distribution system50receives the connection request transmitted from the image capturing apparatus10.

With the authentication information received by the transmitting and receiving unit51, the authentication unit52of the content distribution system50executes the authentication process for the user of the image capturing apparatus10(step S39). Specifically, the authentication unit52performs a search through the authentication management table (seeFIG. 11A) with the search key set to the user ID and the password included in the connection request received by the transmitting and receiving unit51. If the same user ID and password as those in the connection request are managed in the authentication management table, the authentication unit52allows the user the image capturing apparatus10to connect (i.e., log in) to the content distribution service. If the same user ID and password as those in the connection request are managed in the authentication management table, the processes described below are executed. Further, the authorization information managing unit54performs a search through the authorization information management table (seeFIG. 11B) with the search key set to the authorization code included in the connection request received by the transmitting and receiving unit51, and grants the user of the image capturing apparatus10the access right associated with the authorization code.

Then, the transmitting and receiving unit51transmits the authorization information including the granted access right to the image capturing apparatus10(step S40). Then, the transmitting and receiving unit11of the image capturing apparatus10receives the authorization information transmitted from the content distribution system50. The transmitting and receiving unit11of the image capturing apparatus10then transmits the image data of the image captured by the image capturing unit13to the content distribution system50(step S41). Thereby, the image capturing apparatus10distributes the image data of the captured image to the content distribution system50via the communication network5.

As described above, according to the communication system1a, the image capturing apparatus10captures the image of the two-dimensional code450adisplayed on the communication terminal30, and reads the two-dimensional code450ato acquire the setting information embedded therein. The communication system1athereby enables simple setting of image distribution with the image capturing apparatus10.

According to a typical communication system, an image capturing apparatus has a dedicated network interface (e.g., network card) for communication with a communication terminal. Therefore, the connection to the Internet is unavailable during the setting of image distribution with the communication terminal. However, the authorization information of the content distribution service is often acquired via the Internet, and the actual distribution of content involves the connection to the Internet. Consequently, switching of the network connection frequently occurs during the setting operation, complicating the setting procedure. Further, to use multiple content distribution services, separate software applications (i.e., client programs) for the multiple content distribution services are typically preinstalled in the image capturing apparatus.

According to the communication system1aof the present embodiment, on the other hand, the communication terminal30displays the two-dimensional code450a, in which the setting information for using the content distribution service is embedded. Then, the image capturing apparatus10acquires the setting information by capturing the image of the displayed two-dimensional code450a, and performs the setting for the image distribution with the acquired setting information. With the image capturing function of the image capturing apparatus10, therefore, the communication system1asimplifies the setup (i.e., setting) of the image distribution, obviating the switching of the network connection. Further, when the image capturing apparatus10is the special image capturing apparatus equipped with the wide-angle lenses102, the image capturing apparatus10converts the captured image of the two-dimensional code450ain accordance with the projection method of the lenses102, to thereby acquire the setting information embedded in the two-dimensional code450a. Accordingly, even if the image capturing apparatus10is the special image capturing apparatus equipped with the wide-angle lenses102, for example, the setting information embedded in the two-dimensional code450ais reliably acquired regardless of the type of the imaging device101.

A first modified example of the two-dimensional code450displayed on the communication terminal30will be described withFIGS. 19 and 20.

FIG. 19is a diagram illustrating the first modified example of the two-dimensional code450of the first embodiment displayed on the communication terminal30. A two-dimensional code450billustrated inFIG. 19is distorted from the two-dimensional code450aillustrated inFIG. 14. The image capturing apparatus10is capable of acquiring the setting information embedded in the two-dimensional code450bdisplayed on the communication terminal30by reading the two-dimensional code450b.

A process of generating the two-dimensional code450billustrated inFIG. 19will be described withFIG. 20.

FIG. 20is a flowchart illustrating an exemplary process of generating the first modified example of the two-dimensional code450. The process illustrated inFIG. 20is executed at step S21ofFIG. 12.

The two-dimensional code generating unit36first generates the two-dimensional code450awith the setting information generated at step S20inFIG. 12(step S21-1). The two-dimensional code450agenerated in this step is not distorted, as illustrated inFIG. 14. Then, the two-dimensional code generating unit36identifies the projection method of the lenses102of the image capturing apparatus10(step S21-2). In the present example, the image capturing apparatus10is the special image capturing apparatus illustrated inFIGS. 4 to 9. Thus, the two-dimensional code generating unit36identifies the equirectangular projection method as the projection method of the lenses102of the image capturing apparatus10. It is assumed here that the information of the projection method of the image capturing apparatus10is stored in the communication terminal30.

Then, based on the projection method identified at step S21-2, the two-dimensional code generating unit36determines whether the two-dimensional code450agenerated at step S21-1should be corrected (step S21-3). If the projection method identified at step S21-2is the central projection method, the two-dimensional code generating unit36determines that the two-dimensional code450adoes not need to be corrected. If the projection method identified at step S21-2is a projection method other than the central projection method, the two-dimensional code generating unit36determines that the two-dimensional code450ashould be corrected. If having determined that the two-dimensional code450ashould be corrected (YES at step S21-3), the two-dimensional code generating unit36proceeds to the process of step S21-4. If having determined that the two-dimensional code450adoes not need to be corrected (NO at step S21-3), the two-dimensional code generating unit36completes the two-dimensional code generation process.

If having determined that the two-dimensional code450ashould be corrected (YES at step S21-3), the two-dimensional code generating unit36converts the two-dimensional code450ainto a two-dimensional code according to the projection method identified at step S21-2, to thereby generate a corrected two-dimensional code (step S21-4). Specifically, the two-dimensional code generating unit36generates the two-dimensional code450bwith equation (2) described above. In equation (2), xcand ycrepresent the coordinates of the two-dimensional code450agenerated at step S21-1, and xEDand yEDrepresent the coordinates according to the equirectangular projection method obtained through the conversion. With equation (2), the two-dimensional code generating unit36thus converts the coordinates xcand ycof the two-dimensional code450agenerated at step S21-1into the coordinates xEDand yEDaccording to the equirectangular projection method. The two-dimensional code generating unit36then generates the two-dimensional code450brepresented by the coordinates xEDand yEDaccording to the equirectangular projection method obtained through the conversion. Herein, equation (2) varies depending on the type of the lenses102employed in the image capturing apparatus10, and an appropriate conversion equation is selected based on the projection method identified at step S21-2.

When the image capturing apparatus10reads the distorted two-dimensional code450bdisplayed on the communication terminal30, therefore, the two-dimensional code450bis read as a normal (i.e., undistorted) two-dimensional code (e.g., the two-dimensional code450a). In this case, the two-dimensional code450bis readable in the setting information acquisition process of the image capturing apparatus10inFIG. 16(NO at step S32-2). Therefore, the image capturing apparatus10is capable of acquiring the setting information embedded in the two-dimensional code450bwithout generating the corrected image. Except for the two-dimensional code generation process illustrated inFIG. 20, similar processes to those illustrated inFIGS. 12 and 15are executed in the present example.

A second modified example of the two-dimensional code450displayed on the communication terminal30will be described withFIG. 21.

FIG. 21is a diagram illustrating the second modified example of the two-dimensional code450of the first embodiment displayed on the communication terminal30. Unlike the two-dimensional code450billustrated inFIG. 19, a two-dimensional code450cillustrated inFIG. 21includes a plurality of two-dimensional codes. Further, in the two-dimensional code450c, the entirety of the plurality of two-dimensional codes displayed on the display317is distorted. To display such a two-dimensional code450c, the communication terminal30generates the two-dimensional code450cwith the two-dimensional code generation process illustrated inFIG. 20. Similarly as in the example of the two-dimensional code450b, the image capturing apparatus10is capable of reading the setting information embedded in the two-dimensional code450cwithout the corrected image generation process illustrated inFIG. 16.

A communication system1bof a second embodiment of the present invention will be described. The same components and functions as those in the first embodiment will be denoted with the same reference numerals, and description thereof will be omitted.

In the communication system1bof the second embodiment, the process of generating the two-dimensional code450to be displayed on the communication terminal30is executed by the content distribution system50.

A functional configuration of the communication system1bof the second embodiment will be described withFIGS. 22A and 22B.

FIGS. 22A and 22Bare diagrams illustrating an exemplary functional configuration of the communication system1bof the second embodiment. InFIGS. 22A and 22B, the functions of the apparatuses and terminal except the content distribution system50are similar to those illustrated inFIGS. 10A and 10B, and thus description thereof will be omitted. The content distribution system50includes, as well as the functions thereof illustrated inFIG. 10A, a setting information generating unit56and a two-dimensional code generating unit57.

The setting information generating unit56is a function implemented by a command from the CPU501inFIG. 3to generate the setting information for using the content distribution service.

The two-dimensional code generating unit57is a function implemented by a command from the CPU501inFIG. 3to generate the two-dimensional code450with the setting information generated by the setting information generating unit56.

Processes and operations performed in the communication system1bof the second embodiment will be described withFIG. 23.

FIG. 23is a sequence diagram illustrating an exemplary content distribution process performed in the communication system1bof the second embodiment. The processes of steps S51to S58are similar to those of steps S11to S18inFIG. 12, and thus description thereof will be omitted.

The setting information generating unit56generates the setting information for using the content distribution service (step S59). Herein, the setting information includes the setting request information received at step S56and the service provision information read at step S57.

The two-dimensional code generating unit57generates the two-dimensional code450with the setting information generated at step S59(step S60). A method of generating the two-dimensional code450employed in this step is similar to that illustrated inFIG. 20, and thus description thereof will be omitted. Then, the transmitting and receiving unit51transmits the two-dimensional code450generated at step S60to the communication terminal30(step S61). Then, the transmitting and receiving unit31of the communication terminal30receives the two-dimensional code450transmitted from the content distribution system50. Then, the display control unit33of the communication terminal30controls the display317to display the two-dimensional code450received at step S61(step S62). Subsequent processes are similar to the processes of steps S31to S41illustrated inFIG. 15, and thus description thereof will be omitted.

As described above, according to the communication system1bof the second embodiment, in which the two-dimensional code450having the setting information embedded therein is generated by the content distribution system50, the setup (i.e., setting) of the image distribution in the image capturing apparatus10is simplified similarly as in the communication system1aof the first embodiment.

As described above, the image capturing apparatus10of the foregoing embodiments of the present invention is capable of executing the image distribution without network switching. Consequently, the setting of the image distribution is simplified.

Further, according to the communication system1aof the first embodiment and the communication system1bof the second embodiment, the communication terminal30displays the two-dimensional code450in which the setting information for using the content distribution service is embedded. Consequently, the setting of the image distribution by the image capturing apparatus10is performed with the image capturing function of the image capturing apparatus10.

The various tables of the embodiments described above may be generated by machine learning. The mutually associated data items in each of the tables may be categorized by machine learning to obviate the need for the tables. Herein, machine learning refers to a technology for causing a computer to acquire learning ability similar to human learning ability. According to the technology, the computer autonomously generates, from previously learned data, algorithms for making decisions such as data identification, and makes predictions by applying the algorithms to new data. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a learning method combining two or more of these learning methods. The learning method for machine learning is not limited to a particular method.

Each of the functions of the described embodiments may be implemented by one or more processing circuits or circuitry. Circuitry includes a programmed processor, as a processor includes circuitry. A processing circuit also includes devices such as an application specific integrated circuit (ASIC), digital signal processor (DSP), field programmable gate array (FPGA), and conventional circuit components arranged to perform the recited functions. Further, the above-described steps are not limited to the order disclosed herein.

Further, in this disclosure, the spherical image does not have to be the full-view spherical image of a full 360 degrees in the horizontal direction. For example, the spherical image may be a wide-angle view image having an angle of anywhere from 180 to any amount less than 360 degrees in the horizontal direction. It is desirable that the spherical image is image data having at least a part that is not entirely displayed in the viewable area. The image, if desired, can be made up of multiple pieces of image data which have been captured through different lenses, or using different image sensors, or at different times. Moreover, the image capturing apparatus may capture any desired code, other than the two-dimensional code, as long as the code contains information required for the image capturing apparatus to connect to a particular network used for distributing image data.