Patent Description:
An integrated type omnidirectional camera ((fully) spherical camera) that can capture an omnidirectional image ((fully) spherical image), which has two wide angle lenses (e.g. fish eye lenses) in the front and the back of a camera is becoming popular. Generally, an omnidirectional camera does not include a display for live viewing because of the characteristic of the way of capturing an omnidirectional image, so remote live view display is performed on a display of a smartphone connected to the omnidirectional camera, in order to observe an object (captured image).

<CIT> discloses a technique to display a plurality of information corresponding to a plurality of view points respectively, in order to easily observe a captured omnidirectional image from a desired view point.

As illustrated in <FIG>, in the case of a remote live view display of a captured omnidirectional image, a part of the omnidirectional image is clipped and displayed on a screen. The user can freely change the display range (range displayed on the screen; clipping range) of the omnidirectional image by a "flick" operation or the like.

However in the case of checking the captured (recorded) omnidirectional image on a personal computer (PC) or the like, an entire image of the omnidirectional image is displayed as a thumbnail image of a file of the omnidirectional image, as illustrated in <FIG>. Since the impression of this thumbnail image does not match with the impression of the display range of the remote live view display when the image was captured, the user cannot easily recognize which scene of the omnidirectional image is captured in each file.

Furthermore, when a file is reproduced, a range of the omnidirectional image, which is captured in a predetermined direction (e.g. front direction of the spherical camera), is displayed first as the display range. Therefore, the impression of the display range when the reproduction is started does not match with the impression of the display range of the remove live view display when the image was captured, and the user cannot easily recognize which scene of the omnidirectional image is captured in the reproduced file.

Document <CIT> discloses a system for presenting content. The content may be a spherical video and is acquired from, e.g. a social networking system and is presented through a graphical user interface.

Document <CIT> discloses an electronic device including a display and a processor electrically connected with the display and a memory and configured to use a first content in a <NUM>-dimensional (3D) space in response to executing the first content, render an area corresponding to a field of view, and store information relating to the field of view in the memory as metadata of the first content in response to a specified event.

Document <CIT> discloses Computer software and an associated digital camera system for capturing digital wide angle such as hemispherical images, for processing two or more wide angle or hemispherical images to seam the wide angle or hemispherical images together to form a spherical image, for linking sound data files, location data, time and date data and horizontal reference data to the captured image data, and for selecting for display or for printing undistorted portions of the spherical images.

Document <CIT> discloses a display control unit that simultaneously displays a plurality of cut-out images cut out from respective ranges of a wide-angle moving image.

Document <CIT> discloses an information processing apparatus includes imaging units and a display control unit. The imaging units are arranged, on a surface almost parallel to a display surface of a display unit, in a direction almost orthogonal to a long side of the display unit. The display control unit controls, in a state in which the long side of the display unit is almost parallel to a direction of gravitational force, the display unit to display a plurality of areas of a horizontally long image, which is obtained by connecting images generated by the imaging units, in rows in a longitudinal direction of the display unit. The display control unit controls the display unit to display, as those areas, first and second images including areas of both end portions in a longitudinal direction of the horizontally long image, and a third image including an area present between the both end portions.

Document <CIT> discloses an image recording apparatus and an image recording method which can output an image suitable for an aspect ratio of a display screen.

Document <CIT> discloses a mobile terminal including a short-range communication module configured to perform short-range communication with an omnidirectional capture device for capturing an omnidirectional image, a display unit configured to display the omnidirectional image received through the short-range communication module and to receive user input, and a controller configured to set an area, in which a moving image is generated, in the omnidirectional image and to generate the moving image in the set area.

The present invention provides a technique to allow a user to easily recognize which scene of the image file is captured in a file.

The present invention in its first aspect provides a system as specified in claims <NUM> to <NUM>. The present invention in its second aspect provides a control method as specified in claim <NUM>. The present invention in its fourth aspect provides a computer readable medium as specified in claim <NUM>.

Embodiments of the present invention will be described with reference to the drawings. <FIG> is a front perspective view (external view) of a digital camera <NUM> (image-capturing apparatus), which is an electronic apparatus according to this embodiment. <FIG> is a rear perspective view (external view) of the digital camera <NUM>. The digital camera <NUM> is an omnidirectional camera ((fully) spherical camera).

A barrier 102a is a protective window for a front camera unit of which image capturing range is a front area of the digital camera <NUM>. The front camera unit is a wide angle camera unit of which image capturing range is a wide range on the front side of the digital camera <NUM> that is at least <NUM>° vertically and horizontally, for example. A barrier 102b is a protective window for a rear camera unit of which image capturing range is a rear area of the digital camera <NUM>. The rear camera unit is a wide-angle camera unit of which image capturing range is a wide range in the rear side of the digital camera <NUM> that is at least <NUM>° vertically and horizontally, for example.

A display unit <NUM> displays various information. A shutter button <NUM> is an operation unit (operation member) to instruct image capturing. A mode selecting switch <NUM> is an operation unit to switch various modes. A connection I/F <NUM> is a connector to connect a connection cable to the digital camera <NUM>, whereby the digital camera <NUM> is connected to an external apparatus (e.g. smartphone, personal computer, TV) via the connection cable. An operation unit <NUM> has various switches, buttons, dials, touch sensors or the like to receive various operations from the user. A power switch <NUM> is a push button to switch the power supply ON/OFF.

A light-emitting unit <NUM> is a light-emitting member (e.g. as a light-emitting diode (LED)) that notifies the user on various states of the digital camera <NUM> using light-emitting patterns and light-emitting colors. A fixing unit <NUM> has a screw hole for a tripod, for example, and is used to install and fix the digital camera <NUM> to a fixture (e.g. tripod).

<FIG> is a block diagram depicting a configuration example of the digital camera <NUM>.

The barrier 102a covers an image-capturing system (e.g. an image capturing lens 103a, a shutter 101a, an image-capturing unit 22a) of the front camera unit, so as to prevent contamination of and damage to the image-capturing system. The image capturing lens 103a is a lens group including a zoom lens and a focus lens, and is a wide-angle lens. The shutter 101a is a shutter which has an aperture function to adjust the incident quantity of the object light to the image-capturing unit 22a. The image-capturing unit 22a is an image pickup element (image sensor) constituted of a CCD, a CMOS element or the like to convert an optical image into an electric signal. An A/D convertor 23a converts an analog signal outputted from the image-capturing unit 22a into a digital signal. Instead of disposing the barrier 102a, the outer surface of the image capturing lens 103a may be exposure so that the image capturing lens 103a prevents contamination of and damage to the other components of the image-capturing system (e.g. shutter 101a, image-capturing unit 22a).

The barrier 102b covers an image-capturing system (e.g. an image capturing lens 103b, a shutter 101b, an image-capturing unit 22b) of the rear camera unit, so as to prevent contamination of and damage to the image-capturing system. The image capturing lens 103b is a lens group including a zoom lens and a focus lens, and is a wide-angle lens. The shutter 101b is a shutter which has an aperture function to adjust the incident quantity of the object light to the image-capturing unit 22b. The image-capturing unit 22b is an image pickup element constituted of a CCD, a CMOS element or the like to convert an optical image into an electric signal. An A/D convertor 23b converts an analog signal outputted from the image-capturing unit 22b into a digital signal. Instead of disposing the barrier 102b, the outer surface of the image capturing lens 103b may be exposed so that the image capturing lens 103b prevents contamination of and damage to the other components of the image-capturing system (e.g. shutter 101b, image-capturing unit 22b).

A virtual reality (VR) image is captured by the image-capturing unit 22a and the image-capturing unit 22b. The VR image is an image that can be VR-displayed (displayed in display mode "VR view"). The VR image includes an omnidirectional image ((fully) spherical image) captured by an omnidirectional camera ((fully) spherical camera), and a panoramic image having an image range (effective image range) that is wider than the display range of the display unit. The VR image includes not only a still image but also a moving image and a live view image (image acquired from the camera in near real-time). The VR image has an image range (effective image range) equivalent to the visual field that is at most <NUM>° in the vertical direction (vertical angle, angle from the zenith, elevation angle, depression angle, altitude angle, pitch angle), and <NUM>° in the horizontal direction (horizontal angle, azimuth angle, yaw angle).

The VR image includes an image that has an angle of view (visual field range) wider than the angle of view that a standard camera can capture, even if the angle is less than <NUM>° vertically and <NUM>° horizontally, or an image that has an image range (effective image range) wider than a possible display range of the display unit. For example, an image captured by a spherical camera that can capture an image of an object in a visual field (angle of view) that is <NUM>° horizontally (horizontal angle, azimuth angle), and <NUM>° vertically with the zenith at the center, is a type of VR image. Further, an image captured by a camera that can capture an image of an object in a visual field (angle of view) that is <NUM>° horizontally (horizontal angle, azimuth angle) and <NUM>° vertically with the horizontal direction at the center, is a type of VR image. In other words, an image which has an image range of a visual field that is at least <NUM>° (±<NUM>°) in the vertical direction and horizontal direction respectively, and which has an image range that is wider than a range that an individual can visually recognize at once, is a type of VR image.

When this VR image is VR-displayed (displayed in the display mode "VR view"), the seamless omnidirectional image can be viewed in the horizontal direction (horizontally rotating direction) by changing the orientation of the display apparatus (display apparatus that displays the VR image) in the horizontally rotating direction. In terms of the vertical direction (vertically rotating direction), the seamless omnidirectional image can be viewed in the ±<NUM>° range from above (zenith), but the range that exceeds <NUM>° from the zenith becomes a blank region where no image exists. The VR image can be defined as "an image of which image range is at least a part of a virtual space (VR space)".

The VR display (VR view) is a display method (display mode) in which the display range, to display an image in the visual field range in accordance with the orientation of the display apparatus, out of the VR image, can be changed. To view the image on a smartphone, which is a display apparatus, an image in the visual field range, in accordance with the orientation of the smartphone, is displayed. For example, it is assumed that an image in the visual angle (angle of view) centered at <NUM>° in the horizontal direction (specific azimuth, such as North) and <NUM>° in the vertical direction (<NUM>° from zenith, that is horizontal) out of the VR image, is being displayed at a certain point. If the orientation of the display apparatus is front/back inverted (e.g. display surface is changed from facing south to facing north), the display range is changed to an image in the visual angle centered at <NUM>° in the horizontal direction (opposite azimuth, such as South) and <NUM>° in the vertical direction (horizontal) out of the same VR image. In the case where a user views the image while holding the smartphone, the image displayed on the smartphone changes from an image to the North to an image to the South if the smartphone is turned from North to South (in other words, if the user turns their back). By this VR display, the user can visually experience the sensation (sense of immersion) as if the user were at the spot of the VR image (VR space).

The method of displaying the VR image is not limited to the above description. The display range may be moved (scrolled) in accordance with the user operation on a touch panel, direction button or the like, instead of by changing the orientation. When the VR image is displayed (when the display mode is "VR view"), the display range may be changed not only by changing the orientation, but also by a touch move on the touch panel, a drag operation by mouse, pressing the direction button and the like.

An image processing unit <NUM> performs a predetermined processing, such as pixel interpolation, resizing (e.g. zoom out), and color conversion, on the data from the A/D convertor 23a and the A/D convertor 23b, or the data from the memory control unit <NUM>. The image processing unit <NUM> also performs a predetermined arithmetic processing using captured image data. A system control unit <NUM> performs exposure control and distance measurement control on the basis of the arithmetic result acquired by the image processing unit <NUM>. Thereby the through the lens (TTL) type autofocus (AF) processing, auto exposure (AE) processing, pre-flash emission (EF) processing and the like are performed. The image processing unit <NUM> also performs a predetermined arithmetic processing using the captured image data, and performs TTL type auto white balance (AWB) processing on the basis of the acquired arithmetic result. Further, the image processing unit <NUM> performs basic image processing on the two images (two fish eye images; two wide angle images) acquired from the A/D convertor 23a and the A/D convertor 23b, and performs image connection processing to combine the two images on which the basic processing was performed, so as to generate a single VR image. Furthermore, the image processing unit <NUM> performs image clipping processing, zooming processing, distortion correction and the like to display the VR image when the VR image is VR-displayed in live view or when reproduced, and performs rendering to write the processing result in a VRAM of a memory <NUM>.

In the image connection processing, the image processing unit <NUM> uses one of the two images as a reference image and the other as a comparative image, calculates the amount of deviation between the reference image and the comparative image for each area by pattern matching processing, and detects a connection position to connect the two images on the basis of the amount of deviation in each area. Considering the detected connection position and the lens characteristic of each optical system, the image processing unit <NUM> corrects the distortion of each image by the geometric conversion, so as to convert each image into an image in a spherical format (spherical image format). Then the image processing unit <NUM> combines (blends) the two images in the spherical format, so as to generate one spherical image (VR image). The generated spherical image is an image based on the equidistant cylindrical projection, and the position of each pixel of the spherical image can be corresponded with the coordinates on the surface of a sphere (VR space) (3D mapping).

The output data from the A/D convertors 23a and 23b are written in the memory <NUM> via the image processing unit <NUM> and the memory control unit <NUM>, or via the memory control unit <NUM> without passing through the image processing unit <NUM>. The memory <NUM> stores image data which is acquired by the image-capturing units 22a and 22b and converted into digital data by the A/D convertors 23a and 23b, for example. The memory <NUM> also stores the image data to be transferred to a wirelessly-connected external apparatus (e.g. smartphone) via the communication unit <NUM>, and the image data to be outputted from the connection I/F <NUM> to an external display. The memory <NUM> has a storage capacity that is sufficient to store a predetermined number of still images, or a predetermined time of moving images and sound data.

The memory <NUM> also functions as a memory for image display (video memory). The data for image display, which is stored in the memory <NUM>, can be transferred to a wirelessly-connected external apparatus (e.g. smartphone) via the communication unit <NUM>, or can be outputted to an external display via the connection I/F <NUM>. The VR image, which was generated by the image processing unit <NUM> from the images captured by the image-capturing units 22a and 22b, and was stored in the memory <NUM>, may be transferred to a wirelessly-connected external apparatus (e.g. smartphone) via the communication unit <NUM>, and displayed on the external apparatus side. Thereby the external apparatus (e.g. smartphone) can function as an electronic view finder, and perform remote live view display (remote LV display). The remote LV display can also be performed by sequentially transferring the VR images stored in the memory <NUM> to an external display, and displaying the VR images on the screen of the external display. Hereafter, the images displayed by the remote LV display are called "remote live view images" (remote LV images).

A non-volatile memory <NUM> is a memory that functions as an electrically erasable and recordable recording medium, such as EEPROM. In the non-volatile memory <NUM>, constants, programs and the like for operation of the system control unit <NUM> are recorded. "Programs" here refer to computer programs that execute various flow charts, which will be described later in this embodiment.

The system control unit <NUM> is a control unit that includes at least one processor or circuit, and controls the digital camera <NUM> in general. The system control unit <NUM> implements each of the later mentioned processing of this embodiment by executing a program recorded in the above-mentioned non-volatile memory <NUM>. The system memory <NUM> is a RAM, for example, and in the system memory <NUM>, constants and variables for the operation of the system control unit <NUM> and programs read from the non-volatile memory <NUM> are developed. The system control unit <NUM> also controls display by controlling the memory <NUM>, the image processing unit <NUM>, the memory control unit <NUM> and the like. A system timer <NUM> is a timer that measures the time used for various controls and the time of internal clocks.

The mode selecting switch <NUM>, the shutter button <NUM>, the operation unit <NUM> and the power switch <NUM> are used to input various operation instructions to the system control unit <NUM>.

The mode selecting switch <NUM> switches the operation mode of the system control unit <NUM> to one of a still image recording mode, a moving image capturing mode, a reproduction mode, a communication connecting mode and the like. The still image recording mode includes an auto image capturing mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode) and a program AE mode. Various scene modes, to set image capturing for each image capturing scene, and a custom mode are also included. The user can directly select one of these modes using the mode selecting switch <NUM>. After switching to an image capturing mode list screen using the mode selecting switch <NUM>, the user may selectively switch to one of the plurality modes displayed on the display unit <NUM> using another operation member. The moving image capturing mode may include a plurality of modes in the same manner.

The shutter button <NUM> includes a first shutter switch <NUM> and a second shutter switch <NUM>. The first shutter switch <NUM> is turned ON in the middle of the operation of the shutter button <NUM>, that is, in the half-depressed state (image capturing preparation instruction), and generates a first shutter switch signal SW1. By the first shutter switch signal SW1, the system control unit <NUM> starts the image capturing preparation operation, such as the auto focus (AF) processing, the auto exposure (AE) processing, the auto white balance (AWB) processing, and the pre-flash (EF) processing. The second shutter switch <NUM> is turned ON when the operation of the shutter button <NUM> completes, that is, in the fully-depressed state (image capturing instruction), and generates a second shutter switch signal SW2. By the second shutter switch signal SW2, the system control unit <NUM> starts a series of operations of the image capturing processing, from reading signals from the image-capturing units 22a and 22b to writing the image data to the recording medium <NUM>.

The shutter button <NUM> is not limited to an operation member that can perform a two-step operation (half-depression and full-depression), but may be an operation member that can perform only a one step of depression. In this case, the image capturing preparation operation and the image capturing processing are performed continuously by a one step depression. This is the same as the case of fully depressing the shutter button that can perform both half depression and full depression (case where the first shutter switch signal SW1 and the second shutter switch signal SW2 are generated almost simultaneously).

The operation unit <NUM> functions as various functional buttons that perform the functions assigned for each scene, by selecting various functional icons and options displayed on the display unit <NUM>. The functional buttons include: an end button, a return button, an image forward button, a jump button, a preview button and an attribute change button. For example, when the menu button is depressed, a menu screen, that allows various settings, is displayed on the display unit <NUM>. The user operates the operation unit <NUM> while viewing the menu screen displayed on the display unit <NUM>, whereby various settings can be performed intuitively.

The power switch <NUM> is a push button to switch the power ON/OFF. A power control unit <NUM> includes a battery detection circuit, a DC-DC convertor, and a switch circuit to select a block to be energized, so as to detect whether the battery is installed, a type of the battery, a residual amount of battery power and the like. The power control unit <NUM> also controls the DC-DC convertor on the basis of the detection result and the instructions of the system control unit <NUM>, and supplies the required voltage to each component, including the recording medium <NUM>, for a required period of time. A power supply unit <NUM> includes: a primary battery (e.g. alkali battery, lithium battery), a secondary battery (e.g. NiCd battery, an NiMH battery, an Li battery), and an AC adapter.

A recording medium I/F <NUM> is an interface with the recording medium <NUM> (e.g. memory card hard disk). The recording medium <NUM> is a storage unit (e.g. memory card) to record captured images, and is constituted of a semiconductor memory, an optical disk, a magnetic disk or the like. The recording medium <NUM> may be an exchangeable recording medium that is detachable from the digital camera <NUM> or may be a recording medium embedded in the digital camera <NUM>.

The communication unit <NUM> transmits/receives image signal and sound signals to/from an external apparatus that is connected wirelessly or via a cable. The communication unit <NUM> can also be connected to a wireless local area network (LAN) or Internet. The communication unit <NUM> transfers the VR images, which are captured by the image-capturing units 22a and 22b, generated by the image processing unit <NUM> and are stored in the memory <NUM>, to a wirelessly-connected external apparatus (e.g. smartphone) via the communication unit <NUM>, and displays the VR images on the external apparatus side. Thereby the external apparatus (e.g. smartphone) can function as an electronic view finder, and perform remote live view display (remote LV display). The communication unit <NUM> can also transmits an image recorded in the recording medium <NUM>, and can receive images and various other information from an external apparatus.

An orientation detection unit <NUM> detects an orientation of the digital camera <NUM> with respect to the direction of gravity. On the basis of the orientation detected by the orientation detection unit <NUM>, it can be determined whether the images captured by the image-capturing units 22a and 22b are images captured when the digital camera <NUM> is in the horizontal position, or images captured when the digital camera <NUM> is in the vertical position. It can also be determined to what degree the digital camera <NUM> was inclined in the three axis directions (rotation directions), that is, the yaw direction, the pitch direction and the roll direction, when the images were captured by the image-capturing units 22a and 22b. The system control unit <NUM> can add the orientation information in accordance with the orientation detected by the orientation detection unit <NUM> to the image file of the VR image captured by the image-capturing units 22a and 22b, or can rotate the image (adjust the orientation of the image so as to correct the inclination (zenith correction)) and record the rotated image. One or a set of a plurality of sensors, out of the acceleration sensor, gyro sensor, geo magnetic sensor, azimuth sensor, altitude sensor and the like may be used as the orientation detection unit <NUM>. Using the acceleration sensor, gyro sensor, azimuth sensor or the like, which constitute the orientation detection unit <NUM>, the movement of the digital camera <NUM> (e.g. pan, tilt, elevate, still) can be detected.

A microphone <NUM> is a microphone that collects sound around the digital camera <NUM>, that is recorded as sound of the VR image which is a moving image (VR moving image). A connection I/F <NUM> is a connection plug to which an HDMI® cable, USB cable or the like is connected so as to transmit or receive images to/from an external apparatus.

<FIG> is an external view of a display control apparatus <NUM>. The display control apparatus <NUM> is a display apparatus, such as a smartphone. A display <NUM> is a display unit that displays images and various information. The display <NUM> is integrated with a touch panel 206a, so that the touch operation on the display surface of the display <NUM> can be detected. The display control apparatus <NUM> can VR-display a VR image (VR content) on the display <NUM>. An operation unit 206b is a power button which receives operation to switch the power of the display control apparatus <NUM> ON/OFF. An operation unit 206c and an operation unit 206d are volume buttons to increase/decrease the volume of the sound outputted from a sound output unit <NUM>. An operation unit 206e is a home button to display a home screen on the display <NUM>. A sound output terminal 212a is an earphone jack, which is a terminal to output sound signals to an earphone, an external speaker or the like. A speaker 212b is a built-in speaker to output sound.

<FIG> is a block diagram depicting a configuration example of the display control apparatus <NUM>. A CPU <NUM>, a memory <NUM>, a non-volatile memory <NUM>, an image processing unit <NUM>, a display <NUM>, an operation unit <NUM>, a recording medium I/F <NUM>, an external I/F <NUM> and a communication I/F <NUM> are connected to an internal bus <NUM>. The sound output unit <NUM> and an orientation detection unit <NUM> are also connected to the internal bus <NUM>. Each unit connected to the internal bus <NUM> is configured such that data can be exchanged with other units via the internal bus <NUM>.

The CPU <NUM> is a control unit that controls the display control apparatus <NUM> in general, and includes at least one processor or circuit. The memory <NUM> is a RAM (e.g. volatile memory using a semiconductor element). The CPU <NUM> controls each unit of the display control apparatus <NUM> using the memory <NUM> as a work memory, in accordance with the program stored in the non-volatile memory <NUM>, for example. The non-volatile memory <NUM> stores such as data as image data and sound data, and various programs for the CPU <NUM> to operate. The non-volatile memory <NUM> is a flash memory or a ROM, for example.

The image processing unit <NUM> performs various image processing on the images stored in the non-volatile memory <NUM> and the recording medium <NUM>, the image signals acquired via the external I/F <NUM>, the images acquired via the communication I/F <NUM> and the like, on the basis of the control of the CPU <NUM>. The image processing performed by the image processing unit <NUM> includes: the A/D conversion processing, D/A conversion processing, encoding processing of image data, compression processing, decoding processing, enlarging/reducing processing (resizing), noise reduction processing and color conversion processing. The image processing unit <NUM> also performs various types of image processing (e.g. panoramic development, mapping processing, conversion) on a VR image, which is an omnidirectional image or a wide range image, which is not an omnidirectional image but an image having a wide range. The image processing unit <NUM> may be configured by dedicated circuit blocks to perform a specific image processing. Depending on the type of image processing, the CPU <NUM> may perform the image processing in accordance with the program, without using the image processing unit <NUM>.

The display <NUM> displays graphic user interface (GUI) screen constituting images and GUI on the basis of control of the CPU <NUM>. The CPU <NUM> generates a display control signal in accordance with the program, and controls each unit of the display control apparatus <NUM> so as to generate image signals to display the images on the display <NUM>, and output the image signals to the display <NUM>. On the basis of the generated and outputted image signals, the display <NUM> displays the image. The display control apparatus <NUM> may include only the configuration up to the interface to output the image signals for the display <NUM> to display the images, and the display <NUM> may be an external monitor (e.g. TV) or the like. The display <NUM> can function as an electronic view finder and perform remote live view display (remove LV display) by displaying VR images, which are captured by the digital camera <NUM> (image-capturing apparatus) and are sequentially transferred via the communication I/F <NUM>.

The operation unit <NUM> is an input device to receive user operation, which includes a text information input device (e.g. keyboard), a pointing device (e.g. mouse, touch panel), buttons, dials, a joystick, a touch sensor and a touch pad. In this embodiment, the operation unit <NUM> includes the touch panel 206a, and operation units 206b, 206c, 206d and 206e.

To the recording medium I/F <NUM>, a recording medium <NUM> (e.g. memory card, CD, DVD) can be removably attached. On the basis of the control of the CPU <NUM>, the recording medium I/F <NUM> reads data from the attached recording medium <NUM>, or writes data to the recording medium <NUM>. The external I/F <NUM> is an interface that is connected with an external apparatus via a cable or wirelessly, and inputs/outputs image signals and sound signals. The communication I/F <NUM> is an interface to transmit/receive various data (e.g. files, commands) by communicating with an external apparatus via the Internet <NUM> or the like.

The sound output unit <NUM> outputs the sound of a moving image or music data, operation tones, ring tones, various notification tones and the like. The sound output unit <NUM> includes the sound output terminal 212a to connect an earphone and the like, and the speaker 212b. The sound output unit <NUM> may output the sound data to an external speaker via wireless communication or the like.

The orientation detection unit <NUM> detects the orientation (inclination) of the display control apparatus <NUM> with respect to the direction of gravity, and the orientation of the display control apparatus <NUM> with respect to each axis in the yaw direction, pitch direction and roll direction. On the basis of the orientation detected by the orientation detection unit <NUM>, it can be determined whether the display control apparatus <NUM> is held horizontally or vertically, and whether the display control apparatus <NUM> turns up or down, or in a diagonal orientation. It can also be detected whether the display control apparatus <NUM> is inclined in the rotation directions (e.g. yaw direction, pitch direction, roll direction), the degree of the inclination, and whether the display control apparatus <NUM> rotated in the rotation direction. One or a combination of sensors (e.g. acceleration sensor, gyro sensor, geo magnetic sensor, azimuth sensor, altitude sensor) may be used as the orientation detection unit <NUM>.

As mentioned above, the operation unit <NUM> includes a touch panel 206a. The touch panel 206a is an input device, which is configured as a plane superimposed on the display <NUM>, so that the coordinate information corresponding with the contacted position is outputted. The CPU <NUM> can detect the following operation performed on the touch panel 206a or the state thereof.

When Touch-Down is detected, Touch-On is also detected at the same time. Unless Touch-Up is detected after Touch-Down, Touch-On is normally detected continuously. When Touch-Move is detected as well, Touch-On is detected at the same time. Even if Touch-On is detected, Touch-Move is not detected unless the touch position is moving. Touch-Off is detected when Touch-Up of all fingers and pen is detected.

These operations, states, and coordinates of the positions of the finger(s) or pen touching the touch panel 206a are notified to the CPU <NUM> via the internal bus, and on the basis of the notified information, the CPU <NUM> determines the kind of operation (touch operation) that was performed on the touch panel 206a. For Touch-Move, the CPU <NUM> can also determine the moving direction of the finger or pen on the touch panel 206a, on the basis of the change of the positional coordinates, for the vertical components and the horizontal components on the touch panel 206a respectively. If Touch-Move is detected for at least a predetermined distance, the CPU <NUM> determines that the slide operation was performed.

An operation of quickly moving a finger on the touch panel 206a for a certain distance in the touched state and releasing the finger is called "flick". In other words, flick is an operation of touching and moving the finger rapidly on the touch panel 206a. If Touch-Move is detected for at least a predetermined distance at a predetermined speed or faster, and Touch-Up is detected thereafter, the CPU <NUM> then determines that flick was performed (determines that flick was performed after the slide operation).

Further, a touch operation of touching a plurality of points (e.g. two points) simultaneously and moving these touch positions closer together is called "Pinch-In", and a touch operation of moving these touch positions further apart is called "Pinch-Out". Pinch-In and Pinch-Out are collectively called a pinch operation (or simply "pinch"). For the touch panel 206a, various types of touch panels may be used, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type and an optical sensor type. There is a type of detecting touch when the touch panel is actually contacted, and a type of detecting touch when a finger or pen approaches the touch panel, but either type may be used.

<FIG> are examples of the remove live view display on the display control apparatus <NUM>. In this embodiment, the display formats of the remote live view display includes a spherical (omnidirectional) image format and a zoom view format. The spherical image format is a format of displaying the entire VR image captured by the digital camera <NUM> (image-capturing apparatus) on the display <NUM> using equidistant cylindrical projection, that is the so called "panoramic format". In other words, in the case of the spherical image format, the VR image captured by the digital camera <NUM> is displayed as is. <FIG> is an example of the remote live view display in the spherical image format. The zoom view format is a format of clipping a partial region (range) from the VR image captured by the digital camera <NUM>, and displaying the clipped image on the display <NUM>. In the zoom view format, a partial region is normally clipped and displayed on the basis of the region instructed by the user using the display control apparatus <NUM> (smartphone). <FIG> is an example of the remote live view display in the zoom view format. Using the operation unit <NUM>, the user can switch the display mode between the display mode in the spherical format and the display mode in the zoom view format. The display modes that can be set are not limited to the spherical image format and the zoom view format, but may be display modes in other display formats.

<FIG> is a flow chart depicting an example of the general processing of the digital camera <NUM>. This processing is implemented by the system control unit <NUM> developing the program recorded in the non-volatile memory <NUM> in the system memory <NUM>, and executing the program. When the power of the digital camera <NUM> is turned ON, the processing in <FIG> starts.

In S401, the system control unit <NUM> determines whether or not a change in the display format (display mode) of the display control apparatus <NUM> was notified. Processing advances to S402 if notified, or to S403 if not. In S402, the system control unit <NUM> stores the format information, which indicates the notified display format (display format after the change; current display format) to the system memory <NUM> (update of the format information stored in the system memory <NUM>). The processing in S401 is also a processing to determine whether or not the format information was received (acquired). In this embodiment, the format information is acquired from the display control apparatus <NUM> via the communication unit <NUM>.

In S403, the system control unit <NUM> determines whether or not the change in the display range (range of captured image that is displayed in remote live view display) of the display control apparatus <NUM> was notified. Processing advances to S404 if notified, or to S405 if not. In S404, the system control unit <NUM> stores the range information on the notified display range (display range after the change; current display range) in the system memory <NUM> (update of the range information stored in the system memory <NUM>). The range information indicates the direction of the view point and the visual angle (angle of view) when the captured VR image (equidistant cylindrical projection) is 3D-mapped. The range information may be other information that indicates the display range. The processing in S403 is also a processing to determine whether or not the range information was received (acquired). In this embodiment, the range information is acquired from the display control apparatus <NUM> via the communication unit <NUM>.

In S405, the system control unit <NUM> determines whether or not an image capturing instruction was received from the user (image-capturing operation). Processing advances to S406 if the image capturing instruction was received, or to S411 if not. In S406, the system control unit <NUM> records the file of the captured VR image (equidistant cylindrical projection) in the recording medium <NUM>.

In S407, the system control unit <NUM> determines whether or not the display format of the display control apparatus <NUM> is a format to display a partial range of the captured VR image (zoom view format) on the basis of the format information stored in the system memory <NUM>. Processing advances to S409 if the display format is the zoom view format, or to S408 if not (if spherical image format).

In S408, the system control unit <NUM> records (generates and records) a thumbnail image in the file recorded in S406 on the basis of the captured VR image. In concrete terms, a thumbnail (e.g. image (image generated by reducing the VR image) which indicates the entire VR image that was captured (equidistant cylindrical projection), is record in the file.

In S409, the system control unit <NUM> performs 3D mapping of the captured VR image (equidistant cylindrical projection), and clips the display range from the VR image in accordance with the range information (direction of the view point and visual angle (angle of view)) stored in the system memory <NUM>. In S410, the system control unit <NUM> records (generates and records) a thumbnail image in the file recorded in S406 on the basis of the image (display range) clipped in S409. In concrete terms, the system control unit <NUM> records a thumbnail image that indicates the display range (e.g. image generated by reducing an image in the display range) in the file.

In S411, the system control unit <NUM> determines whether or not the user instructed to stop the digital camera <NUM> (performed stop operation). If the user instructed to stop the digital camera <NUM>, the system control unit <NUM> stops the digital camera <NUM> by performing various types of processing (shuts the power of the digital camera <NUM> OFF). Then the entire processing in <FIG> ends. Processing advances to S412 otherwise.

In S412, the system control unit <NUM> acquires (captures) a front image using the image-capturing unit 22a. In S413, the system control unit <NUM> acquires (captures) a rear image using the image-capturing unit 22b. In S414, using the image processing unit <NUM>, the system control unit <NUM> combines the two images acquired in S412 and S413, so as to generate a single VR image (equidistant cylindrical projection). In S415, the system control unit <NUM> transmits the VR image generated in S414 (equidistant cylindrical projection) to the display control apparatus <NUM> via the communication unit <NUM>.

<FIG> is a flow chart depicting an example of the remote live view processing performed by the display control apparatus <NUM>. This processing is implemented by the CPU <NUM> developing a program, which is recorded in the non-volatile memory <NUM>, in the memory <NUM>, and executing the program. When the power of the display control apparatus <NUM> is turned ON, and the display control apparatus <NUM> is set to the display mode to perform the remove live view display of the VR image captured by the digital camera <NUM>, the processing in <FIG> starts.

In S501, the CPU <NUM> determines whether or not the captured VR image (equidistant cylindrical projection) was received from the digital camera <NUM> (image-capturing apparatus). Processing advances to S509 if the VR image was received, or to S502 if not. In this embodiment, the VR image is received from the digital camera <NUM> via the communication I/F <NUM>.

In S502, the CPU <NUM> determines whether or not the user instructed the format change (instruction to change the display format: format change operation). Processing advances to S503 if the format change was instructed, or to S506 if not.

In S503, the CPU <NUM> determines whether or not the current display format is the spherical image format. Processing advances to S504 if the current display format is the spherical image format, or to S505 if not.

In S504, the CPU <NUM> stores the format information that indicates the zoom view format in the memory <NUM>, so as to switch the display format to the zoom view format (update of the format information stored in the memory <NUM>). Further, the CPU <NUM> transmits the format information, which indicates the zoom view format, to the digital camera <NUM> via the communication I/F <NUM>, so as to notify the digital camera <NUM> that the display format was changed to the zoom view format.

In S505, the CPU <NUM> stores the format information that indicates the spherical image format in the memory <NUM>, so as to switch the display format to the spherical image format (update of the format information stored in the memory <NUM>). Further, the CPU <NUM> transmits the format information, which indicates the spherical image format, to the digital camera <NUM> via the communication I/F <NUM>, so as to notify the digital camera <NUM> that the display format was changed to the spherical image format.

In S506, the CPU <NUM> determines whether or not the user instructed the range change (instruction to change the display range: range change operation). Processing advances to S507 if the range change was instructed, or to S501 if not. In S507, the CPU <NUM> determines whether or not the current display format is the zoom view format. Processing advances to S508 if the current display format is the zoom view format, or to S501 if not. In S508, the CPU <NUM> stores the range information on the display range after the change in the memory <NUM>, so as to update the display range (update of the range information stored in the memory <NUM>). Further, the CPU <NUM> transmits the range information that indicates the current display range to the digital camera <NUM> via the communication I/F <NUM>, so as to notify the digital camera <NUM> that the display range was changed.

In S509, the CPU <NUM> determines whether or not the current display format is the spherical image format. Processing advances to S510 if the current display format is the spherical image format, or to S511 if not.

In S510, the CPU <NUM> displays the VR image (equidistant cylindrical projection) which was received from the digital camera <NUM>, on the display <NUM>, as the remote live view image (update of the image displayed on the display <NUM>).

In S511, the CPU <NUM> reads the range information (direction of view point and visual angle (angle of view)) from the memory <NUM>. In S512, the CPU <NUM> performs 3D mapping of the VR image (equidistant cylindrical projection) received from the digital camera <NUM>, and clips the display range from the VR image in accordance with the range information which was read in S511. In S513, the CPU <NUM> displays the image in the display range, which was clipped in S512, on the display <NUM> as the remote live view image (update of the image displayed on the display <NUM>).

As described above, according to this embodiment, a thumbnail image corresponding to the range of the live view image is recorded in the file in the case where a partial range of the captured VR image is displayed on the display as the live view image. Therefore, when the captured (recorded) VR image is received on a personal computer (PC) or the like, an image in a range which the user was checking during image capturing is displayed as the thumbnail image of the file of the VR image, as illustrated in <FIG>. Thereby the impression of the thumbnail image matches with the impression of the display range of the remote live view display during image capturing, hence by merely viewing the thumbnail image, the user can easily recognize which scene of the VR image is captured in each file.

An example in the case where the captured image is the VR image was described, but a similar effect can be implemented by a similar processing even when an image other than the VR image is captured. Further, an example of performing the remote live view display was described, but a display that can execute the live view display may be disposed in the electronic apparatus (digital camera <NUM>) according to this embodiment.

Further, an example of the case where the format information and the range information are transmitted from the display control apparatus <NUM> to the digital camera <NUM> and the thumbnail image is generated on the basis of this information was described, but the embodiments of the present invention is not limited to this. For example, the digital camera <NUM> may notify the image capturing timing to the display control apparatus <NUM>, and the display control apparatus <NUM> may transmit the displayed remote live view image to the digital camera <NUM>. Then the digital camera <NUM> may record the thumbnail image on the basis of the received remote live view image. <FIG> and <FIG> are flow charts depicting examples of such processing.

<FIG> is a flow chart depicting an example of the general processing of the digital camera <NUM>. This processing is implemented by the system control unit <NUM> developing the program recorded in the non-volatile memory <NUM> in the system memory <NUM> and executing the program. When the power of the digital camera <NUM> is turned ON, the processing in <FIG> starts.

In S701, the system control unit <NUM> determines whether or not an image capturing instruction was received from the user. Processing advances to S702 if the image capturing instruction was received, or to S704 if not. In S702, the system control unit <NUM> records the file of the captured VR image (equidistant cylindrical projection) in the recording medium <NUM>. In S703, the system control unit <NUM> requests the display control apparatus <NUM> to transmit the remote live view image via the communication unit <NUM>.

In S704, the system control unit <NUM> determines whether or not the remote live view image was received from the display control apparatus <NUM>. Processing advances to S705 if the remote live view image was received, or to S706 if not. In this embodiment, the remote live view image is received from the display control apparatus <NUM> via the communication unit <NUM>. In S705, the system control unit <NUM> records (generates and records) a thumbnail image in the file recorded in S702 on the basis of the remote live view image received from the display control apparatus <NUM>. In concrete terms, a thumbnail image (e.g. image generated by reducing the remote live view image), which indicates the received remote live view image, is recorded in the file.

In S706, the system control unit <NUM> determines whether or not the user instructed to stop the digital camera <NUM>. If the user instructed to stop the digital camera <NUM>, the system control unit <NUM> stops the digital camera <NUM> by performing various types of processing. Then the entire processing in <FIG> ends. Processing advances to S707 otherwise.

In S707, the system control unit <NUM> acquires (captures) a front image using the image-capturing unit 22a. In S708, the system control unit <NUM> acquires (captures) a rear image using the image-capturing unit 22b. In S709, using the image processing unit <NUM>, the system control unit <NUM> combines the two images acquired in S707 and S708, so as to generate a single VR image (equidistant cylindrical projection). In S710, the system control unit <NUM> transmits the VR image generated in S709 (equidistant cylindrical projection) to the display control apparatus <NUM> via the communication unit <NUM>.

<FIG> is a flow chart depicting an example of the remote live view processing performed by the display control apparatus <NUM>. This processing is implemented by the CPU <NUM> developing the program, which is recorded in the non-volatile memory <NUM>, in the memory <NUM>, and executing the program. When the power of the display control apparatus <NUM> is turned ON, and the display control apparatus <NUM> is set to the display mode to perform the remote live view display of the VR image captured by the digital camera <NUM>, the processing in <FIG> starts.

In S801, the CPU <NUM> determines whether or not the captured VR image (equidistant cylindrical projection) was received from the digital camera <NUM> (image-capturing apparatus). Processing advances to S809 if the VR image was received, or to S802 if not.

In S802, the CPU <NUM> determines whether the user instructed the format change. Processing advances to S803 if the format change was instructed, or to S806 if not.

In S803, the CPU <NUM> determines whether or not the current display format is the spherical image format. Processing advances to S804 if the current display format is the spherical image format, or to S805 if not. In S804, the CPU <NUM> stores the format information that indicates the zoom view format in the memory <NUM>, so as to switch the display format to the zoom view format (update of the format information stored in the memory <NUM>). In S805, the CPU <NUM> stores the format information that indicates the spherical image format in the memory <NUM>, so as to switch the display format to the spherical image format (update of the format information stored in the memory <NUM>).

In S806, the CPU <NUM> determines whether or not the user instructed the range change. Processing advances to S807 if the range change was instructed, or to S814 if not.

In S807, the CPU <NUM> determines whether or not the current display format is the zoom view format. Processing advances to S808 if the current display format is the zoom view format, or to S801 if not. In S808, the CPU <NUM> stores the range information on the display range after the change in the memory <NUM>, so as to update the display range (update of the range information stored in the memory <NUM>).

In S809, the CPU <NUM> determines whether or not the current display format is the spherical image format. Processing advances to S810 if the current display format is the spherical image format, or to S811 if not.

In S810, the CPU <NUM> displays the VR image (equidistant cylindrical projection), which was received from the digital camera <NUM>, on the display <NUM>, as the remote live view image (update of the image displayed on the display <NUM>). Further, the CPU <NUM> stores the current remote live view image in the memory <NUM> (updates the remote live view image stored in the memory <NUM>).

In S811, the CPU <NUM> reads the range information (direction of view point and visual angle (angle of view)) from the memory <NUM>. In S812, the CPU <NUM> performs 3D mapping of the VR image (equidistant cylindrical projection) received from the digital camera <NUM>, and clips the display range from the VR image in accordance with the range information which was read in S811. In S813, the CPU <NUM> displays the image in the display range, which was clipped in S812, on the display <NUM> as the remote live view image (update of the image displayed on the display <NUM>). Further, the CPU <NUM> stores the current remote live view image in the memory <NUM> (update of the remote live view image stored in the memory <NUM>).

In S814, the CPU <NUM> determines whether or not the digital camera <NUM> requested transmission of the remote live view image via the communication I/F <NUM>. Processing advances to S815 if transmission was requested, or to S801 if not. In S815, the CPU <NUM> reads the remote live view image from the memory, and transmits the remote live view image to the digital camera <NUM> via the communication I/F <NUM>.

The system control unit <NUM> may start recording of the file of the captured (acquired) moving image responding to the recording start instruction (image capturing instruction) from the user, and stop recording of the file responding to the recording stop instruction from the user. In this case, the system control unit <NUM> records a thumbnail image, corresponding to the range of the live view image of which file is being recorded, in the file. Since the live view image of which file is being recorded more likely remains as an impression of the user, the user can easily recognize which scene of the moving image is captured in each file by merely viewing the thumbnail image. In particular, the live view image, at a timing when the recording start instruction or the recording stop instruction is received, more likely remains as an impression of the user, therefore it is preferable that a thumbnail image corresponding to the range of the live view image at such a timing is recorded in the file.

An example of recording a thumbnail image based on the remote live view image in the file was described, but the range information on the range of the remote live view image may be recorded in the file as initial reproduction information on the range that is displayed first when the file is reproduced. Then the impression of the display range when reproduction is started matches with the impression of the display range of the remote live view display during the image capturing, and the user can easily recognize which scene of the VR image is captured in the reproduced file. <FIG> and <FIG> are flow charts depicting examples of such processing.

In S901, the system control unit <NUM> determines whether or not a change in the display format of the display control apparatus <NUM> was notified. Processing advances to S902 if notified, or to S903 if not. In S902, the system control unit <NUM> stores the format information, which indicates the notified display format (display format after the change; current display format) to the system memory <NUM> (update of the format information stored in the system memory <NUM>).

In S903, the system control unit <NUM> determines whether or not the change in the display range of the display control apparatus <NUM> was notified. Processing advances to S904 if notified, or to S905 if not. In S904, the system control unit <NUM> stores the range information (direction of the view point and visual angle (angle of view)) on the notified display range (display range after the change; current display range) in the system memory <NUM> (update of the range information stored in the system memory <NUM>).

In S905, the system control unit <NUM> determines whether or not the image capturing instruction was received from the user. Processing advances to S906 if the image capturing instruction was received, or to S910 if not. In S906, the system control unit <NUM> records the file of the captured VR image (equidistant cylindrical projection) in the recording medium <NUM>.

In S907, the system control unit <NUM> determines whether or not the display format of the display control apparatus <NUM> is the zoom view format on the basis of the format information stored in the system memory <NUM>. Processing advances to S909 if the display format is the zoom view format, or to S908 if not. In S908, the system control unit <NUM> records the initial reproduction information (direction of the view point and visual angle (angle of view)) on the image capturing range in a predetermined direction (e.g. front direction) of the digital camera <NUM>, out of the captured VR image, in the file recorded in S906. In S909, the system control unit <NUM> records the range information (direction of the view point and visual angle (angle of view)) stored in the system memory <NUM> in the file recorded in S906 as the initial reproduction information.

In S910, the system control unit <NUM> determines whether the user instructed to stop the digital camera <NUM>. If the user instructed to stop the digital camera <NUM>, the system control unit <NUM> stops the digital camera <NUM> by performing various types of processing. Then the entire processing in <FIG> ends. Processing advances to S911 otherwise.

In S911, the system control unit <NUM> acquires (captures) a front image using the image-capturing unit 22a. In S912, the system control unit <NUM> acquires (captures) a rear image using the image-capturing unit 22b. In S913, using the image processing unit <NUM>, the system control unit <NUM> combines the two images acquired in S911 and S912, so as to generate a single VR image (equidistant cylindrical projection). In S914, the system control unit <NUM> transmits the VR image generated in S913 (equidistant cylindrical projection) to the display control apparatus <NUM> via the communication unit <NUM>.

<FIG> is a flow chart depicting an example of the reproduction processing (processing to reproduce a file) performed by the display control apparatus <NUM>. This processing is implemented by the CPU <NUM> developing the program which is recorded in the non-volatile memory <NUM>, in the memory <NUM> and executing the program. When the power of the display control apparatus <NUM> is turned ON, and the user instructs to reproduce a file stored in the recording medium <NUM>, the processing in <FIG> starts.

In S1001, the CPU <NUM> acquires the initial reproduction information (direction of the view point and visual angle (angle of view)) from the reproduction target file. In S1002, the CPU <NUM> displays a display range in accordance with the initial reproduction information acquired in S1001, out of the VR image recorded in the reproduction target file, on the display <NUM>. If the display format when the image was captured is the spherical image format, the VR image is displayed in the spherical image format. If the display format when the image was captured is the zoom view format, a partial range of the VR image is clipped and displayed so that the display range, which was displayed in the remote live view display when the image was captured, is displayed.

The various controls, which were assumed to be performed by the system control unit <NUM> and the CPU <NUM> in the above description, may be performed by one hardware component, or shared by a plurality of hardware components (e.g. a plurality of processors or circuits) so as to control the entire apparatus. In the same manner, various controls, which were assumed to be performed by the CPU <NUM> in the above description, may be performed by one hardware component, or shared by a plurality of hardware components (e.g. a plurality of processors or circuits), so as to control the entire apparatus.

While the present invention has been described with reference to the preferred embodiments, the embodiments of the present invention is not limited to these specific embodiments, and includes various modes within the scope of not departing from the essence of the invention. Each of the above-mentioned embodiments is merely an example of the invention, and may be combined as required.

In the example described in the above embodiments, the present invention is applied to a digital camera, but the embodiments of the present invention is not limited to this example, and may be applied to any electronic apparatus that can record the files of captured images. For example, the present invention can be applied to a personal computer, a PDA, a portable telephone terminal, a portable image viewer, a printer, a digital photo frame, a music player, a game machine, an electronic book reader and a video player. The present invention can also be applied to a smartphone, a television, a projector, a tablet terminal, an AI speaker, a home electronic device, an onboard unit and a medical apparatus.

According to this disclosure, the user can easily recognize which scene of the image file is captured in a file.

Claim 1:
A system comprising an electronic apparatus (<NUM>) having a camera and an external apparatus (<NUM>) having a display (<NUM>),
the electronic apparatus (<NUM>) comprising:
a first acquisition means configured to acquire a captured image from the camera;
characterized by
a control means (<NUM>) configured to perform control, so that a file of the image acquired by the first acquisition means is recorded in a storage, in response to an image capturing instruction from a user, wherein
in a case where a partial range of the captured image is displayed on the display (<NUM>) as a live view image at the time of recording the file of the acquired image, the control means (<NUM>) further performs control so that a thumbnail image corresponding to the partial range of the captured image, which is displayed as the live view image, is recorded in association with the file,
a second acquisition means configured to acquire the live view image from the external apparatus (<NUM>) having the display (<NUM>),
wherein the control means (<NUM>) is configured to perform control so that the thumbnail image is recorded based on the live view image.