Electronic apparatus, method of controlling the same, and storage medium

An electronic apparatus includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic apparatus to perform control to display an image in a display unit based on a third image including a first image captured through a first optical system, and a second image having a parallax with respect to the first image, captured through a second optical system, receive an enlargement instruction for enlarging a part of the image displayed in the display unit, and perform control, upon reception of the enlargement instruction while the third image is displayed, to display in the display unit an enlarged image including an enlarged portion of either one of the first image and the second image.

BACKGROUND

Field of the Disclosure

The present disclosure relates to an electronic apparatus, a method of controlling the same, and a recording medium.

Description of the Related Art

There is known a technique of acquiring wide viewing angle images with a parallax through two different optical systems, and then mapping the images on a virtual sphere to display a Virtual Reality (VR) image with a stereoscopic effect. A dual lens VR camera for capturing images with a parallax includes two different optical systems oriented in the same direction to capture two different images with a parallax in a single image capturing. In a certain dual lens VR camera, each optical system captures images in a wide range of 180 degrees or more in the vertical and horizontal directions (i.e., a hemisphere, 90 degrees or more in all directions from the image center). Known VR image display methods include “monocular VR display” for displaying one image through deformation by mapping an VR image on the virtual sphere, and “dual side-by-side VR display” for displaying a right-eye VR image and a left-eye VR image side by side in the right and left regions, respectively.

WO 11/121840 discloses a stereoscopic imaging apparatus that captures an identical subject from the right and left view points using two different imaging units arranged side by side with a parallax, to acquire a right-eye image and a left-eye image, respectively.

SUMMARY

The present disclosure is directed to providing image display suitable for enlarging an image including a right-eye image and a left-eye image arranged side by side and checking details of the image.

According to an aspect of the present disclosure, an electronic apparatus includes a processor, and a memory storing a program which, when executed by the processor, causes the electronic apparatus to perform control to display an image in a display unit based on a third image including a first image captured through a first optical system, and a second image having a parallax with respect to the first image, captured through a second optical system, receive an enlargement instruction for enlarging a part of the image displayed in the display unit, and perform control, upon reception of the enlargement instruction while the third image is displayed, to display in the display unit an enlarged image including an enlarged portion of either one of the first image and the second image.

DESCRIPTION OF THE EMBODIMENTS

Some exemplary embodiments of the present disclosure will be described below with reference to the accompanying drawings. The present exemplary embodiment will be described below centering on examples of a digital camera (imaging apparatus) as an electronic apparatus.

FIGS.1A and1Bare illustrate examples of outer appearances of a digital camera100(hereinafter simply referred to as a camera).FIG.1Ais a perspective view illustrating the camera100in sight of the front face, andFIG.1Bis a perspective view illustrating the camera100in sight of the rear face. The camera100includes a shutter button101, a power switch102, a mode selection switch103, a main electronic dial104, a sub electronic dial105, a moving image button106, and an out-finder display unit107on the top face. The shutter button101is an operation member to perform an image capturing preparation or issue an image capturing instruction. The power switch102is an operation member to turn power of the camera100ON or OFF. The mode selection switch103is an operation member to select various modes. The main electronic dial104is a rotary operation member to change setting values of the shutter speed, diaphragm, and other properties. The sub electronic dial105is a rotary operation member to move a selection frame (cursor) and feeding images. The moving image button106is an operation member to issue instructions for starting and stopping moving image capturing (recording). The out-finder display unit107displays various setting values of the shutter speed, diaphragm, and other properties.

The camera100includes a display unit108, a touch panel109, a cross key110, a SET button111, an automatic exposure (AE) lock button112, an enlargement button113, a reproduction button114, a menu button115, an eyepiece portion116, an eye contact detection unit118, and a touch bar119on the rear face. The display unit108displays images and various pieces of information. The touch panel109is an operation member to detect touch operations on the display surface (touch operation surface) of the display unit108. The cross key110is an operation member including up, down, right, and left keys (four-way key). The cross key110allows operation at its pressed position. The SET button111is an operation member to be pressed mainly to determine a selection item. The AE lock button112is an operation member to be pressed to fix an exposure state in the image capturing standby state. The enlargement button113is an operation member to turn the enlargement mode ON or OFF in the live view display (LV display) in the image capturing mode. With the enlargement mode ON, operating the main electronic dial104enlarges or reduces the live view image (LV image). The enlargement button113is used to enlarge reproduced images or increase magnification rate in the reproduction mode. The reproduction button114is an operation member to switch between the image capturing mode and the reproduction mode. Pressing the reproduction button114in the image capturing mode shifts the camera100to the reproduction mode, making it possible to display the latest one of the images recorded in a recording medium227(described below), in the display unit108.

The menu button115is an operation member to be pressed to display a menu screen for making various settings in the display unit108. The user is able to intuitively make various settings on the menu screen displayed in the display unit108with the cross key110and the SET button111. The eyepiece portion116is provided with an eye contact finder (look-in finder)117to be brought to the user's eye. The eyepiece portion116allows the user to visually recognize an image displayed in an internal Electronic View Finder (EVF)217(described below). The eye contact detection unit118is a sensor to detect whether the user's eye is close to the eyepiece portion116.

The touch bar119is a line-shaped touch operation member (line touch sensor) to accept touch operations. The touch bar119is disposed at a (touchable) position where touch operations can be performed with the thumb of the right hand while holding the grip portion120with the right hand (the little finger, the third finger, and the middle finger of the right hand) so that the shutter button101can be pressed with the forefinger of the right hand.

More specifically, the touch bar119can be operated with the user's eye close to the eyepiece portion116to look in the eye contact finder117in a state in which the user is poised to press the shutter button101at any time (photographing attitude). The touch bar119accepts tap operations (touching the touch bar119and then detaching the finger without moving it within a predetermined time period) and right/left slide operations (touching the touch bar119and then move the touch position while in contact with the touch bar119). The touch bar119is an operation member different from the touch panel109and is not provided with a display function. The touch bar119according to the present exemplary embodiment is a multifunction bar, and functions, for example, as an M-Fn bar.

The camera100also includes the grip portion120, a thumb rest portion121, terminal covers122, a lid123, and a communication terminal124. The grip portion120has a shape that is easy to grip with the right hand when the user holds the camera100. The shutter button101and the main electronic dial104are disposed at positions where these operation members can be operated by the forefinger of the right hand while holding the camera100by gripping the grip portion120with the little finger, the third finger, and the middle finger of the right hand. The sub electronic dial105and the touch bar119are disposed at positions where these operation members can be operated by the thumb of the right hand in a similar state. The thumb rest portion121(thumb standby position) is a grip portion provided at a position on the rear face of the camera100, where the thumb of the right hand holding the grip portion120is easy to rest in a state where no operation member is operated. The thumb rest portion121is made of a rubber material to improve the holding force (grip feeling). The terminal covers122protect connectors such as connection cables for connecting the camera100with external apparatuses. The lid123closes the slot for storing the recording medium227(described below) to protect the recording medium227and the slot. The communication terminal124enables the camera100to communicate with a lens unit200(described below), which is attachable to and detachable from the camera100.

FIG.2illustrates an internal configuration example of the camera100. Referring toFIGS.1A and1B, like numbers refer to like components inFIG.2, and redundant descriptions thereof will be omitted as appropriate. The lens unit200or a lens unit300(described below) is attached to the camera100. Firstly, a camera system including the camera100and, as an example, the lens unit200as a conventional single-lens unit will be described.

The lens unit200is a type of interchangeable lens attachable to and detachable from the camera100. The lens unit200as a single-lens unit is an example of a regular lens. Unlike the lens unit300(described below), the lens unit200includes a single optical system.

The lens unit200includes a diaphragm201, a lens202, a diaphragm drive circuit203, an automatic focus (AF) drive circuit204, a lens system control circuit205, and a communication terminal206. The diaphragm201has an adjustable aperture diameter. The lens202includes a plurality of lenses. The diaphragm drive circuit203controls the aperture diameter of the diaphragm201to adjust the quantity of light. The AF drive circuit204drives the lens202to adjust the focus. The lens system control circuit205controls the diaphragm drive circuit203and the AF drive circuit204based on instructions from a system control unit50(described below). The lens system control circuit205controls the diaphragm201via the diaphragm drive circuit203to shift the position of the lens202via the AF drive circuit204to adjust the focus. The lens system control circuit205communicates with the camera100. More specifically, the lens system control circuit205communicates with the camera100via the communication terminal206of the lens unit200and the communication terminal124of the camera100. The communication terminal206is used by the lens unit200to communicate with the camera100.

The camera100will be described. The camera100includes a shutter210, an imaging unit211, an analog-to-digital (A/D) converter212, a memory controller213, an image processing unit214, a memory215, a digital-to-analog (D/A) converter216, the EVF217, the display unit108, and the system control unit50.

The shutter210is a focal-plane shutter to control the exposure time of the imaging unit211based on instructions from the system control unit50. The imaging unit211is an image sensor that is a Charge Coupled Device (CCD) sensor or a complementary Metal Oxide Semiconductor (CMOS) sensor to convert an optical image into an electrical signal. The imaging unit211may include an imaging plane phase-difference sensor to output defocus amount information to the system control unit50. The A/D converter212converts the analog signal output from the imaging unit211into a digital signal.

The image processing unit214performs predetermined processing (pixel interpolation, resize processing including reduction, and color conversion processing) on data from the A/D converter212or from the memory controller213.

The image processing unit214also performs predetermined calculation processing on captured image data. The system control unit50performs exposure control and distance measurement control based on obtained calculation results. This processing enables AF processing, Automatic Exposure (AE) processing, and Electronic Flash Preliminary Emission (EF) processing based on the Through-The-Lens (TTL) method. The image processing unit214also performs predetermined calculation processing on the captured image data and performs TTL-based Automatic White Balance (AWB) processing based on obtained calculation results.

Image data from the A/D converter212is stored in the memory215via the image processing unit214and the memory controller213. Otherwise, image data from the A/D converter212is stored in the memory215via the memory controller213without being processed by the image processing unit214. The memory215stores image data captured by the imaging unit211and then converted into digital data by the A/D converter212, and stores image data to be displayed in the display unit108and the EVF2179. The memory215has a sufficient storage capacity to store a predetermined number of still images, and moving images and sound for a predetermined time period. The memory215also serves as an image display memory (video memory).

The D/A converter216converts image display data stored in the memory215into an analog signal and then supplies the signal to the display unit108and the EVF217. Thus, the image display data stored in the memory215is displayed in the display unit108and EVF217via the D/A converter216. The display unit108and the EVF217display data corresponding to the analog signal from the D/A converter216. The display unit108and the EVF217are, for example, a Liquid crystal Display (LCD) and an organic electroluminescence (EL) display. The digital signal, generated in the A/D conversion by the A/D converter212and stored in the memory215, is then converted into an analog signal by the D/A converter216. The analog signal is successively transferred to the display unit108or the EVF217and displayed thereon, thus enabling the LV display.

The system control unit50includes at least one processor and/or at least one circuit. More specifically, the system control unit50may be a processor, a circuit, or a combination of both. The system control unit50generally controls the camera100. The system control unit50runs programs recorded in a nonvolatile memory219to carry out each piece of processing of flowcharts (described below). The system control unit50also controls the memory215, the D/A converter216, the display unit108, and the EVF217to perform display control. The system control unit50also functions as a reception unit to receive instructions input through operations on the above-described various operation members. The system control unit50performs controls corresponding received instructions.

The camera100includes a system memory218, the nonvolatile memory219, a system timer220, a communication unit221, an orientation detection unit222, and an eye contact detection unit118. The system memory218is, for example, a random access memory (RAM). Constants and variables used for operations of the system control unit50and programs read from the nonvolatile memory219are loaded into the system memory218. The nonvolatile memory219is an electrically erasable recordable memory such as an electrically erasable programmable read only memory (EEPROM). Constants and programs used for operations of the system control unit50are recorded in the nonvolatile memory219. The above-described programs refer to programs for carrying out the processing in flowcharts (described below). The system timer220is a time measurement unit to measure time used in various control and time of the built-in clock.

The communication unit221transmits and receives video and audio signals to/from an external apparatus wirelessly connected or connected with a wire cable thereto. The communication unit221is connectable with a wireless Local Area Network (LAN) and the Internet. The communication unit221is also communicable with an external apparatus through Bluetooth® and Bluetooth Low Energy. The communication unit221can transmit images (including the live image) captured by the imaging unit211and images recorded in the recording medium227, and receive image data and other various information from an external apparatus.

The orientation detection unit222detects the orientation of the camera100with respect to the gravity direction. Based on the orientation detected by the orientation detection unit222, the system control unit50determines whether the image captured by the imaging unit211is an image captured with the camera100horizontally held or an image captured with the camera100vertically held. The system control unit50can add direction information corresponding to the orientation detected by the orientation detection unit222to the image file of the image captured by the imaging unit211, or rotate the image before recording. An acceleration sensor or gyroscope sensor can be used as the orientation detection unit222. Motions of the camera100(pan, tilt, raising, and stand still) can also be detected by using the orientation detection unit222.

The eye contact detection unit118can detect the approach of some object to the eyepiece portion116of the eye contact finder117incorporating the EVF217. An infrared proximity sensor can be used as the eye contact detection unit118. When an object comes closer, the infrared light projected from the light projecting portion of the eye contact detection unit118is reflected by the object and then received by the light receiving portion of the infrared light proximity sensor. The distance between the eyepiece portion116and the object can be determined based on the quantity of the received infrared light. In this way, the eye contact detection unit118performs eye contact detection to detect the proximity distance of the object to the eyepiece portion116.

The eye contact detection unit118is an eye contact detection sensor to detect the approach (eye-on state) and the separation (eye-off state) of the eye (object) to and from the eyepiece portion116of the eye contact finder117. When an object coming closer to the eyepiece portion116is detected at a predetermined distance or shorter in the eye-off state (non-approaching state), the eye contact detection unit118detects the eye-on state. When an object in the eye-on state (approaching state) is detached and separated from the eyepiece portion116by a predetermined distance or longer, the eye contact detection unit57detects the eye-oft state. The threshold value for detecting the eye-on state and the threshold value for detecting the eye-off state may be different, for example, when a hysteresis is provided. Once the eye-on state is detected, the eye-on state continues until the eye-off state is detected. Once the eye-off state is detected, the eye-off state continues until the eye-on state is detected. The system control unit50turns display of the display unit108and the EVF217ON (display state) or OFF (undisplay state) depending on the state detected by the eye contact detection unit118. More specifically, at least when the camera100is in the image capturing standby state and when an automatic changeover is set for the display destination of the live view image, the following display control is performed. In the eye-off state, the display unit108is set as the display destination, i.e., the display of the display unit108is turned ON and the display of the EVF217is turned OFF. In the eye-on state, on the other hand, the EVF217is set as the display destination, i.e., the display of the EVF217is turned ON and the display of the display unit108is turned OFF. The eye contact detection unit118is not limited to an infrared proximity sensor but may be another sensor as long as the sensor is capable of detecting the eye-on state.

The camera100also includes the out-finder display unit107, an out-finder display drive circuit223, a power source control unit224, a power source unit225, a recording medium interface (I/F)226, and an operation unit228.

The out-finder display unit107displays various setting values to the camera100, such as the shutter speed and diaphragm, via the out-finder display drive circuit223.

The power source control unit224includes a battery detection circuit, a direct-current to direct-current (DC-DC) converter, and a switch circuit to select a block to be supplied with power. The power source control unit224detects the attachment or detachment of a battery, the battery type, and the remaining battery capacity. The power source control unit224also controls the DC-DC converter based on detection results and instructions from the system control unit50to supply appropriate voltages to the recording medium227and other components for appropriate time periods.

The power source unit225includes a primary battery (such as an alkaline battery and a lithium battery), a secondary battery (such as a NiCd battery, a NiMH battery, and a Li battery), and an alternating current (AC) adapter. The recording medium I/F226is an interface to the recording medium227such as a memory card and a hard disk. The recording medium227is, for example, a memory card to record captured images, and includes a semiconductor memory and a magnetic disk. The recording medium227may be attachable to and detachable from or built in the camera100.

The operation unit228is an input unit to accept operations from the user (user operations) and is used to input various instructions to the system control unit50. The operation unit228includes the shutter button101, the power switch102, the mode selection switch103, the touch panel109, and other operation members229. Other operation members229include the main electronic dial104, the sub electronic dial105, the moving image button106, the cross key110, the SET button111, the AE lock button112, the enlargement button113, the reproduction button114, the menu button115, and the touch bar119.

The shutter button101includes a first shutter switch230and a second shutter switch231. The first shutter switch230turns ON in the middle of the operation on the shutter button101, what is called a half depression (image capturing preparation instruction), to generate a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the system control unit50starts image capturing preparation processing such as the AF processing, AE processing, AWB processing, and EF processing. The second shutter switch231turns ON upon completion of the operation on the shutter button101, what is called a full depression (image capturing instruction), to generate a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit50starts a series of image capturing processing including reading the signal from the imaging unit211, generating an image file containing a captured image, and storing the image file in the recording medium227.

The mode selection switch103changes the operation mode of the system control unit50to either the still image capturing mode, the moving image capturing mode, or the reproduction mode. The still image capturing mode includes the automatic image capturing mode, automatic scene determination mode, manual mode, diaphragm priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). The still image capturing mode also includes various scene modes providing imaging settings for various captured scenes, and includes a custom mode. The mode selection switch103enables the user to directly select any one of these image capturing modes. Otherwise, the mode selection switch103enables the user to once select an image capturing mode list screen and then select any one of a plurality of displayed modes using the operation unit228. Likewise, the moving image capturing mode may also include a plurality of modes.

The touch panel109is a touch sensor to detect various touch operations on the display surface of display unit108(operation surface of the touch panel109). The touch panel109and the display unit108can be integrally formed. For example, the touch panel109is attached to the upper layer of the display surface of the display unit108so that the transmissivity of light does not disturb the display of the display unit108. Then, the input coordinates on the touch panel109are associated with the display coordinates on the display surface of the display unit108. This provides a graphical user interface (GUI) that virtually allows the user to directly operate the screen displayed in the display unit108. The touch panel109may be one among various types including the resistance film type, capacitance type, surface elastic wave type, infrared type, electromagnetic induction type, image recognition type, and optical sensor type.

A touch is detected when a finger or pen comes into contact with the touch panel109or when a finger or pen comes close to the touch panel109depending on the type, and either type is applicable.

The system control unit50can detect the following operations on and states of the touch panel109: * An operation to start touching the touch panel109with a finger or pen that had been out of contact with the touch panel109(hereinafter referred to as a “touch-down”). * A state where the finger or pen is in contact with the touch panel109(hereinafter referred to as a “touch-on”). * An operation to move the finger or pen while in contact with the touch panel109(hereinafter referred to as a “touch-move”). * An operation to detach (release) the finger or pen that had been in contact with the touch panel109from the touch panel109to end touching (hereinafter referred to as a “touch-up”). * A state where the finger or pen is out of contact with the touch panel109(hereinafter referred to as a “touch-off”).

When a touch-down is detected, a touch-on is also detected at the same time. After detecting a touch-down, a touch-on is normally kept being detected until a touch-up is detected. In a state where a touch-move is detected, a touch-on is also detected at the same time. Even when a touch-on is detected, a touch-move is not detected if the touch position is not moving. After a touch-up of all of the fingers or the pen that had been in contact with the touch panel109is detected, a touch-off is detected.

The above-described operations and states as well as the position coordinates of the position where the finger or pen contacts the touch panel109are notified to the system control unit50via an internal bus. Based on the notified information, the system control unit50determines what kind of operation (touch operation) has been performed on the touch panel109. For a touch-move, the moving direction of the finger or pen moving on the touch panel109can be determined for the individual vertical and horizontal components on the touch panel109based on changes in the position coordinates. If a touch-move over a predetermined distance or longer is detected, the system control unit50determines that a slide operation has been performed. An operation of quickly moving a finger over a certain distance while in contact with the touch panel109and then release the finger therefrom is referred to as a flick. In other words, a flick is an operation of flicking on the surface of the touch panel109with a finger. If a touch-move at a predetermined speed or higher over a predetermined distance or longer is detected and then a touch-up is subsequently detected, a flick is determined to have been performed (a flick is determined to have been performed following a slide). A touch operation of simultaneously touching a plurality of positions, for example, two positions (multi-touch) and bringing these positions close to each other is referred to as a “pinch-in”. A touch operation of moving these positions away from each other is referred to as a “pinch-out”. A pinch-out and a pinch-in are collectively referred to as a pinch operation (or simply referred to as a “pinch”).

FIG.3is a schematic view illustrating an example configuration of the lens unit300.FIG.3illustrates the camera100with the lens unit300attached thereto. Referring to the camera100illustrated inFIG.3, like numbers refer to like components illustrated inFIG.2, and redundant descriptions thereof will be omitted.

The lens unit300is a type of interchangeable lens attachable to and detachable from the camera100. The lens unit300is a dual-lens unit to acquire an optical image in which the right and left images have a parallax. The lens unit300includes two different optical systems. Each optical system having a wide viewing angle of approximately 180 degrees acquires an optical image in the range of the front hemisphere. More specifically, each of the two optical systems of the lens unit300acquires images of subjects in viewing angles (field angle) of 180 degrees in the horizontal direction (horizontal angle, azimuth angle, and angle of yaw) and 180 degrees in the vertical direction (vertical angle, elevation angle, and angle of pitch). The lens unit300includes a right-eye optical system301R including a plurality of lenses and reflection mirrors, a left-eye optical system301L including a plurality of lenses and reflection mirrors, and a lens system control circuit303. The right-eye optical system301R corresponds to an example of a first optical system, and the left-eye optical system301L corresponds to an example of a second optical system. The right-eye optical system301R and the left-eye optical system301L include lenses302R and302L, respectively, disposed nearer a subject than the camera100and oriented in the same direction. The optical axes of the lenses302R and302L are approximately in parallel. Each optical system includes what is called a fisheye lens, and a circular optical image is formed on the imaging unit211(sensor).

The lens unit300according to the present exemplary embodiment is a Virtual Reality (VR) 180 lens unit to capture images for what is called VR180, a VR image format that enables stereoscopic vision. The VR180 lens unit includes a fisheye lens in which both the right-eye optical system301R and the left-eye optical system301L capture images in a range of approximately 180 degrees. While the right-eye optical system301R and the left-eye optical system301L in the VR180 lens unit acquire an image that enables dual side-by-side VR image display in VR180 according to the present exemplary embodiment, the VR180 lens unit may be capable of capturing a wide viewing angle range of about 160 degrees smaller than the range of 180 degrees. The VR180 lens unit enables forming a right image (first image) formed through the right-eye optical system301R and a left image (second image) formed through the left-eye optical system301L with a parallax to the right image, on one or two different image sensors of the camera to which the VR180 lens unit is attached.

The lens unit300is attached to the camera100with a lens mount unit304of the lens unit300connected with a camera mount unit305of the camera100. With the lens unit300attached to the camera100, the system control unit50of the camera100and the lens system control circuit303of the lens unit300are electrically connected with each other via the communication terminals124and306.

According to the present exemplary embodiment, the right image formed through the right-eye optical system301R and the left image formed through the left-eye optical system301L with a parallax to the right image are formed side by side on the imaging unit211of the camera100. More specifically, the two optical images formed by the right-eye optical system301R and the left-eye optical system301L are formed on one image sensor. The imaging unit211converts the formed subject image (optical signal) into an analog electrical signal. The use of the lens unit300enables acquiring one piece of image data in which two different images (right and left images) with a parallax acquired through two different optical systems (the right-eye optical system301R and the left-eye optical system301L) are arranged side by side. The image acquired in this way is referred to as a dual side-by-side image (dual side-by-side image data). The dual side-by-side image is a pair of the right-side image corresponding to the right image and the left-side image corresponding to the left image arranged side by side. The right-side image is also referred to as a tight-eye image, and the left-side image is also referred to as a left-eye image.

FIG.5Ais a schematic view illustrating a display example of the dual side-by-side image data captured through the lens unit300being displayed in live view. A live view image (dual side-by-side image)500includes a live view image (right-side image)501R corresponding to the right image captured through the right-eye optical system301R, and live view image (left-side image)501L corresponding to the left image captured through the left-eye optical system301L. The live view images501R and501L, each are circularly shaped, and the degree of distortion (compression) increases closer to the outer edge of the circle. According to the present exemplary embodiment, the right-side image corresponding to the right image is arranged in the right-hand side region in the dual side-by-side image, and the left-side image corresponding to the left image is arranged in the left-hand side region in the dual side-by-side image. In the dual side-by-side image, the right-side image corresponding to the right image may be arranged on the left-hand side, and the left-side image corresponding to the left image may be arranged on the right-hand side.

The VR display using the right-eye image (right image) and the left-eye image (left image) in the acquired image allows the user to view a stereoscopic VR image in the range of about 180 degrees, what is called VR180.

A VR image refers to an image in VR display (described below). VR images include an omnidirectional image (entire celestial sphere image) captured by an omnidirectional camera (entire celestial sphere camera), and a panoramic image with a video range (effective video range) wider than the display range that can be displayed at one time in the display unit108. VR images also include still images, moving images, and live images (image acquired from the camera almost in real time). A VR image has a video range (effective video range) in viewing angles of up to 360 degrees in the horizontal direction and up to 360 degrees in the vertical direction. VR images also include an image with a field angle wider than the field angle that can be captured by an ordinary camera even in viewing angles of less than 360 degrees in the horizontal direction and less than 360 degrees in the vertical direction, or with a video range wider than the display range that can be displayed at one time in the display unit108. An image captured by the camera100by using the lens unit300(described above) is a type of a VR image. VR images can be displayed, for example, by setting the display mode of the display apparatus (capable of displaying a VR image) to the “VR view”. When the user displays an VR image with a field angle of 360 degrees in the VR display and changes the orientation of the display apparatus in the horizontal direction (horizontal rotational direction), the user can view a horizontally seamless omnidirectional image.

The VR display (VR view) refers to a display method (display mode) that enables changing the display range. This display method displays an image in the visual field range corresponding to the orientation of the display apparatus out of the VR image. The VR display includes “monocular VR display” (monocular VR view) that performs deformation by mapping a VR image to a virtual sphere (deformation subjected to distortion correction) to display one image. The VR display also includes “dual side-by-side VR display” (dual side-by-side VR view) that performs deformation by mapping both a right-eye VR image and a left-eye VR image on the virtual sphere to display two images in the right- and left-hand side regions, respectively. Performing “dual side-by-side VR display” with the right-eye VR image and the left-eye VR image with a parallax allows stereoscopic vision. In either VR display, for example, with the user wearing a display apparatus such as a Head Mount Display (HMD), an image in the visual field range corresponding to the orientation of the user's face is displayed. For example, assume that, at a certain timing, a VR image displays an image in the visual field range centering on 0 degrees in the horizontal direction (specific direction, e.g., north) and 90 degrees in the vertical direction (90 degrees from the zenith, i.e., horizontal direction). If the orientation of the display apparatus is reversed (for example, the orientation of the display surface is changed from the south to the north) in this state, the display range is changed to an image in the visual field range centering on 180 degrees in the horizontal direction (opposite direction, e.g., the south) and 90 degrees in the vertical direction, out of the same VR image. More specifically, when the user wearing an HMD moves the face from the north to the south (i.e., the user turns to the back), the image displayed on the HMD is also changed from the north image to the south image. A VR image captured with the lens unit300according to the present exemplary embodiment is a VR180 image as a result of capturing the image in the range of about 180 degrees in the anterior direction and does not include the image in the range of about 180 degrees in the posterior direction. When such a VR180 image is displayed and the orientation of the display apparatus is changed to the side where no image exists, a blank region is displayed.

Displaying a VR image in the VR display in this way enables the user to feel as if he or she were visually in the VR image (in the VR space). The method of displaying VR images is not limited to the method of changing the orientation of the display apparatus. For example, the display range may be moved (scrolled) according to a user operation through the touch panel109or a direction button. In the VR display (in the “VR view” display mode), the display range may be changed according to the orientation change and in response to a touch-move on the touch panel109, a drag operation with the mouse, or the depression of the direction button. A smart phone attached to VR goggles (head mount adapter) is a type of an HMD.

In the camera100with the above-described configuration, an image captured through the lens unit300includes images captured through the right-eye and the left-eye optical systems and arranged side by side. The user may enlarge a part of the image to check details of the live view image or a recorded image on the camera100. When enlarging the image to check a dual side-by-side image portion, it is suitable to display the part of the right or the left image. If both the right and left images are included in the enlarged image, it is hard for the user to intuitively recognize which portion of the original image corresponding to the enlarged image.

However, when enlarging the image, uniquely setting the center position of the image enlargement target range to the center position of the entire image will enlarge the boundary portion including both the image from the right-eye optical system (right image) and the image from the left-eye optical system (left image). In this case, the left end portion of the image from the right-eye optical system is arranged on the right-hand side of the enlarged image, and the right end portion of the image from the left-eye optical system is arranged on the left-hand side of the enlarged image. This makes it hard for the user to check the enlarged image.

The present exemplary embodiment will be described below centering on processing of the camera100with reference to the flowchart inFIGS.4A and4B. The processing includes live view enlargement processing suitable for image capturing with a dual-lens unit such as the lens unit300.

FIGS.4A and4Bare a flowchart illustrating an example of processing of the camera100. The processing in the flowchart inFIGS.4A and4Bare carried out when the system control unit50loads programs recorded in the nonvolatile memory219into the system memory218and then runs the programs. The flowchart inFIGS.4A and4Bis started when the camera100is set to the still image capturing mode or the moving image capturing mode.

In step S401, the system control unit50acquires information about the type of the attached lens unit and then determines whether the lens unit is a dual-lens unit. In this case, the system control unit50determines whether the attached lens unit is a VR180 lens unit. The system control unit50communicates with the attached lens unit via the communication terminal124to acquire information about the type of the lens unit from the lens unit. If the attached lens unit is a dual-lens unit (VR180 lens unit) (YES in step S401), the processing proceeds to step S402. On the other hand, if no lens unit is attached or the attached lens unit is a regular lens unit such as single-lens unit (NO in step S401), the processing proceeds to step S421. More specifically, if the lens unit attached to the camera100is the lens unit200as a conventional single-lens unit, the processing proceeds to step S421. On the other hand, if the lens unit attached to the camera100is the lens unit300as a dual-lens unit, the processing proceeds to step S402.

In step S402, the system control unit50determines whether the display mode setting at the time of the live view display is the dual side-by-side image display mode. Either the dual side-by-side image display mode, the left-image enlarged display mode, or the right-image enlarged display mode can be preset as the display mode at the time of the live view display of the dual side-by-side image. The display mode can be set by the user operating the menu screen. Information about the set display mode is prestored in the nonvolatile memory219. In step S402, the system control unit50determines whether information about the dual side-by-side image display mode is stored in a control variable stored in the nonvolatile memory219. If the dual side-by-side image display mode is set (YES in step S402), the processing proceeds to step S403. Otherwise (NO in step S402), the processing proceeds to step S406.

FIG.5Aillustrates an example of a live view image500at the time of the live view display in the dual side-by-side image display mode. The live view image500includes the image (right image)501R captured through the right-eye optical system301R and the image (left image)501L captured through the left-eye optical system301L. The images501R and501L each are circularly shaped, and the degree of distortion increases closer to the outer edge of the circle. The dual side-by-side image display mode makes it easier for the user to recognize that two different wide-field images are captured by the two optical systems and that, with the VR180 lens unit attached, the camera100is in the VR image capturing state. The dual side-by-side image display mode, on the other hand, separately displays the two images in one screen and is not suitable for the user to cheek the focus and subject expression in detail. For that reason, the dual side-by-side image display mode is used, for example, when the user does not check the focus and subject expression in detail.

FIG.5Billustrates an example of a live view image502at the time of the live view display in the left-image enlarged display mode. In comparison with the live view image500at the time of the live view display in the dual side-by-side image display mode, the portion of the live image (left image) captured through the left-eye optical system is enlarged, making it easier for the user to check details of the image.

A display optical system guide503indicates which of the right-eye and the left-eye optical systems the captured live image is currently being displayed through. The guide503includes a region504for the dual side-by-side image corresponding to the left-eye optical system, and a region505for the dual side-by-side image corresponding to the right-eye optical system. The background on the side corresponding to the currently displayed optical system is shaded. In this example, the background of the region504for the currently displayed dual side-by-side image corresponding to the left-eye optical system is shaded. This enables the user to recognize which of the right-eye and the left-eye optical systems the currently displayed live image comes from. A frame506in the guide503indicates the enlargement target range of the dual side-by-side image. In this example, the circle on the region504indicating the left-eye optical system represents the image region of the live image from the left-eye optical system before the enlargement, and a rectangle is displayed in the region corresponding to the position of the currently displayed enlarged live image.

A button507is a graphical user interface (GUI) that accepts an operation for changing the enlargement target. When the user performs a touch-down on the touch panel109, the button507is displayed in the display unit108as an operation button for performing processing to switch the enlargement target image between the left and the right images. If the user presses the enlargement target right/left switching button, the display mode can be changed from the left-image enlarged display mode to the right-image enlarged display mode. If the current display mode is the right-image enlarged display mode, the display mode can be changed to the left-image enlarged display mode. According to the present exemplary embodiment, in selecting the enlargement target image, the enlargement position is determined to be the position of the other image corresponding to the enlargement position of the image before the switching. For example, the enlargement position may be determined by measuring the distance from the current enlargement position to the subject, calculating the amount of parallax together with the positions of the right and the left optical systems, and then shifting the enlargement position by the amount of parallax.

FIG.5Cillustrates an example of a live view image508at the time of the live view display in the right-image enlarged display mode. The right-image enlarged display mode is similar to the left-image enlarged display mode except that the enlargement target image is the image (right image)501R, and redundant descriptions thereof will be omitted.

In step S403, the system control unit50subjects the live image captured by the imaging unit211through the VR180 lens unit to the dual side-by-side image display, i.e., the system control unit50displays the live image in the display unit108in the dual side-by-side image display mode. In the dual side-by-side image display mode, the live image captured by the imaging unit211is displayed in the live view in the display unit108so that the live image captured through the right-eye optical system of the VR180 lens unit and the live image captured through the left-eye optical system thereof are arranged side by side. As illustrated inFIG.5A, the image500in which the right-side image501R and the left-side image501L are arranged side by side is displayed in the display unit108.

In step S404, the system control unit50determines whether the user performs an operation for enlarging the live view image. More specifically, the system control unit50determines whether an enlargement instruction input through the enlargement operation is received. For example, the enlargement instruction is input through the depression of the enlargement button113or a pinch-out operation on the touch panel109. If the enlargement instruction is received, i.e., if the system control unit50determines that the user has performed an operation for enlarging the live view image (YES in step S404), the processing proceeds to step S405. If neither operation is detected (NO in step S404), the processing proceeds to step S430.

In step S405, the system control unit50sets the display mode at the time of the live view display to the left-image enlarged display mode. More specifically, the system control unit50stores information about the left-image enlarged display mode in a control variable stored in the nonvolatile memory219. Then, the processing proceeds to step S430.

In step S430, the system control unit50determines whether to end the live view image display. The system control unit50determines to end the live view image display, for example, if an instruction for entering the menu mode is input. The menu mode is a mode in which the user displays the menu screen from either the still image or the moving image mode and then makes settings. When the user operates the power button to turn power OFF, the system control unit50determines to end the live view image display. If the system control unit50determines to end the live view image display (YES in step S430), the processing exits the flowchart of the live view display processing. Otherwise (NO in step S430), the processing returns to step S401.

In step S406, the system control unit50determines whether the current display mode setting is the left-image enlarged display mode. More specifically, the system control unit50determines whether information about the left-image enlarged display mode is stored in a control variable stored in the nonvolatile memory219. If the left-image enlarged display mode is set (YES in step S406), the processing proceeds to step S407. Otherwise (NO in step S406), the processing proceeds to step S414.

In step S407, the system control unit50enlarges the left-side image portion of the dual side-by-side image captured by the imaging unit211via the lens unit300. The left-image enlarged display mode is a mode for enlarging the image (left-side image) captured through the left-eye optical system of the lens unit300out of the live image captured by the imaging unit211, and displaying the enlarged image as the live view in the display unit108. The system control unit50reads information about the enlargement position from a control variable stored in the system memory218, and enlarges the region corresponding to the enlargement position of the image captured via the left-eye optical system. In this case, if no information is stored in the control variable or no setting is made at the enlargement position in advance, the system control unit50enlarges the central portion of the image captured via the left-eye optical system and then displays the enlarged image.FIG.5Bis a schematic view illustrating the live view image displayed in the left-image enlarged display mode. As described above, a part of the left-side image501L inFIG.5Ais enlarged and displayed as the live view image502. The guide503and the button507are also displayed. Then, when the user performs the enlargement operation in a state where the dual side-by-side image is displayed, the user is able to immediately check details of the portion of either one (left-side image) of the right-side and left-side images.

In step S408, the system control unit50determines whether to end the enlarged display. More specifically, the system control unit50determines whether an instruction (enlargement end instruction) input in response to the operation for ending the enlarged display is received. If the instruction is received, the system control unit50determines to end the enlarged display. For example, the system control unit50determines whether the user has performed an operation (enlargement end operation) to issue an instruction for ending the enlarged live view image display. More specifically, the enlargement end operation is a depression of the enlargement button113by the user. A pinch-in operation (reduction operation) on the touch panel109may also be detected as an enlargement end operation. If an enlargement end operation is detected, i.e., if the system control unit50determines to end the enlarged display (YES in step S408), the processing proceeds to step S409. On the other hand, if no enlargement end operation is performed, i.e., if the system control unit50determines not to end the enlarged display (NO in step S408), the processing proceeds to step S410. If no operation has been performed within a predetermined time period since the enlarged display was started (time-out), the system control unit50may determine to end the enlarged display.

In step S409, the system control unit50sets the display mode at the time of the live view display to the dual side-by-side image display mode. More specifically, the system control unit50stores information about the dual side-by-side image display mode in a control variable stored in the nonvolatile memory219. Then, the processing proceeds to step S430.

In step S410, the system control unit50determines whether an instruction for changing the enlargement position (enlargement range) subjected to the enlargement processing in the enlarged display is input. More specifically, the system control unit50determines whether the user has performed an operation for changing the enlargement position. Examples of operations for changing the enlargement position include a touch-move operation on the touch panel109and cursor key operations. If an operation for changing the enlargement position is detected, i.e., if the system control unit50determines that an instruction for changing the enlargement position is input (YES in step S410), the processing proceeds to step S411. On the other hand, if the system control unit50determines that the instruction is not input (NO in step S410), the processing proceeds to step S412. In an operation for changing the enlargement position, an enlargement range can be set in the left-side image.

In step S411, the system control unit50performs processing for changing the enlargement position. More specifically, the system control unit50changes the enlargement position of the live image captured through the left-eye optical system based on information about the direction and distance of the enlargement position change operation detected in step S410. The system control unit50also stores information about the enlargement position in a control variable stored in the system memory218. Then, the processing proceeds to step S430.

In step S412, the system control unit50determines whether the user has performed an enlargement target right/left switching operation. More specifically, the system control unit50detects whether an operation on the button507displayed in the display unit108is performed. If the operation is detected (YES in step S412), the processing proceeds to step S413. Otherwise (NO in step S412), the processing proceeds to step S430.

In step S413, the system control unit50sets the display mode at the time of the live view display to the right-image enlarged display mode. More specifically, the system control unit50stores information about the right-image enlarged display mode in a control variable stored in the nonvolatile memory219. Then, the processing proceeds to step S430.

The above-described processing in steps S407to S413is processing in the left-image enlarged display mode. In the left-image enlarged display mode, the left-side image alone of the dual side-by-side image is subjected to the enlargement processing and enlarged. This enables the user to avoid recognizing the displayed enlarged image as the right-side image portion or the left-side image portion in a confused way.

Operations in the right-image enlarged display mode will be described.

In step S414, the system control unit50enlarges the right-side image portion of the dual side-by-side image captured by the imaging unit211through the lens unit300. The right-image enlarged display mode is a mode for enlarging the image (right-side image) captured through the right-eye optical system of the lens unit300out of the live image captured by the imaging unit211, and displaying the enlarged image as the live view in the display unit108. The system control unit50reads information about the enlargement position from a control variable stored in the system memory218, and enlarges the region corresponding to the enlargement position of the image captured through the right-eye optical system. In this case, if no information is stored in the control variable or no setting is made at the enlargement position in advance, the system control unit50subjects the central portion of the image captured through the right-eye optical system to the enlargement processing and then displays the enlarged image.FIG.5Cis a schematic view illustrating the live view image displayed in the right-image enlarged display mode. As described above, a part of the right-side image501R inFIG.5Ais enlarged and displayed as the live view image508. The guide503and the button507are displayed. Then, the processing proceeds to step S415.

In step S415, the system control unit50determines whether to end the enlarged display. More specifically, the system control unit50determines whether an instruction (enlargement end instruction) input in response to the operation fir ending the enlarged display is received. If the instruction is received, the system control unit50determines to end the enlarged display. For example, the system control unit50determines whether the user has performed an operation (enlargement end operation) to issue an instruction for ending the enlarged live view image display. More specifically, the enlargement end operation is a depression of the enlargement button113by the user. A pinch-in operation on the touch panel109may also be detected as an enlargement end operation. If an enlargement end operation is detected, i.e., if the system control unit50determines to end the enlarged display (YES in step S415), the processing proceeds to step S416. On the other hand, if no enlargement end operation is performed, if the system control unit50determines not to end the enlarged display (NO in step S415), the processing proceeds to step S417. If no operation has been performed within a predetermined time period since the enlarged display was started (time-out), the system control unit50may determine to end the enlarged display.

In step S416, the system control unit50sets the display mode at the time of the live view display to the dual side-by-side image display mode. More specifically, the system control unit50stores information about the dual side-by-side image display mode in a control variable stored in the nonvolatile memory219. Then, the processing proceeds to step S430.

In step S417, the system control unit50determines whether an instruction for changing the enlargement position (enlargement range) subjected to the enlargement processing in the enlarged display is input. More specifically, the system control unit50determines whether the user has performed an operation for changing the enlargement position. Examples of operations for changing the enlargement position include a touch-move operation on the touch panel109and cursor key operations. If an operation for changing the enlargement position is detected, i.e., if the system control unit50determines that an instruction for changing the enlargement position is input (YES in step S417), the processing proceeds to step S418. On the other hand, if the system control unit50determines that the instruction is not input (NO in step S417), the processing proceeds to step S419. In an operation for changing the enlargement position, an enlargement range can be set in the left-side image.

In step S418, the system control unit50performs processing for changing the enlargement position. More specifically, the system control unit50changes the enlargement position of the live image captured through the right-eye optical system based on information about the direction and distance of the enlargement position change operation detected in step S417. The system control unit50also stores information about the enlargement position in a control variable stored in the system memory218. Then, the processing proceeds to step S430.

In step S419, the system control unit50determines whether the user has performed an enlargement target right/left switching operation. More specifically, the system control unit50detects whether an operation on the button507displayed in the display unit108is performed. If the operation is detected (YES in step S419), the processing proceeds to step S420. Otherwise (NO in step S419), the processing proceeds to step S430.

In step S420, the system control unit50sets the display mode at the time of the live view display to the left-image enlarged display mode. More specifically, the system control unit50stores information about the left-image enlarged display mode in a control variable stored in the nonvolatile memory219. Then, the processing proceeds to step S430.

The above-described processing in steps S414to S420is processing in the right-image enlarged display mode. In the right-image enlarged display mode, the right-side image alone of the dual side-by-side image is subjected to the enlargement processing and enlarged. This enables the user to avoid recognizing the displayed enlarged image as the right-side image portion or the left-side image portion in a confused way.

As described above, with the lens unit300that acquires a dual side-by-side image attached to the camera100and an image based on the dual side-by-side image displayed, the system control unit50of the camera100enlarges either the right-side or left-side images according to the enlargement instruction. With the enlarged display made, the above-described control enables preventing the right-side and left-side image portions from being mixed in the displayed image, thus improving user's visibility.

The system control unit50of the camera100according to the present exemplary embodiment changes the setting of the enlargement target range according to the type of the lens unit attached to the camera100in response to an issuance of an enlargement processing instruction. Operations with the lens unit200as a conventional single-lens lens unit attached to the camera100will be described.

In step S421, the system control unit50determines whether the display mode setting at the time of the live view display is the enlarged display mode. More specifically, the system control unit50determines whether information about the enlarged display mode is stored in a control variable stored in the nonvolatile memory219. If the enlarged display mode is set (YES in step S421), the processing proceeds to step S425. Otherwise (NO in step S421) the processing proceeds to step S422.

In step S422, the system control unit50displays the live image captured by the imaging unit211through the lens unit200, in the live view in the display unit108in the normal display mode. The normal display mode is a mode for displaying the live image captured by the imaging unit211through the optical system of the lens unit200without enlargement, in the live view in the display unit108.FIG.6Aillustrates an example of a live view image509at the time of the live view display in the normal display mode. The processing proceeds to step S423.

In step S423, the system control unit50determines whether the user has performed an operation for enlarging the live view image. More specifically, the system control unit50determines whether an enlargement instruction input through the enlargement operation is received. For example, the enlargement instruction is input through a depression of the enlargement button113or a pinch-out operation on the touch panel109. If the enlargement instruction is received, i.e., if the system control unit50determines that the user has performed an operation for enlarging the live view image (YES in step S423), the processing proceeds to step S424. If neither operation is detected (NO in step S423), the processing proceeds to step S430.

In step S424, the system control unit50sets the display mode at the time of the live view display to the enlarged display mode. More specifically, the system control unit50stores information about the enlarged display mode in a control variable stored in the nonvolatile memory219. Then, the processing proceeds to step S430.

In step S425, the system control unit50displays the live image captured by the imaging unit211through the lens unit200, in the live view in the display unit108in the enlarged display mode. The enlarged display mode is a mode for enlarging the live image captured by the imaging unit211via the optical system of the lens unit200and then displaying the enlarged image in the live view in the display unit108. The system control unit50reads information about the enlargement position from a control variable stored in the system memory218, and enlarges the position corresponding to the live image captured via a normal imaging lens unit. If no information is stored in a control variable, the center position of the image is predetermined as the initial position of the enlargement position.FIG.6Billustrates an example of a live view image509at the time of the live view display in the enlarged display mode. Enlarged position guides510and511indicate which position of the live image before the enlargement is enlarged as the currently displayed live image. The enlarged position guide510corresponds to the entire live image before the enlargement, and the enlarged position guide511represents the enlarged region currently being displayed. Then, the processing proceeds to step S426.

In step S426, the system control unit50determines whether to end the enlarged display. More specifically, the system control unit50determines whether an instruction (enlargement end instruction) input in response to the operation for ending the enlarged display is received. If the instruction is received, the system control unit50determines to end the enlarged display. For example, the system control unit50determines whether the user has performed an operation (enlargement end operation) to issue an instruction for ending the enlarged live view image display. More specifically, the enlargement end operation is a depression of the enlargement button113by the user. A pinch-in operation on the touch panel109may also be detected as an enlargement end operation. If an enlargement end operation is detected, i.e., if the system control unit50determines to end the enlarged display (YES in step S426), the processing proceeds to step S427. On the other hand, if no enlargement end operation is performed, if the system control unit50determines not to end the enlarged display (NO in step S426), the processing proceeds to step S428. If no operation has been performed within a predetermined time period since the enlarged display was started (time-out), the system control unit50may determine to end the enlarged display.

In step S427, the system control unit50sets the display mode at the time of the live view display to the normal display mode. More specifically, the system control unit50stores information about the normal display mode in a control variable stored in the nonvolatile memory219. Then, the processing proceeds to step S430.

In step S428, the system control unit50determines whether an instruction for changing the enlargement position (enlargement range) subjected to the enlargement processing in the enlarged display is input. More specifically, the system control unit50determines whether the user has performed an operation for changing the enlargement position. Examples of operations for changing the enlargement position include a touch-move operation on the touch panel109and cursor key operations. If an operation for changing the enlargement position is detected, i.e., if the system control unit50determines that an instruction for changing the enlargement position is input (YES in step S428), the processing proceeds to step S429. On the other hand, if the system control unit50determines that the instruction is not input (NO in step S428), the processing proceeds to step S430.

In step S429, the system control unit50changes the enlargement position of the live view image. More specifically, the system control unit50changes the enlargement position of the live image captured through the optical system of the lens unit200based on information about the direction and distance of the enlargement position change operation detected in step S428. The system control unit50also stores information about the enlargement position in a control variable stored in the system memory218. Then, the processing proceeds to step S430.

As described above, with the lens unit200as a conventional single-lens unit attached to the camera100, the system control unit50of the camera100according to the present exemplary embodiment enlarges the central portion of the image according to an enlargement instruction. The lens unit300as a dual-lens unit capable of acquiring a dual side-by-side image is attachable to the camera100. The dual side-by-side image includes the right-side and left-side images with a parallax arranged side by side. With a dual-lens unit attached to the camera100, the system control unit50of the camera100enlarges the central portion of one of the left and the right-side images according to an enlargement instruction. More specifically, the system control unit50changes the position of the enlargement range subjected to the enlargement processing according to the type of the lens unit attached to the camera100. This eliminates the user's need to change the setting of the enlargement target position according to the type of the lens unit each time, easily providing an enlarged display with a suitably enlarged range.

As described above, in image capturing using a dual-lens unit according to the present exemplary embodiment, one of the right-side and left-side images is enlarged at the time of the enlarged display even while the images from the right and the left optical systems are displayed side by side. This enables reducing the user's difficulty in recognizing an enlarged boundary portion between the right-side and left-side images. In the present exemplary embodiment, an electronic apparatus is provided that enlarges one of the right-side and left-side images to make it easier for the user to check details of the image.

Although the present exemplary embodiment has been described above on the premise that the live view image displayed through a dual-lens unit is subjected to enlarged display, the present exemplary embodiment is also applicable to a case where an image captured through a dual-lens unit and reproduced from a Secure Digital (SD) card is subjected to enlarged display.

The present exemplary embodiment has been described above centering on a case of moving an enlargement position within the left-side image region during enlarged display of the left-side image or within the right-side image region during enlarged display of the right-side image. However, upon reception of an instruction for moving an enlargement position to exceed the end of the right-side or the left-side image, i.e., an instruction for changing an enlargement position to the outside of either image, the enlargement position may be moved to an end region of the other image. For example, upon reception of an instruction for further moving the enlargement position to the right while the right end region of the left-side image is displayed in the left-image enlarged display mode, the right-image enlarged display mode is entered and then the enlargement position is moved to the left end region of the right-side image. In this case, a movement instruction may be issued in such a way that the enlargement position is gradually moved starting in a state where the end of the image is not enlarged, and then the enlargement position eventually exceeds the end of the image. In this case, the enlargement position may be moved to the position where the end of the image is to be enlarged, without subjecting the other image to the enlargement position movement. Then, upon issuance of an instruction for moving the enlargement position to exceed the end of the image again, the enlargement position may be moved to the end region of the other image.

Upon issuance of an instruction for moving the enlargement position to exceed the end of one enlarged image, the other image may be enlarged and arranged next to the currently enlarged image, and an image including the enlarged right end region of the left-side image and the enlarged left end region of the right-side image may be displayed.

Although, in this example, an enlarged version alone of the image captured through one optical system is displayed in the live view, the live image captured through the other optical system may be displayed without the enlargement, together with the enlarged image. An example display in this case is illustrated inFIG.5D.FIG.5Dillustrates an enlarged version of a live image512captured through the left-eye optical system, and a live image513captured through the right-eye optical system. In this case, as the user wants to check details of the enlarged version of the live image captured through the left-eye optical system, the live image513captured through the right-eye optical system is partly hidden. According to the present disclosure, as long as a live image captured through the left-eye optical system or a live image captured through the right-eye optical system is subjected to enlargement, any other image can be displayed at the same time.

While the present disclosure has specifically been described based on the exemplary embodiments, the present disclosure is not limited to these specific exemplary embodiments. Diverse embodiments not departing from the spirit and scope of the present disclosure are also included in the present disclosure. A part of the above-described exemplary embodiments may be suitably combined.

The present disclosure makes it possible to implement image display suitable for checking details of an image including a right-eye image and a left-eye image arranged side by side.

While the present disclosure has been described with reference to exemplary embodiments, the scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

This application claims the benefit of Japanese Patent Application No. 2021-074490, filed Apr. 26, 2021, which is hereby incorporated by reference herein in its entirety.