Patent ID: 12225281

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

Embodiment 1

FIG.1is a block diagram illustrating an example of a configuration of a mobile terminal1according to Embodiment 1. A lens unit2aand an imaging unit3aare a rear camera disposed on the front surface of the mobile terminal1and are generally used for ordinary photographing such as landscape. A lens unit2band an imaging unit3bare a front camera disposed on the back surface of the mobile terminal1, and are used for so-called self-photographing.

Each of the lens units2aand2bis configured with a plurality of lenses including a focus lens, and a control circuit6controls a position of the focus lens to perform a focusing operation. The imaging units3aand3binclude an imaging sensor configured with a CMOS, a CCD, or the like. Photoelectric conversion elements as an imaging sensor are two-dimensionally disposed on an imaging surface of the imaging units3aand3b, and an optical image of a subject, which is input through the lens units2aand2band formed on the imaging surface, is photoelectrically converted into an imaging signal.

The imaging units3aand3binclude an AD conversion circuit that converts an analog signal into a digital signal, and output a digitized imaging signal. Further, the imaging units3aand3bmay include an imaging sensor in which pixels for a phase difference AF (autofocus) are disposed, so that it is intended to speed up the AF. The imaging units3aand3bmay include a memory, so that an interval until the next imaging is shortened.

Incidentally, in a case where the imaging units3aand3bdo not include the AD conversion circuit, the AD conversion circuit may be provided outside the imaging units3aand3b. The control circuit6controls the imaging units3aand3b, and the lens units2aand2baccording to an operation mode of the mobile terminal1, in addition to the focusing operation.

An interface circuit4outputs either or both of input signals from the imaging units3aand3bto an image/audio signal processing circuit5according to the operation mode of the mobile terminal1. The control circuit6also controls this operation mode. The image/audio signal processing circuit5performs various image signal processing such as filtering, amplification according to sensitivity setting, white balance correction, and the like on the input signal from the interface circuit4.

The image/audio signal processing circuit5generates moving image data or still image data as image data for display or image data for recording from the signal subjected to image signal processing, according to the operation mode. Here, the image data for display may be scaled up or down as an image. The image data for display is output to a display8, and the image data for recording is output to an encoding/decoding circuit15.

The image/audio signal processing circuit5may input the encoded or decoded image data from the encoding/decoding circuit15to be output to a recording/reproducing circuit10, or may generate the image data for display to be output to the display8. Under the control of the control circuit6, the image/audio signal processing circuit5may generate image data of texts and graphics to be output to the display8, or may adjust the brightness of the display8.

Further, in addition to a circuit for performing image signal processing, the image/audio signal processing circuit5also includes a circuit for performing audio signal processing, and performs predetermined audio signal processing such as encoding on an input signal from a microphone34. Then, in a case where an encoded audio signal is input, the audio signal is decoded to be output to a speaker32. The microphone34and the speaker32may be used for speech communication, and the audio signal may be transmitted to and received from a telephone line by a wireless communication unit14through the image/audio signal processing circuit5and the control circuit6.

Incidentally, the image/audio signal processing circuit5may be an LSI integrated into one chip with another circuit, or may be one independent LSI. Then, there may be provided a circuit including two systems of circuits for processing the imaging units3aand3bdepending on the performance of the imaging units3aand3b, and capable of simultaneously performing two systems of signal processing. Further, a memory12that is a DRAM, a flash memory, or the like may be used as a temporary buffer memory.

The encoding/decoding circuit15encodes moving image data or still image data, or decodes the encoded data. Instead of the image/audio signal processing circuit5, an encoding/decoding circuit15may encode or decode the audio signal. The recording/reproducing circuit10writes data input from the image/audio signal processing circuit5into a recording medium11, or reads out the data stored in the recording medium11to be output to the image/audio signal processing circuit5. Incidentally, data to be read from or written to may be any encoded data.

The control circuit6inputs information from each unit of a posture detection unit7, an operation input unit9, a position information input unit13, and a proximity sensor31, and controls each unit of the lens units2aand2b, the imaging units3aand3b, and the interface circuit4to input and output information with the image/audio signal processing circuit5and the wireless communication unit14. Further, the control circuit6may control the image/audio signal processing circuit5and the wireless communication unit14, or may control the display8, the encoding/decoding circuit15, and the recording/reproducing circuit10, through the image/audio signal processing circuit5.

Further, the control circuit6may directly control the display8, the encoding/decoding circuit15, and the recording/reproducing circuit10by using a control line (not illustrated). Incidentally, the control circuit6may be a processor, or may execute a program stored in a memory (not illustrated) or a memory incorporated in the processor.

The wireless communication unit14is a circuit that communicates with the Internet or the like by wireless communication. Wireless communication may be a telephone line, a wireless LAN, or the like. The position information input unit13is a circuit that acquires the position information of the mobile terminal1by a GPS or wireless communication to output the acquired position information to the control circuit6. The posture detection unit7is a circuit that detects gravity by an acceleration sensor or detects rotation by an angular velocity sensor to output the detected information to the control circuit6.

The proximity sensor31is a sensor that detects an object approaching the mobile terminal1and is a sensor that mainly detects a face to be in close to the mobile terminal1for speech communication. Since the proximity sensor31of the present embodiment also detects approach other than the approach of the face, it is preferable that the proximity sensor31is an infrared type proximity sensor or the like for detecting the approach of an object other than a human body.

The operation input unit9receives an operation input from a user. Specifically, as described later, the operation input unit includes a touch panel, a power button, and a shutter. However, the operation input unit is not limited thereto and may include various dedicated buttons. The display8is, for example, a display panel such as a liquid crystal panel or an organic EL panel. It is preferable that the display8and the touch panel of the operation input unit9are integrated. In the following description, the touch panel of the operation input unit9is also referred to as the display8unless otherwise mentioned.

Incidentally, the mobile terminal1may be a general smartphone, a tablet, or the like.

The operation mode of the mobile terminal1includes at least a photographing mode and a reproducing mode. First, operations in the photographing mode will be described. The control circuit6detects an activation instruction of the photographing mode by an operation on the operation input unit9(touch panel) and the like, and performs control according to the photographing mode. The photographing mode further includes a still image photographing mode and a moving image photographing mode.

In either case of still image photographing or moving image photographing, the imaging units3aand3boutput imaging signals at predetermined intervals, and the imaging signals are subjected to predetermined image signal processing in the image/audio signal processing circuit5through the interface circuit4, so that the image data for display is generated. The image data for display is displayed on the display8in real time.

At this time, depending on which of the imaging unit3aand the imaging unit3bis used, the AF or a diaphragm value, and the like, the control circuit6controls the lens units2aand2b, the imaging units3aand3b, the interface circuit4, the image/audio signal processing circuit5, and the like. Incidentally, in a case where it is set to detect two states of a half depression and a full depression on the depression of the shutter, once the state of the half depression is detected, the control circuit6may perform control of the AF.

In the still image photographing mode, once the depression of the shutter or the full depression is detected, the control circuit6controls each unit according to the photographing conditions such as a shutter speed. The imaging signals of a still image imaged by the imaging units3aand3bare subjected to predetermined still image signal processing by the image/audio signal processing circuit5, and are then encoded by the encoding/decoding circuit15.

Here, the memory12may be used as a buffer memory when still image signal processing and encoding are performed. Further, the encoding may be, for example, any encoding into JPEG data, or encoding of MPEG data into still images. The encoded still image data is output to the recording/reproducing circuit10by the image/audio signal processing circuit5, and is recorded on the recording medium11by the recording/reproducing circuit10. Incidentally, without the use of the encoding/decoding circuit15, recoding may be performed in a high-quality RAW format.

In the moving image photographing mode, once the depression of the shutter or the full depression is detected, the control circuit6controls each unit according to the photographing conditions. In the case of the moving image photographing mode, even though the depression of the shutter is released, the control circuit6continues control of the photographing. The imaging signals of a moving image imaged by the imaging units3aand3bare subjected to predetermined moving image signal processing by the image/audio signal processing circuit5, and are then encoded by the encoding/decoding circuit15.

The encoding may be, for example, any encoding into MPEG data such as H.264 or H.265, or encoding into other moving image formats. The encoded moving image data is output to the recording/reproducing circuit10by the image/audio signal processing circuit5and is recorded on the recording medium11by the recording/reproducing circuit10.

Once the depression of the shutter during photographing of the moving image is detected again, the control circuit6terminates control of the photographing. Incidentally, the image/audio signal processing circuit5generates image data for display during photographing and also after photographing of the moving image, and the image data for display is displayed on the display8in real time.

Next, operations in the reproducing mode will be described. The control circuit6detects an activation instruction of the reproducing mode on an operation of the operation input unit9(touch panel) or the like, and performs control according to the reproducing mode. The recording/reproducing circuit10reads out designated data from the data recorded on the recording medium11, the read-out data is decoded by the encoding/decoding circuit15through the image/audio signal processing circuit5, and the decoded data is output to the image/audio signal processing circuit5. The image/audio signal processing circuit generates image data for display from the decoded data, and the image data for display is displayed on the display8.

FIG.2is a diagram illustrating an example of a cross-sectional structure of the display8including a liquid crystal panel22and a touch panel21. The display8is formed by disposing the touch panel21on an upper surface of the liquid crystal panel22to integrate them, disposing a protective cover20such as glass on the upper surface of the touch panel21, and disposing a backlight23on a lower surface of the liquid crystal panel22.

The touch panel21uses, for example, an electrostatic capacitance type, and transparent electrodes are disposed in a two-dimensional orthogonal manner. Once a human finger or a touch pen is in contact with or approaches a display screen of the display8, electrostatic capacitance between the finger or the touch pen and the transparent electrodes is changed, so that a position in the horizontal and vertical directions on the contacted screen is detected. Incidentally, display and operations of the display8including the touch panel21will be described later.

In this structure, since the electrostatic capacitance is detected through the protective cover20, the touch panel21is disposed in close contact with the protective cover20to obtain high detection accuracy. Further, since a surface of the protective cover20is subjected to gloss finishing, high visibility of the display image of the liquid crystal panel22is obtained and a slip of the finger and the touch pen is improved. However, once the surface of the protective cover20is subjected to glossy finishing, a reflection amount of light from the outside is increased.

The backlight23emits illumination light from the back surface of the liquid crystal panel22to display an image. In a case where it is not necessary to display the image, the backlight23is controlled to be turned off, in order to reduce power consumption. The backlight23may be turned off over the whole of the display8, and the backlight23is divided into a plurality of portions to be controlled so that a portion of the display8may be turned off.

Incidentally, instead of the liquid crystal panel22and the backlight23, a panel such as an organic EL may be used. In the display panel using a light-emitting element such as an organic EL, the backlight is unnecessary. Further, in addition to the electrostatic capacitance type, the touch panel21may use a pressure sensitive type or the like.

FIG.3is a diagram illustrating an example of the external appearance of the mobile terminal1,FIG.3(a)is a diagram of the mobile terminal1as seen from a back surface side,FIG.3(b)is a diagram of the mobile terminal1as seen from a side surface side, andFIG.3(c)is a diagram of the mobile terminal1as seen from a front surface side. The display8integrated with the touch panel21is disposed on the back surface of the mobile terminal1.

As illustrated inFIGS.3(a) and3(c), the lens unit2aof the rear camera is disposed on the front surface, and the lens unit2bof the front camera is disposed on the back surface.FIGS.3(a) and3(c)illustrate that the lens units2aand2bis fixed on the front surface and the back surface, respectively, but may be replaced with a lens of an attachable or detachable type having a different focal length. A power switch33is a switch operated when activating and terminating the mobile terminal1, and may also serve as a switch for returning to a power saving mode in the mobile terminal1having a power saving mode.

Since the speaker32and the microphone34are for speech communication, for example, the speaker and the microphone are disposed to be in close to the ears and the mouth of a caller in speech communication. The proximity sensor31is disposed to be in close to the speaker32, for example, in order to detect the approach of a face in speech communication, and the infrared type proximity sensor has a light emitting portion and a light receiving portion for near infrared light. The proximity sensor31is disposed on the same surface as that of the display8, that is, on the back surface, in order to detect that the viewer is mounted as described later. The speaker32and the microphone34are also disposed on the back surface.

A shutter35is a switch for instructing to perform photographing through the lens unit2aand the shutter35may coexist with a shutter executed by touching a portion of the touch panel21, or may be eliminated. The example ofFIG.3(b)is an example of the disposition of the power switch33and the shutter35, without limiting to this disposition.

FIG.4is a diagram illustrating an example of a viewer40mounted on the mobile terminal1. The viewer40has a structure in which the viewer is attachable to or detachable from the back surface of the mobile terminal1.FIG.4(a)is a diagram of the viewer40as seen from a back surface side,FIG.4(b)is a diagram of the viewer40as seen from a side surface side, andFIG.4(c)is a diagram of the viewer40as seen from a front surface side. Here, the back surface, the side surface, and the front surface are the same surfaces as those of the mobile terminal1illustrated inFIG.3, but are not surfaces based on the structure of the viewer40.

The viewer40includes a finder portion42a. As illustrated inFIGS.4(a) and4(b), the finder portion42ahas a rectangular tube shape, that is, a shape in which four side surfaces are surrounded by substantially rectangular light shielding plates to shield light from the side surfaces. As illustrated inFIGS.4(a) and4(c), an opening portion41of the finder portion42ais an opening portion through which light is passed from the front surface side to the back surface side of the viewer40, and the structure of the opening portion41will be described later with reference toFIG.5. A cavity portion43is a cavity through which light, a human finger or a touch pen is passed between the front surface side and the back surface side of the viewer40.

The whole of the viewer40has a shape in which the viewer is mounted covering portions of the back surface and the side surface of the mobile terminal1, and is formed of a material such as colored polycarbonate as a light shielding material. The viewer40and the mobile terminal1may have a shape in which the viewer and the mobile terminal are pinched between fingers to maintain a mounted state, and each of the viewer40and the mobile terminal1may have a concave portion and convex portion (not illustrated) so that the concave portion is fitted to the convex portion to maintain a mounted state.

Further, the viewer40has a shape in which the proximity sensor31detects the viewer in a state where the viewer40is mounted to the mobile terminal1. Therefore, at the time of mounting, the opening portion41and the cavity portion43are not located at positions facing the proximity sensor31, and a portion of the viewer40excluding the opening portion41and the cavity portion43is located facing the proximity sensor31.

FIG.5is a cross-sectional view illustrating an example of the finder portion42a. A cover glass50and lens51are fitted to the opening portion41of the finder portion42a, and the side surfaces of the finder portion42aserve as supporting members of the cover glass and lens. In a case where the display8is directly viewed without the viewer40, it is performed to normally view the display8at a distance of about 30 cm or more from the display8, whereas in a case where the viewer40is used, it is performed to view the display8in a state of looking into the finder portion42a, so that the image displayed on the display8is enlarged by the lens51to adjust focus on the image.

The cover glass50protects the lens51. It is preferable that the finder portion42aextends from an eyepiece position to the cover glass50, and it is preferable to have a shape in which the cover glass50is shielded from external light by the side surfaces of the finder portion42aand a face of a person looking into the finder portion.

FIG.6Ais a diagram illustrating an example of a display in a case where the viewer40is not mounted, andFIG.6Bis a diagram illustrating an example of a display in a case where the viewer40is mounted. The display on the display8is changed depending on whether or not the viewer40is mounted, that is, whether or not the viewer40is used. In the case of the viewer being not used ofFIG.6A, it is performed to directly view the display8.

InFIG.6A, a subject67ais a display of a subject imaged by the imaging unit3a. An imaging region66ais preferably a display within a range imaged by the imaging unit3a, but may be a display within a range of a portion obtained by clipping the periphery. Further, the display of the subject67aand the imaging region66amay be reduced and displayed according to a ratio between the number of pixels of the imaging units3aand3band the number of pixels of the display8.

Setting buttons60to64are a display of various setting buttons, and a shutter button65is a display of a button corresponding to a shutter. The setting button60is a button for switching between the front camera and the rear camera, the setting button61is a button for changing an ISO sensitivity, the setting button62is a button for changing a diaphragm value, the setting button63is a button for changing a shutter speed, and the setting button64is a button for setting a flash.

These setting buttons60to64, which are operation menus for setting the camera, are displayed on the display8. Once it is detected that a position corresponding to a display is touched on the touch panel21of the operation input unit9, the setting is changed by the processing of the control circuit6. For example, each time the setting button60is touched, the rear camera and the front camera are switched.

Further, in a case where the setting button61is touched, a selectable ISO sensitivity is displayed by horizontal scrolling, and in a case where a selection is made by touch, the ISO sensitivity is changed. The diaphragm value of the setting button62and the shutter speed of the setting button63also operate in the same manner as the setting button61. Each time the setting button64is touched, the setting button64is set to ON (forced light emission), OFF (light emission prohibition), or automatic light emission (light emission control according to brightness).

Incidentally, these setting buttons60to64are examples of operation menus, and menus for changing an optional setting and setting buttons such as changing a mode to a photographing mode including moving image photographing, or a reproducing mode, a focusing mode, and white balance may be displayed. The shutter button65is the same operation as the shutter35and may be combined with the shutter35.

Further, when the image imaged by the imaging unit3bas the front camera is displayed on the display8, the image is displayed as a mirror image, and the other images are normally displayed as normal images. Then, the display and operations ofFIG.6Amay be a general display and operations of the smartphone.

In the display ofFIG.6B, the same displays as those inFIG.6Aare denoted by the same reference numerals, and the descriptions thereof will not be repeated. A region68is a region corresponding to the cavity portion43, and even in a state where the viewer40is mounted, the region68can be viewed directly and can be touched through the cavity portion43. The display of the setting buttons60to64and the shutter button inFIG.6Bis illustrated as an example of the same displays as those inFIG.6A, but may be reduced and displayed, as compared with the display ofFIG.6A, to fit in the region68.

In a case where the viewer40is mounted, the setting button for switching between the rear camera and the front camera may not be displayed using only the rear camera, or the setting button60may be grayed out not to be selectable. Further, in a case where it is detected that the viewer40is mounted, the setting buttons60to64may be changed to different operation menus.

A subject67band an imaging region66bcorrespond to the subject67aand the imaging region66a, respectively, and the same image data is used and displayed as an image display by one operation of the shutter35or the shutter button65. Here, in a case where the subject67aand the imaging region66aare displayed at equal magnification, the subject67band the imaging region66bare reduced and displayed, and in a case where the subject67aand the imaging region66aare reduced and displayed, the subject67band the imaging region66bare reduced and displayed to be smaller, as compared with the reduced display of the subject67aand the imaging region66a. This reduction is performed by the image/audio signal processing circuit5.

It is preferable that a size of the imaging region66bis large enough to sufficiently confirm the image displayed in the imaging region66bfrom corner to corner, due to enlargement by the lens51. For example, a magnification setting button is also displayed on the operation menus of the setting buttons60to64, and a reduction magnification for this size may be set by a touch operation. Further, a distance from the display8to the lens51, a distance from the lens51to an eye looking into the lens, a focal length of the lens51, and the like are preset, and a size and resolution and the like of a screen of the display8are acquired, so that the reduction magnification may be calculated.

The periphery display of the imaging region66b, that is, a hatched portion of a region69, may be displayed with a reduced brightness or black. For this display, the liquid crystal panel22may be controlled, or the backlight23may be controlled.

The mounting of the viewer40is detected by the proximity sensor31. For example, once the proximity sensor31detects a proximity object to be within a range of a preset distance longer than a preset time in a state where the photographing mode is set, the control circuit6may perform control of changing a display to another display illustrated inFIG.6B. That is, the control circuit6may perform control of reducing the imaging region66bincluding the subject67band displaying the region69with a reduced display brightness.

Further, the removal of the viewer40is also detected by the proximity sensor31. For example, once the proximity sensor31does not detect a proximity object to be within a range of a preset distance longer than a preset time in a state where the photographing mode is set, the control circuit6may perform control of changing a display to the display illustrated inFIG.6A. Incidentally, the setting button for switching is also displayed on the operation menus of the setting buttons60to64, and may control switching between the display illustrated inFIG.6Aand the display illustrated inFIG.6Bby a touch operation.

When a still image or a moving image is photographed, there is a case where bright surroundings make it difficult for the screen of the display8to be viewed. In such a case, since the viewer40is mounted to improve a light shielding property, it is easy to confirm the image of the subject67beven in the bright surroundings.

FIG.7Ais a diagram illustrating an example of a display including a focus setting region frame70ain a case where the viewer40is not mounted. In the display ofFIG.7A, the same displays as those inFIG.6Aare denoted by the same reference numerals, and the descriptions thereof will not be repeated. In the display illustrated inFIG.6A, for example, once the touch panel21detects that an optional position in the display of the imaging region66ais touched, the control circuit6displays the focus setting region frame70aby focusing on a distance to an imaging target corresponding to the touched position.

FIG.7Bis a diagram illustrating an example of a display including a focus setting region frame70bin a case where the viewer40is mounted. In the display ofFIG.7B, the same displays as those inFIG.6Bare denoted by the same reference numerals, and the descriptions thereof will not be repeated. A touch pad region71is touched through the region68corresponding to the cavity portion43and the control circuit6performs control of moving a position of the focus setting region frame70bin the imaging region66baccording to a touched position in the region68.

In this way, it is possible to move the position of the focus setting region frame70bin the display of the imaging region66b, even though the cover glass50cannot be touched due to the mounting of the viewer40. Further, icons and the like corresponding to the setting buttons60to64illustrated inFIG.7Aare displayed in the display of the imaging region66b, and the control circuit6may perform control such that icons and the like are selectable according to the position of the focus setting region frame70b.

FIG.8is a diagram illustrating another example of the viewer40.FIG.8(a)is a diagram of the viewer40as seen from the back surface side,FIG.8(b)is a diagram of the viewer40as seen from the side surface side, andFIG.8(c)is a diagram of the viewer40as seen from the front surface side. InFIG.8, the same structures as those inFIG.4are denoted by the same reference numerals, and the descriptions thereof will not be repeated.FIG.8illustrates a different shape of the finder portion42b, as compared withFIG.4.

In the example illustrated inFIG.4, each of the side surfaces of the finder portion42ais substantially rectangular, but in the example illustrated inFIG.8, each of the side surfaces of the finder portion42bis substantially trapezoidal. That is, as the opening portion41approaches the display8, the opening portion becomes wider. In this way, in the case of looking into the finder portion42b, an inside of the finder portion42b, that is, a visible region of an inside surface on an opening portion41side is reduced, and the display regions of the imaging region66billustrated inFIGS.6B and7Bare widened, so that there are a case where the number of pixels in the display region is easy to be increased. Further, since the side surface of the finder portion42bis substantially trapezoidal, a physical structural strength also is enhanced.

As described above, according to the present embodiment, in the mobile terminal1which has the display8such as a liquid crystal panel but does not have the electronic viewfinder, the same functions and effects as the viewfinder are obtained only by mounting the viewer40. Here, the viewer40does not include display components unlike the electronic viewfinder, so that a simple structure and a low cost are obtained.

Further, since it is possible to eliminate, through image processing of the mobile terminal1, a portion in which the display of the imaging region66acannot be confirmed resulting from the mounting of the viewer40, the viewer40can be substantially used. Then, since it is possible to automatically switch a display when the viewer40is mounted or not mounted, it is possible to provide a user-friendly mobile terminal. Further, even though the viewer40is mounted, it is possible to move a manual focus setting region frame.

Embodiment 2

In Embodiment 1, the example of one rear camera has been described, but in Embodiment 2, an example of two rear cameras will be described.FIG.9is a block diagram illustrating an example of the configuration of the mobile terminal1of Embodiment 2. InFIG.9, the same structures as those inFIG.1are denoted by the same reference numerals and the descriptions thereof will not be repeated. InFIG.1, two lens units2aand2bcorresponding to the front camera and the rear camera, and two imaging units3aand3bare provided, whereas in the example ofFIG.9, a lens unit2cand an imaging unit3care further provided.

The lens unit2cand the imaging unit3care combined with the lens unit2aand the imaging unit3a, so that the front camera can cope with stereo imaging or the like. For example, the imaging unit3aand the imaging unit3bare controlled to perform imaging at the same timing, and the interface circuit4outputs both input signals from the imaging units3aand3cto the image/audio signal processing circuit5. Further, the image/audio signal processing circuit5generates image data for display based on both input signals and outputs the image data to the display8. This display will be described later.

FIG.10is a diagram illustrating an example of the external appearance of the mobile terminal1of Embodiment 2.FIG.10(a)is a diagram of the mobile terminal1as seen from the back surface side,FIG.10(b)is a diagram of the mobile terminal1as seen from the side surface side, andFIG.10(c)is a diagram of the mobile terminal1as seen from the front surface side. InFIG.10, the same structures as those inFIG.3are denoted by the same reference numerals, and the descriptions thereof will not be repeated. InFIG.3, the lens unit2aof the rear camera is provided, but in the example ofFIG.10, the lens unit2aand the lens unit2cof the rear camera are provided.

The lens unit2aand the lens unit2care disposed at a predetermined interval in a longitudinal direction on the front surface of the mobile terminal1. Incidentally, disposition in the longitudinal direction is for performing photographing by using the mobile terminal1sideways. Although disposition is not limited thereto, it is preferable to dispose the lens units side by side in a long side direction of the display8.

FIG.11is a diagram illustrating an example of a viewer of Embodiment 2. The viewer40has a structure in which the viewer is attachable to or detachable from the back surface of the mobile terminal1. Incidentally, it is preferable that the viewer is mounted on the mobile terminal1illustrated inFIGS.9and10of the present embodiment, and the viewer is mounted on the mobile terminal1illustrated inFIGS.1and3of Embodiment 1, so that the viewer may be used for reproducing and displaying a 3D image.

The viewer80, which is mounted on the mobile terminal1illustrated inFIGS.9and10of the present embodiment, is used for 3D photographing by which images corresponding to a right eye and a left eye are simultaneously photographed by the two imaging units of the imaging unit3aand the imaging unit3c. Further, in reproducing, this viewer80is used for viewing 3D images.FIG.11(a)is a diagram of the viewer80as seen from the back surface side,FIG.11(b)is a diagram of the viewer80as seen from the side surface side, andFIG.11(c)is a diagram of the viewer80as seen from the front surface side.

As illustrated inFIGS.11(a) and11(b), each of the finder portions82aand82chas a rectangular tube shape, that is, a shape in which four side surfaces are surrounded by substantially rectangular light shielding plates to shield light from the side surfaces. Further, each of opening portions81aand81cof the finder portions82aand82cis an opening portion through which light is passed from the front surface side to the back surface side of the viewer80. A cavity portion83is a cavity through which light, a human finger or a touch pen is passed between the front surface side and the back surface side of the viewer80.

The finder portion82aand the finder portion82care disposed at a predetermined interval in the longitudinal direction on the back surface of the viewer80. This corresponds to the disposition of the lens units2aand2cillustrated inFIG.10(c), and when photographing is performed by using the mobile terminal1sideways, each of the finder portion82aand the finder portion82cis disposed to be viewed by a left eye and a right eye. Incidentally, in order to increase area of the opening portions81aand81c, it is preferable to dispose the finder portions side by side in the long side direction of the display8. The structure of each of the finder portions82aand82cis the same as described with reference toFIG.5.

InFIGS.11(a) and11(c), there is illustrated an example in which, when photographing is performed by using the mobile terminal1sideways, the cavity portion83is disposed at a position where the touch panel21is easy to be operated by a thumb. However, the cavity portion is limited thereto, and may be disposed anywhere as long as a position is easy to be operated other than the finder portions82aand82c. However, the opening portions81aand81cand the cavity portion83are preferably disposed such that a portion of the viewer80other than the opening portions81aand81cand the cavity portion83is detected by the proximity sensor31at the time of mounting.

FIG.12Ais a diagram illustrating an example of a display of the photographing mode in a case where the viewer80is mounted. On the display8, imaging regions91aand91c, the setting buttons61to63, and the shutter button65are displayed, but the setting buttons61to63and the shutter button65are the same as described with reference toFIG.6A. Then, the setting buttons61to63and the shutter button65are displayed in a region90corresponding to the cavity portion83.

Each of the imaging region91aand the imaging region91cis a display of the range imaged by the imaging unit3aand the imaging unit3c. When the viewer80is mounted, the imaging regions are displayed at positions where the display of the imaging region91ais viewed through the opening portion81a, and the display of the imaging region91cis viewed through the opening portion81c. Although a subject94aand a subject94care the same objects, the images are imaged by the imaging unit3aand the imaging unit3c, so that the images are displayed from positions having different angles.

Then, the image data, which has been imaged and obtained by the imaging unit3a, is displayed as the subject94ain the imaging region91a, so that the display of the subject94ais viewed through the finder portion82aby the left eye, and the image data, which has been imaged and obtained by the imaging unit3c, is displayed as the subject94cin the imaging region91c, so that the display of the subject94ais viewed through the finder portion82cby the right eye. In this way, the image data can be viewed as 3D images.

Incidentally, in a case where the viewer80is not mounted in the photographing mode, the image data cannot be viewed as 3D images, so that there may be provided a display including the imaging region66aillustrated inFIG.6A, instead of two displays of the imaging region91aand the imaging region91c. In order to display the imaging region66a, image data, which has been imaged and obtained by either the imaging unit3aor the imaging unit3c, may be displayed.

The display of each of the imaging region91aand the imaging region91cis smaller than the display of the imaging region66aand the display of each of the subject94aand the subject94cmay be reduced to be smaller than the display of the subject67a. The display size of the imaging region91aand the imaging region91cmay be the same size. Further, the mounting of the viewer80may be detected by the proximity sensor31and the display screen may be switched.

FIG.12Bis a diagram illustrating an example of the display of the reproducing mode in a case where the viewer80is mounted. In the display ofFIG.12B, the same displays as those inFIG.12Aare denoted by the same reference numerals, and the descriptions thereof will not be repeated. However, the setting buttons61to63may be operation menus for reproduction. Alternatively, the setting buttons may be a display of setting contents at the time of photographing an image to be reproduced. A selection button95for a recorded image, which has been displayed instead of the shutter button65, is a display for input used for selecting an image to be reproduced.

The display regions93aand93care displays of images to be reproduced, and in a case where imaging is performed in the display state illustrated inFIG.12A, subjects94dand94eare displayed in the same way as the subjects94aand94cillustrated inFIG.12A. Further, the display regions93aand93care displayed at the same positions as the imaging regions91aand91c. In this way, the image data can be seen as 3D images in the same way as described with reference toFIG.12A.

The imaging regions92aand92care displays of images imaged by the imaging units3aand3c. Also, in the reproducing mode, imaging is performed by the imaging units3aand3c, and the imaged image is combined with a portion of the display regions93aand93cin real time to be displayed. In a case where the viewer80is used at the time of reproduction, light is shielded by the finder portions82aand82c, so that the surroundings are not viewed. However, the imaging regions92aand92care superimposed and displayed on the display regions93aand93c, so that it is possible to confirm the surrounding situations while viewing 3D reproduction images. This synthesis and superimposition may be performed by the image/audio signal processing circuit5.

Incidentally, the display of the imaging regions92aand92cin the reproducing mode may be switched on or off by a setting button or the like (not illustrated). Further, in the photographing mode, a reproduction image may be superimposed and displayed on a portion of the imaging regions91aand91c.

Since a positional relationship between the lens units2aand2c, the mobile terminal1, and the viewer80mounted on the mobile terminal1is fixed, in the photographing mode, the viewer is in a state of looking into a direction in which the lens units2aand2care directed. Also, in the reproducing mode, as in this state, the display images of the display regions93aand93cmay be changed according to the direction in which the lens units2aand2care directed.

Here, the direction in which the lens units2aand2care directed is also a direction of the viewer80and the mobile terminal1, a posture of the mobile terminal1is detected by the posture detection unit7, and a viewing direction of the viewer80mounted on the mobile terminal1is specified. Then, for example, out of the image data obtained by imaging at a super wide angle, that is, the image data recorded in a photographing direction, an image is cut out according to the direction in which the viewer80is directed, and the cut out image may be displayed in the display regions93aand93c.

The image data obtained by imaging at a super wide angle may be obtained by imaging by the mobile terminal1with the lens units2aand2cusing super wide angle lenses, or the images obtained by imaging by other apparatuses may be taken in. Further, for example, it is possible to reproduce image data of so-called full sky type images having a field angle of 360 degrees, and to view the images in 3D in a direction corresponding to the direction in which the viewer80is directed while observing the images using the viewer80, so that the user can enjoy images with realistic feelings.

Incidentally, also in this case, as described with reference toFIG.12B, since the images imaged by the imaging units3aand3care superimposed and displayed on the reproduction image, it is possible to confirm the surrounding situations and to enhance safety. Further, the images are imaged by one of the imaging unit3aand the imaging unit3cof the mobile terminal1illustrated inFIGS.9and10of the present embodiment, so that a display may be performed as illustrated inFIGS.6A,6B,7A, and7Bof Embodiment 1. The viewer40illustrated inFIG.4and the viewer80illustrated inFIG.11may be selectively used depending on whether either or both of the imaging unit3aand the imaging unit3bis used.

According to Embodiment 2, as described above, it is possible to view an imaging target in 3D images in photographing of the 3D images and also view the 3D images in the reproduction of the 3D images by the viewer80. In particular, it is not necessary to provide two electronic viewfinders, and it is possible to use the viewer80with a simple structure and at a low cost.

Incidentally, in Embodiments 1 and 2, the mobile terminal1includes a general-purpose machine such as a tablet terminal or smartphone having an imaging unit. However, in addition to these, the present invention is also applicable to an imaging apparatus including a dedicated machine for mainly imaging, such as a digital camera or a video camera.

According to the present invention, a portion of the display can be used in the same manner as the electronic viewfinder by mounting the viewer on the mobile terminal having the imaging unit. Therefore, it is easy to monitor images even in bright outdoors. Further, the display screen may be automatically switched between a case where the viewer is used and a case where the viewer is not used. Thereby, it is possible to provide a user-friendly mobile terminal and an imaging apparatus.

REFERENCE SIGNS LIST

1Mobile terminal2a,2b,2cLens unit3a,3b,3cImaging unit4Interface circuit8Display31Proximity sensor40,80Viewer42a,42b,82a,82cFinder portion43,83Cavity portion