Image pickup apparatus that performs image pickup control for case where faces of multiple persons are detected at the time of image pickup, control method therefor, and storage medium

An image pickup apparatus which is capable of preventing faces of persons from being partially cut off in an image at the time of image pickup in a case where a subject includes a plurality of persons. The image pickup apparatus has a plurality of lenses with different angles of view including at least a first lens and a second lens. A first image is generated by shooting the subject through the first lens. It is determined whether or not in the subject included in the first image, a person is partially cut off. When it is determined that the person is partially cut off, the lens is switched from the first lens to the second lens with a wider angle of view than that of the first lens to shoot the subject and generate a second image.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to an image pickup apparatus, a control method therefor, and a storage medium, and in particular to an image pickup apparatus that performs image pickup control for case where faces of multiple persons are detected at the time of image pickup, a control method therefore, and a storage medium.

Description of the Related Art

Conventionally, a photographer shoots a subject including himself/herself (“selfie”) using an image pickup apparatus such as a smartphone (see Japanese Laid-Open Patent Publication (Kokai) No. 2019-54447). To take a selfie, a photographer usually holds a smartphone and extends his/her arm to shoot a subject (including himself/herself), or shoots a subject while holding a selfie stick with a smartphone attached thereto.

When taking a selfie to shoot subject including multiple persons using one of the above methods, a problem arises because the face of a person at an edge of the angle of view is partially out of the angle of view, and hence the face is partially cut off in a resulting image (what is called “cut-off”).

SUMMARY OF THE INVENTION

The present invention provides an image pickup apparatus that is capable of preventing faces of persons from being partially cut off in an image at the time of image pickup in a case where a subject includes a plurality of persons, a control method therefor, and a storage medium.

Accordingly, the present invention provides (claim1) an image pickup apparatus equipped with a plurality of lenses with different angles of view including at least a first lens and a second lens, the image pickup apparatus comprising at least one memory that stores a set of instructions, and at least one processor that executes the instructions, the instructions, when being executed, causing the image pickup apparatus to: generate a first image by shooting a subject through the first lens; determine whether or not there is cut-off on a person in the subject included in the first image; and when it is determined that there is cut-off on the person, switch from the first lens to the second lens with a wider angle of view than that of the first lens, shoot the subject, and generate a second image.

According to the present invention, at the time of image pickup in a case where a subject includes a plurality of persons, faces of the persons are prevented from being partially cut off in an image.

DESCRIPTION OF THE EMBODIMENTS

The present invention will now be described in detail below with reference to the accompanying drawings showing embodiments thereof. In the following description, a smartphone is taken as an example of an image pickup apparatus according to the present invention; however, the present invention is not limited to the smartphone.

FIG.1Ais a front view showing an external appearance of a smartphone100according to the embodiments, andFIG.1Bis a rear view showing the external appearance of the smartphone100.

A display105, a touch panel106a, a speaker112b, a front camera115, and a home button106eare disposed on a front surface (a first surface) of the smartphone100. The touch panel106ais laid over the display105, and the front camera115has a telescope lens115a, a standard lens115b, and an ultrawide angle lens115c.

An audio output terminal112ais provided on a lower surface of the smartphone100. A power button106b, a volume up button106c, and a volume down button106dare provided on a side of the smartphone100. A rear camera114is disposed on a rear surface (a second surface) of the smartphone100. The rear camera114has a telescope lens114a, a standard lens114b, and an ultrawide angle lens114c. Descriptions of functions and others of these components the smartphone100has will be given later with reference to a block diagram ofFIG.2schematically showing an arrangement of the smartphone100. Note that the layout of the telescope lens115a, the standard lens115b, and the ultrawide angle lens115cof the front camera115inFIG.1Aand the layout of the telescope lens114a, the standard lens114b, and the ultrawide angle lens114cof the rear camera114inFIG.1B, are just shown as examples, and layouts different from them may be used.

FIG.2is a block diagram schematically showing the arrangement of the smartphone100. The smartphone100has a CPU201, a memory202, a nonvolatile memory203, a display105, a posture detecting unit213, an operating unit106, a storage medium I/F207, an external I/F209, a communication I/F210, and an audio output unit112. The smartphone100also has the rear camera114, the front camera115, a rear camera image processing unit214, and a front camera image processing unit215. These components that the smartphone100has are each connected to an internal bus150and are configured to exchange data with one another via the internal bus150.

The CPU201is a control unit that controls the overall operation of the smartphone100and is comprised of at least one processor or circuit. The memory202is, for example, a RAM. The nonvolatile memory203stores image data, audio data, other data, various programs for operation of the CPU201, and so forth. The nonvolatile memory203is comprised of, for example, flash memory or a ROM. The CPU201integratedly controls the components of the smartphone100by developing programs stored in the nonvolatile memory203into a work area of the memory202.

The display105, which is a display device such as a liquid crystal display or an organic EL display, displays shot images, GUI screens, and so forth under the control by the CPU201. For example, the CPU201generates a display control signal according to a program, and controls the components of the smartphone100to generate an image signal for displaying an image to be displayed on the display105and output it to the display105. The display105displays an image in accordance with the output image signal. The display105is also capable of displaying a Live View image (LV image), which is being taken by the front camera115or the rear camera114, on the display105. In other words, a user can take an image while looking at an LV image displayed on the display105.

The operating unit106includes the touch panel106a, the power button106b, the volume up button106c, the volume down button106d, and the home button106e.

The touch panel106, which is flat and laid over the display105, detects a touch operation made on a display surface (operating surface) of the display105and outputs a position of contact by the touch operation as coordinate information to the CPU201. A keyboard, an icon, and so forth that can be displayed on the display105function as a part of the operating unit106through operations on the touch panel106a.

Note that various methods such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method can be used for the touch panel106a. Touch operations on the touch panel106acan be detected by either a method in which a touch is detected upon actual contact (a contact method), or a method in which a touch is detected upon approach (a non-contact method).

The power button106bis an operating means for turning on and off the display105, and is also an operating means for turning on and off the power to the smartphone100in response to being depressed for a certain period of time (for example, three seconds) (what is called “holding down”). The volume up button106cand the volume down button106dare operating means for adjusting the volume of sound to be output from the audio output unit112. When the volume up button106cis depressed, the volume of output sound increases, and when the volume down button106dis depressed, the volume of output sound decreases. In a shooting standby mode when the camera is in use, the volume up button106cand/or the volume down button106dfunctions as a shutter button that issues an instruction to perform shooting. Note that the user of the smartphone100can configure settings, for example, on an operation of simultaneous depression of the power button106band the volume down button106d, and on an operation of quick repeated depression of the volume down button106d, such that specific functions are performed.

The home button106eis an operating means for displaying a home screen, which is a startup screen of the smartphone100, on the display105. By depressing the home button106ein a case where various applications have been started and run in the smartphone100, the various applications that are running are temporarily closed and the home screen is displayed. Note that although in the embodiment, the home button106eis presented as a button that can be physically depressed, the present invention is not limited to this. The home button106emay be, for example, a button that is displayed on the display105and caused to function similarly to the physical home button106eby touch operations.

The audio output unit112includes the audio output terminal112aand the speaker112b. The speaker112boutputs sounds of video and music data, operating sounds, ring tones, various notification sounds, and so forth. The audio output terminal112ais a terminal that outputs sound to headphones, earphones, external speakers, and so forth (what is called a “headphone jack”). When no audio output speaker such as a headphone is connected to the audio output terminal112a, sound is output from the speaker112b. Note that sound may be output through wireless communication or the like, and for example, sound is output to speakers or earphones (headphones) through Bluetooth (registered trademark).

A storage medium108is, for example, a memory card mounted on a main body of the smartphone100or an internal storage incorporated in the smartphone100. The storage medium I/F207is an interface for reading data from the storage medium108and writing data on the storage medium108under the control of the CPU201. The external I/F209is an interface for communicateably connecting the smartphone100and external equipment together via a connecting cable or via wireless communication such that they can communicate with each other to input/output image signals, audio signals, and so forth. The communication I/F210is an interface for connecting to a communication network such as the Internet211.

The posture detecting unit213detects a posture of the smartphone100with respect to a gravitational direction, and a tilt and turn of the smartphone100with respect to each of yaw, roll, and pitch axes. Based on detection signals from the posture detecting unit213, whether the smartphone100is held in horizontal position or held in vertical position, whether the surface of the display105faces upward, faces downward, or is diagonally positioned, and so forth can be determined. At least one of sensors such as an acceleration sensor, a gyro sensor, a geomagnetic sensor, an orientation sensor, and an altitude sensor can be used as the posture detecting unit213, and a plurality of them can also be used in combination.

In the rear camera114, an image pickup device is disposed for each of the telescope lens114a, the standard lens114b, and the ultrawide angle lens114c. Namely, the rear camera114is a collection of three cameras capable of taking images through the respective lenses.

In the rear camera114, the focal length of the telescope lens114ais longer than that of the standard lens114b. Thus, by using the telescope lens114a, it is possible to take an image of a subject farther away in an enlarged manner than in the case where the standard lens114bis used. Moreover, the focal length of the ultrawide angle lens114cis shorter than that of the standard lens114b. Thus, by using the ultrawide angle lens114c, it is possible to take an image in a wider range than in the case where the standard lens114bis used. Namely, the focal length becomes shorter, and accordingly, the angle of view becomes wider in the following order: the telescope lens114a, the standard lens114b, and the ultrawide angle lens114c.

Note that in the embodiment, the telescope lens114a, the standard lens114b, and the ultrawide angle lens114care lenses each having a zooming function and capable of continuously changing the angle of view in photography in a range between the telephoto side and the wide angle side. However, this is not limitative, but the telescope lens114a, the standard lens114b, and the ultrawide angle lens114cmay be configured to optically zoom at the same magnification in aspect ratio at a predetermined magnification, or their magnifications may be changed by the user.

In the front camera115, an image pickup device is disposed for each of the telescope lens115a, the standard lens115b, and the ultrawide angle lens115c. Namely, the front camera115is a collection of three cameras capable of taking images through the respective lenses.

In the front camera115, the focal length of the telescope lens115ais longer than that of the standard lens115b. Thus, by using the telescope lens115a, it is possible to take an image of a subject farther away in an enlarged manner than in the case where the standard lens115bis used. Moreover, the focal length of the ultrawide angle lens115cis shorter than that of the standard lens115b. Thus, by using the ultrawide angle lens115c, it is possible to take an image in a wider range than in the case where the standard lens115bis used. Namely, the focal length becomes shorter, and accordingly, the angle of view becomes wider in the following order: the telescope lens115a, the standard lens115b, and the ultrawide angle lens115c.

Note that in the embodiment, the telescope lens115a, the standard lens115b, and the ultrawide angle lens115care lenses each having a zooming function and capable of continuously changing the angle of view in photography in a range between the telephoto side and the wide angle side. However, this is not limitative, but the telescope lens115a, the standard lens115b, and the ultrawide angle lens115cmay be configured to optically zoom at the same magnification in aspect ratio at a predetermined magnification, or their magnifications can be changed by the user.

Note that the smartphone100is capable of simultaneously taking images through all of the telescope lens114a, the standard lens114b, the ultrawide angle lens114c, the telescope lens115a, the standard lens115b, and the ultrawide angle lens115. However, this is not limitative, but the smartphone100may simultaneously take images through two to five lenses selected from among the six lenses and also take images through one lens.

Both of LV images obtained through the rear camera114and LV images obtained through the front camera115can be displayed on the display105. Through operation on the touch panel106a, the user can select a lens by which an image to be displayed on the display105is taken. For example, by selecting the telescope lens114a, an image enlarged to a larger extent than an image taken by the standard lens114bcan be displayed on the display105. By selecting the standard lens114b, an image in a wider angle than an image taken by the telescope lens114aand enlarged to a larger extent than an image taken by the ultrawide angle lens114c, can be displayed on the display105. By selecting the ultrawide angle lens114c, an image in a wider angle than an image taken by either the telescope lens114aor the standard lens114bcan be displayed on the display105. Note that in general, the rear camera114is used to take an image of a scene in front of oneself, and the front camera115is used to take an image of a photographer himself/herself (selfie).

The rear camera image processing unit214performs various types of image processing, a subject recognition process, and so forth on images, which are taken by the rear camera114, under the control of the CPU201. The rear camera image processing unit214has a telescope lens image processing unit214a, a standard lens image processing unit214b, and an ultrawide angle lens image processing unit214c. The telescope lens image processing unit214aperforms various types of image processing on images taken through the telescope lens114a. Likewise, the standard lens image processing unit214bperforms various types of image processing on images taken through the standard lens114b, and the ultrawide angle lens image processing unit214cperforms various types of image processing on images taken through the ultrawide angle lens114c.

The front camera image processing unit215performs various types of image processing, a subject recognition process, and so forth on images, which are taken by the front camera115, under the control of the CPU201. The front camera image processing unit215has a telescope lens image processing unit215a, a standard lens image processing unit215b, and an ultrawide angle lens image processing unit215c. The telescope lens image processing unit215aperforms various types of image processing on images taken through the telescope lens115a. Likewise, the standard lens image processing unit215bperforms various types of image processing on images taken through the standard lens115b, and the ultrawide angle lens image processing unit215cperforms various types of image processing on images taken through the ultrawide angle lens115c.

Note that although in the present embodiment, respective image processing units are provided for the three lenses of the rear camera114, the present invention is not limited to this arrangement. For example, one image processing unit may be provided for two of the three lenses, and one image processing unit may be provided for the other one lens. Alternatively, one image processing unit may be provided for the three lenses. The front camera image processing unit215may also have the similar arrangement.

The rear camera image processing unit214and the front camera image processing unit215may perform various types of image processing on images stored in the nonvolatile memory203and the storage medium108, image signals obtained through the external I/F209, images obtained through the communication I/F210, and so forth. Examples of the image processing performed by the rear camera image processing unit214and the front camera image processing unit215include an A/D conversion process, a D/A conversion process, an image data encoding process, a compression process, a decoding process, an enlargement/reduction process (resizing), a noise reduction process, and a color conversion process.

Note that the rear camera image processing unit214and the front camera image processing unit215may be comprised of dedicated circuit blocks for performing specific image processing. Alternatively, the rear camera image processing unit214and the front camera image processing unit215may be integrated into one processing block, and this processing block may be configured to carry out all of various processes on images obtained by the respective lenses through parallel processing or time-sharing processing. Moreover, depending on types of image processing, the CPU201may be configured to perform image processing in accordance with programs in place of the rear camera image processing unit214and the front camera image processing unit215.

A description will now be given of image pickup control using the front camera115.FIG.3is a flowchart of image pickup control using the front camera115according to the first embodiment. Processes (steps) represented by “S” numbers in the flowchart ofFIG.3are implemented by the CPU201developing predetermined programs stored in the nonvolatile memory203into the memory202to integratedly control the operation of the components of the smartphone100.

In S301, in response to a user operation, the CPU201switches (shifts) a shooting mode to a mode in which images are taken with the front camera115. In S302, the CPU201drives a lens that is set as a default lens in the front camera115. It is assumed here that the standard lens115bis set as the default lens. In S303, the CPU201obtains an image (an LV image) using the standard lens115bof the front camera115. In S304, the CPU201causes the standard lens image processing unit214bto detect (areas of) faces of persons from the image obtained in S303. Note that face detection can be performed using a known art, and hence detailed description thereof is omitted here.

In S305, the CPU201causes the standard lens image processing unit214bto count the number of faces detected in S304. In S306, the CPU201causes the standard lens image processing unit214bto determine whether or not the number of faces counted in S305is plural. When it is determined that the number of faces counted is not plural (NO in S306), the CPU201proceeds the process to S307. In S307, the CPU201takes an image with the front camera115. Then, in S308, the CPU201writes and records the shot image on the storage medium108via the storage medium I/F207, and ends the present process.

When it is determined in S306that the number of faces counted is plural (YES in S306), the CPU201proceeds the process to S309. In S309, the CPU201causes the standard lens image processing unit214bto determine whether or not there is any face having “partial cut-off” occurred out of the plurality of faces detected in S304(whether or not at least one face is partially cut off, that is, at least one face has a missing part). When it is determined that there is no face having partial cut-off occurred (NO in S309), the CPU201proceeds the process to S307, and when it is determined that there is a face having partial cut-off occurred (YES in S309), the CPU201proceeds the process to S310.

In S310, the CPU201displays, on the display105, a notification indicating that the zoom magnification will be changed to a magnification on the wide angle side. Then, in S311, the CPU201determines whether or not the zoom magnification of the lens being in use is a magnification on the widest angle side. In a case where the determination in S311is made for the first time, an image was taken by the standard lens115b, and hence the CPU201determines whether or not the zoom magnification of the standard lens115bis a magnification on the widest angle side.

When determining that the zoom magnification of the lens being in use is not a magnification on the widest angle side (NO in S311), the CPU201proceeds the process to S312. In S312, the CPU201changes the zoom magnification of the lens to a magnification on a wider angle side, and after that, the CPU201return the process to S303. Thus, the processes in S303and the subsequent steps are carried out again based on the image obtained in S303, and hence, for example, even if the number of faces in the angle of view increases or decreases between S303last time and S303this time, a process that deals with the increase or decrease can be carried out.

When determining in S311that the zoom magnification of the lens being in use is a magnification on the widest angle side (YES in S311), the CPU201proceeds the process to S313. In S313, the CPU201determines whether or not there is a lens capable of taking wide angle shots as compared to the lens being in use. When determining that there is a lens capable of taking wide angle shots as compared to the lens being in use (YES in S313), the CPU201proceeds the process to S314. When determining that there is no lens capable of taking wide angle shots as compared to the lens being in use (NO in S313), the CPU201proceeds the process to S315.

In S314, the CPU201changes the lens for use in image pickup from the lens being in use to the lens capable of taking wider angle shots, and then returns the process to S303. In S315, the CPU201displays, on the display105, a notification indicating that at least one face has partial cut-off occurred (alarm screen), to notify the user of the partial cut-off, and then proceeds the process to S307. Note that the notification in S315may be provided using light (when the smartphone100has a light-emitting unit) and/or sound (output from the speaker112b) as a substitute for or in combination with the display on the display105.

As described above, in the image pickup control according to the first embodiment, the zoom magnification of the lens being in use is automatically adjusted, and/or the lens being in use is automatically replaced with the lens capable of taking wider angle shots so that the zoom magnification can be a maximum magnification at which a face can fit in the angle of view without being partially cut off. This prevents the face of a subject (person) from being partially cut off at the time of image pickup.

The image pickup control in the case where an image is taken using the front camera115has been described. Likewise, in the case where an image is taken using the rear camera114, the same image pickup control can be performed to prevent the face of a subject (person) from being partially cut off at the time of image pickup.

In the embodiment described above, each of the rear camera114and the front camera115is configured to have a plurality of lenses with different angles of view. A description will now be given of image pickup control in a case where each of the rear camera114and the front camera115is comprised of a monocular lens capable of optically zooming.

FIG.4is a flowchart of the image pickup control according to a second embodiment using the front camera115. In the present embodiment, it is assumed that the front camera115has only the standard lens115bfor the convenience of explanation. Processes (steps) represented by “S” numbers in the flowchart ofFIG.4are implemented by the CPU201developing predetermined programs stored in the nonvolatile memory203into the memory202to integratedly control the operation of the components of the smartphone100.

The process in S401is the same as the process in S301in the flowchart ofFIG.3, and hence description thereof is omitted. In S402, the CPU201sets the standard lens115bat a zoom magnification allowed to be changed toward an intermediate or wide angle side (that is, a zoom magnification on the telephoto side), and drives the standard lens115b. The processes in S403to S409are the same as the processes in S303to S309in the flowchart ofFIG.3, and hence descriptions thereof are omitted.

When it is determined in S409that there is at least one face having partial cut-off occurred (YES in S409), the CPU201proceeds the process to S410. In S410, the CPU201determines whether the zoom magnification of the standard lens115bis a magnification on the widest angle side. When determining that the zoom magnification of the standard lens115bis not a magnification on the widest angle side (NO in S410), the CPU201proceeds the process to S411.

In S411, the CPU201displays, on the display105, a notification indicating that the zoom magnification of the standard lens115bwill be changed to a magnification on a wider angle side. Then, in S412, the CPU201changes the zoom magnification of the standard lens115bto a magnification on a wider angle side than the present zoom magnification by a predetermined magnification, and then returns the process to S403.

When determining in S410that the zoom magnification of the standard lens115bis a magnification on the widest angle side (YES in S410), the CPU201proceeds the process to S413. The process in S413is the same as the process in S315in the flowchart ofFIG.3, and hence description thereof is omitted. After carrying out the process in S413, the CPU201proceeds the process to S407. The processes in S407and the subsequent step S408are the same as the processes in S307and S308in the flowchart ofFIG.3, and hence descriptions thereof are omitted.

As described above, in the image pickup control according to the second embodiment, the zoom magnification of the lens is automatically adjusted so that the zoom magnification can be a maximum magnification at which a face can fit in the angle of view without being partially cut off, which prevents the face of a subject (person) from being partially cut off at the time of image pickup. The image pickup control in the case where an image is taken using the front camera115has been described. Likewise, in the case where an image is taken using the rear camera114, the same image pickup control can be performed to prevent the face of a subject (person) from being partially cut off at the time of image pickup.

FIG.5AandFIG.5Bare views showing examples of transition of images obtained by the image pickup control in accordance with the flowcharts ofFIG.3andFIG.4.FIG.5Ashows an example of an LV image in which cut-off is occurred on faces of persons in S309(or S409). The CPU201instructs an image processing unit for a lens being in use to display face detection frames504correspondingly to faces detected in the face detection process in S304(or S404), on the display105in a manner being superimposed on the LV image. When, for example, a part of the face detection frames504is not displayed on the display105, the CPU201determines that partial cut-off is occurred on a face.

InFIG.5A, faces of persons501and502are partially cut off while a face of a person503is not cut off. When it is determined in S309(or S409) that a face is partially cut off, the zoom magnification is changed to a zoom magnification on the wide angle side in S312(or S412), or the lens is replaced with a lens capable of taking wider angle shots in S314, so that an image inFIG.5Bcan be obtained. Namely,FIG.5Bshows an example of an LV image obtained by changing the angle of view to the wide angle side from the LV image inFIG.5A. InFIG.5B, there is no face that is partially cut off.

In the above-described examples illustrated inFIG.3,FIG.4,FIG.5A, andFIG.5B, whether or not there is any face that is partially cut off is determined to take an image in which no face is partially cut off; however, a target of the determination of cut-off may be the whole body of a person, which makes it possible to obtain an image in which the whole body is not partially cut off.

FIG.5Cshows an example of an image with no cut-off on the determination target obtained by setting the determination target of cut-off as the whole body of a person. In the case where the determination target of cut-off is the whole body of a person, the CPU201detects (the region of) the whole body of a person in S309(or S409). The whole body of a person can be detected using a well-known method. For example, a method in which the face of a person is detected first, and then the whole body is estimated by pattern matching or the like based on the detected face, or a method described in Japanese Laid-Open Patent Publication (Kokai) No. 2019-54447, can be used to detect the whole body of a person. After that, by adjustment of the zoom magnification of the lens and/or switch of the lenses, the magnification to be used is changed to the wide angle side, so that the estimated whole body can fit in the angle of view. As a result, an image in which the whole body of a person is not cut off is obtained as shown inFIG.5C.

Although the present invention has been described in detail by way of the preferred embodiments, the present invention should not be limited to the specific embodiments described above. The present invention also encompasses various forms without departing from the spirits of the present invention. Moreover, the embodiments described above are merely illustrative embodiments of the present invention, and the embodiments may be used in combination as appropriate.

For example, the user may set, via the operating unit106, the number of persons (faces) to be detected from a picked-up image as the number of persons who are going to be subjects, and the CPU201may determine that partial cut-off is occurred on a person (face) when the number of persons (faces) counted in S305or S405is smaller than the set number of persons (faces) to be detected. Namely, the determination is made based on the premise that when the face of a person is partially cut off and does not entirely fit in the angle of view, all of elements required to recognize the face of the person do not exist within the angle of view, and hence the face of the person is not detected as a face of a targeted person. In this case, the determinations in S306, S309, S406, and S409are not performed. In this case, the CPU201compares the counted number of persons with the set number of persons to be detected. When the counted number of persons is smaller than the set number of persons to be detected, the CPU201determines that there is a person (face) who is partially cut off, and carries out the processes in S310and the subsequent steps. When the counted number of persons is equal to or greater than the set number of persons to be detected, the CPU201determines that a person (face) has no cut-off portion, and carries out the processes in S307and the subsequent steps. Thus, even when the number of persons is not plural but singular, whether or not a face is partially cut off can be determined, and shooting can be prevented from being performed with a face partially cut off.

Moreover, although in the embodiments described above, it is assumed that each of the telescope lens114a, the standard lens114b, and the ultrawide angle lens114cin the rear camera114has a zooming function, at least one of these lenses may be a single-focus lens. The same holds for the front camera115. When the single-focus lens is used, the result of the determination in S311is always positive (YES).

Furthermore, although in the embodiments described above, it is assumed that whenever cut-off is occurred, the process in which the zoom magnification is automatically changed to the wide angle side is carried out; however, this function of the smartphone100may be enabled or disabled (may be set enabled or disabled) through user operation on the operating unit106.

In addition, although in the embodiments described above, the present invention is applied to the smartphone, the present invention can be applied to any electronic devices as long as they have a display and a camera. Thus, the present invention can be applied to, for example, a tablet PC, a PDA, and a digital camera. It goes without saying that depending on electronic devices to which the present invention can be applied, arrangements of members and others constituting operating means for operating the electronic devices may be different from those of the operating unit106illustrated inFIG.2. Moreover, as for an arrangement relating to image output from an electronic device according to the present invention, an external monitor may be used as a display (display device). In this case, the electronic device may have an interface for outputting image signals to be displayed on the display.

Other Embodiments

This application claims the benefit of Japanese Patent Application No. 2021-172318, filed on Oct. 21, 2021, which is hereby incorporated by reference herein in its entirety.