Control method, control device and electronic device

The present disclosure provides a control method, a control device and an electronic device. The wide-angle camera is started first. Then, the displayer is controlled to display a cached wide-angle image as a preview image. Next, a designated area is identified and the telephoto camera is started during zooming the preview image. Further, the actuator is controlled such that a cached telephoto image is located in the designated area, and the wide-angle camera and telephoto camera are controlled to image respectively. Finally, the wide-angle image and telephoto image are combined. With the control method and device and the electronic device in the present disclosure, the telephoto camera may image the designated area when the user zooms the designated area of the cached wide-angle image, thereby enhancing sharpness of the designated area and improving the user experience.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority to Chinese Patent Application Serial No. 201611079316.X, filed on Nov. 29, 2016, the entire contents of which are incorporated herein by reference.

FIELD

The present disclosure relates to the imaging technology field, and more particularly, to a control method, a control device and an electronic device.

BACKGROUND

A dual-camera generally includes a wide-angle camera and a telephoto camera. A field of view of the telephoto camera is located within a field of view of the wide-angle camera. Therefore, an image output by the telephoto image may be combined with a corresponding portion of a wide-angle image output by the wide-angle camera to enhance sharpness of the corresponding portion. However, in the related art, this image combining is not intelligent enough, and the user experience is poor.

SUMMARY

The control method is applied for controlling an electronic device. The electronic device includes an imaging device, a displayer and an input device. The imaging device includes a wide-angle camera, a telephoto camera and an actuator. A field of view of the wide-angle camera has an overlapped portion with a field of view of the telephoto camera. The actuator is configured to actuate relative movement of the wide-angle camera and/or the telephoto camera for changing a relative location of the overlapped portion in the field of view of the wide-angle camera. The control method includes: starting the wide-angle camera and closing the telephoto camera; controlling the displayer to display a cached wide-angle image output by the wide-angle camera as a preview image; processing a user input of the input device to determine whether to zoom the preview image; identifying a designated area and starting the telephoto camera during zooming the preview image; controlling the actuator such that a cached telephoto image output by the telephoto camera is located in the designated area; controlling the wide-angle camera to capture a wide-angle image and controlling the telephoto camera to capture a telephoto image, according to a user input; and combining the wide-angle image and the telephoto image to enhance sharpness of an overlapped portion between the wide-angle image and the telephoto image.

The control device is applied for controlling an electronic device. The electronic device includes an imaging device, a displayer and an input device. The imaging device includes a wide-angle camera, a telephoto camera and an actuator. A field of view of the wide-angle camera has an overlapped portion with a field of view of the telephoto camera. The actuator is configured to actuate relative movement of the wide-angle camera and/or the telephoto camera for changing a relative location of the overlapped portion in the field of view of the wide-angle camera. The control device includes a non-transitory computer-readable medium comprising computer-executable instructions stored thereon; and an instruction execution system, which is configured by the instructions to implement at least one of a first control module, a second control module, a processing module, a third control module, a fourth control module, a fifth control module and a combining module. The first control module is configured to start the wide-angle camera and to close the telephoto camera. The second control module is configured to control the displayer to display a cached wide-angle image output by the wide-angle camera as a preview image. The processing module is configured to process a user input of the input device to determine whether to zoom the preview image. The third control module is configured to identify a designated area and start the telephoto camera during zooming the preview image. The fourth control module is configured to control the actuator such that a cached telephoto image output by the telephoto camera is located in the designated area. The fifth control module is configured to control the wide-angle camera to capture a wide-angle image and control the telephoto camera to capture a telephoto image, according to a user input. The combining module is configured to combine the wide-angle image and the telephoto image to enhance sharpness of an overlapped portion between the wide-angle image and the telephoto image.

The electronic device includes an imaging device, a displayer, an input device and the control device. The control device includes a non-transitory computer-readable medium comprising computer-executable instructions stored thereon; and an instruction execution system, which is configured by the instructions to implement at least one of a first control module, a second control module, a processing module, a third control module, a fourth control module, a fifth control module and a combining module. The first control module is configured to start the wide-angle camera and to close the telephoto camera. The second control module is configured to control the displayer to display a cached wide-angle image output by the wide-angle camera as a preview image. The processing module is configured to process a user input of the input device to determine whether to zoom the preview image. The third control module is configured to identify a designated area and start the telephoto camera during zooming the preview image. The fourth control module is configured to control the actuator such that a cached telephoto image output by the telephoto camera is located in the designated area. The fifth control module is configured to control the wide-angle camera to capture a wide-angle image and control the telephoto camera to capture a telephoto image, according to a user input. The combining module is configured to combine the wide-angle image and the telephoto image to enhance sharpness of an overlapped portion between the wide-angle image and the telephoto image.

ELEMENT LIST

DETAILED DESCRIPTION

Embodiments of the present disclosure will be described in detail in the following descriptions, examples of which are shown in the accompanying drawings, in which the same or similar elements and elements having same or similar functions are denoted by like reference numerals throughout the descriptions. The embodiments described herein with reference to the accompanying drawings are explanatory and illustrative, which are used to generally understand the present disclosure. The embodiments shall not be construed to limit the present disclosure.

FIG. 1illustrates a control method in at least one embodiment of the present disclosure.FIG. 2illustrates an imaging device in at least one embodiment of the present disclosure.FIG. 3illustrates functional modules of an electronic device in at least one embodiment of the present disclosure. As shown inFIGS. 1, 2 and 3, a control method provided in embodiments of the present disclosure may be applied for controlling an electronic device100. The electronic device100includes an imaging device10, a displayer22and an input device24. The imaging device10includes a wide-angle camera12, a telephoto camera14and an actuator16. A field of view of the wide-angle camera12and a field of view of the telephoto camera14have an overlapped portion13. The actuator16is configured to actuate relative movement of the wide-angle camera12and/or the telephoto camera14for changing a relative location of the overlapped portion13in the field of view of the wide-angle camera12. The control method includes following acts.

At block S31, the wide-angle camera is started and the telephoto camera is closed.

At block S32, the displayer is controlled to display a cached wide-angle image output by the wide-angle camera as a preview image.

At block S33, a user input of the input device is processed to determine whether to zoom the preview image.

At block S34, a designated area is identified and the telephoto camera is started during zooming the preview image.

At block S35, the actuator is controlled such that a cached telephoto image output by the telephoto camera is located in the designated area.

At block S36, the wide-angle camera is controlled to capture a wide-angle image and the telephoto camera is controlled to capture a telephoto image, according to a user input.

At block S37, the wide-angle image and the telephoto image are combined to enhance sharpness of an overlapped portion between the first image and the second image.

The control device30provided in embodiments of the present disclosure may be applied for controlling an electronic device100.

The control device30includes a non-transitory computer-readable medium (not shown) including computer-executable instructions stored thereon; and an instruction execution system (not shown), which is configured by the instructions to implement at least one of a first control module31, a second control module32, a processing module33, a third control module34, a fourth control module35, a fifth control module36, and a combining module37. The first control module31is configured to start the wide-angle camera12and to close the telephoto camera14.

The second control module32is configured to control the displayer22to display a cached wide-angle image output by the wide-angle camera12as a preview image. The processing module33is configured to process a user input of the input device24to determine whether to zoom the preview image. The third control module34is configured to identify a designated area and to start the telephoto camera14during zooming the preview image. The fourth control module35is configured to control the actuator16such that a cached telephoto image output by the telephoto camera14is located in the designated area. The fifth control module36is configured to control the wide-angle camera12to capture a wide-angle image and control the telephoto camera14to capture a telephoto image, according to a user input. The combining module37is configured to combine the wide-angle image and the telephoto image to enhance sharpness of the overlapped portion13between the wide-angle image and the telephoto image.

That is, the control method provided in embodiments of the present disclosure may be realized by the control device30provided in embodiments of the present disclosure. Block S31may be realized by the first control module31, block S32may be realized by the second control module32, block S33may be realized by the processing module33, block S34may be realized by the third control module34, block S35may be realized by the fourth control module35, block S36may be realized by the fifth control module36, and block S37may be realized by the combining module37.

In at least one embodiment, the control device30provided in the embodiments of the present disclosure may be applied for the electronic device100provided in the embodiments of the present disclosure, or the electronic device100provided in the embodiments of the present disclosure may include the control device30provided in the embodiments of the present disclosure.

The control method, the control device30and the electronic device100according to embodiments of the present disclosure may use the actuator16to control the relative movement of the wide-angle camera12and the telephoto camera14when the user performs the zooming, and change the relative location of the overlapped portion13in the field of view of the wide-angle camera12, and then combine the overlapped image portions to improve sharpness of the image portion, so that the telephoto camera14may image the designated area when the user zooms the designated area of the cached wide-angle image, thereby enhancing sharpness of the designated area and improving the user experience.

In at least one embodiment, the electronic device100includes a mobile phone or a tablet computer, which will not be limited herein. In at least one embodiment of the present disclosure, the electronic device100is the mobile phone.

In at least one embodiment, the imaging device10includes front dual cameras or rear dual cameras, which will not be limited herein.

In at least one embodiment, the displayer22and the input device24are integrated as a touch screen20. That is, the touch screen20may include the displayer22and the input device24.

In at least one embodiment, the angle of view of the wide-angle camera12is from 70 degree to 90 degree. The angle of view of the telephoto camera14is from 20 degree to 60 degree.

In at least one embodiment, the wide-angle camera12refers to a camera with a wide-angle lens, which generally has a shorter focal length and a larger angle of view. The angle of view of the wide-angle camera12in at least one embodiment of the present disclosure may be about 80 degree. The wide-angle camera12is generally configured to capture close-range scenes.

In at least one embodiment, the telephoto camera14refers to a camera with a telephoto lens, which generally has a longer focal length and a smaller angle of view. The angle of view of the telephoto camera14in at least one embodiment of the present disclosure may be about 20 degree. The telephoto camera14is generally configured to capture long-range scenes.

In at least one embodiment, the wide-angle camera12and the telephoto camera14may be arranged closely side-by-side, such that the field of view of the telephoto camera14is located within the field of view of the wide-angle camera12. That is, the whole telephoto image is located within the range of the wide-angle image.

In this way, the telephoto image of the telephoto camera14has a maximum proportion in the wide-angle image of the wide-angle camera12, such that image quality of the maximum area in the first image may be improved.

In at least one embodiment, the field of view of the wide-angle camera12and the field of view of the telephoto camera14are overlapped partially. That is, the wide-angle image and the telephoto image are overlapped partially, so that sharpness of the corresponding portion may be enhanced by combining the overlapped image portions.

Thus, the imaging device10may be applied in some special scenes, such as a scene in which it is required to enhance marginal sharpness of the wide-angle image to acquire a corresponding image with special effects.

In at least one embodiment, the actuator16includes a microelectromechanical motor or a mechanical motor.

In at least one embodiment, the wide-angle camera12is fixed, and the actuator16controls the telephoto camera14to rotate relative to the wide-angle camera12. In this way, the telephoto camera14may be rotated by the actuator16, such that the telephoto camera14may be controlled to image in alignment with the user-designated area when the user performs the zooming.

In at least one embodiment, the wide-angle camera12and the telephoto camera14may be at the same shooting angle after rotation, so that quality of the image obtained after combining the wide-angle image and the telephoto image may be improved, and problems such as ghosting may be avoided.

In at least one embodiment, the control device30closes the telephoto camera14when starting the wide-angle camera12.

In at least one embodiment, when the wide-angle camera12is working, the telephoto camera14may enter a dormant state or stop working, thus avoiding unnecessary power consumption and reducing a working space required when the imaging device10is working.

FIG. 4illustrates a control method in at least one embodiment of the present disclosure. As shown inFIG. 4, block S34includes following acts.

At block S342, the user input is processed to acquire an initial location.

At block S344, it is extended outward from the initial location to acquire the designated area having a same size as the telephoto image.

At block S346, the telephoto camera is started.

As illustrated inFIGS. 5(a) and 5(b), the cached wide-angle image is displayed as the preview image, and the cached telephoto image (b) is generated by the telephoto camera. When the preview image is zoomed, the initial location is identified according to the user input, as illustrated inFIG. 5(c). For example, the initial location may be a point having coordinates on the preview image. An extension is performed from the initial location, in which a rectangular defined by the dashed line has a same size with the cached telephoto image, as illustrated inFIG. 5(d). The rectangular defined by solid line is an intermediate example for acquiring the designated area.

That is to say, from the initial position, the designated area is acquired by extending outward from the initial location on the preview image such that the designated area surrounds the initial position and has a same size with a cached telephoto image output by the telephoto camera. That is to say, a portion of the preview image is selected from the initial position to acquire the designated area such that the designated area has a same size with the cached telephoto image.

In addition,FIG. 5(e)illustrates overlapped wide-angle image and telephoto image generated by combining the wide-angle and the telephoto image of an overlapped portion.

FIG. 6illustrates functional modules of an electronic device in at least one embodiment of the present disclosure. As shown inFIG. 6, the third control module34includes a processing unit342, an extending unit344and a starting unit346. The processing unit342is configured to process the user input to acquire an initial location. The extending unit344is configured to extend outward from the initial location to acquire the designated area having a same size as the telephoto image. The starting unit346is configured to start the telephoto camera14.

That is, block S342may be realized by the processing unit342, block S344may be realized by the extending unit344, and block S346may be realized by the starting unit346.

In at least one embodiment, the control device30controls the displayer22to display the cached wide-angle image, and then acquire the initial location in the cached wide-angle image based on the user input. The control device30extends outward based on the initial location to acquire the designated area having the same size as the telephoto image, that is, the area to be imaged by the telephoto camera14is acquired. The wide-angle camera12and the telephoto camera14capture images simultaneously, and the images in the designated area are combined, thereby enhancing sharpness of the image in the designated area.

In at least one embodiment, when the user performs the zooming, the control device30may start the telephoto camera14. Since a focus area of the telephoto camera14may be not the user-designated area (that is, the overlapped portion13of the wide-angle image and the telephoto image may be different from the user-designated area), the control device30controls the actuator16to drive the wide-angle camera12and/or the telephoto camera14, so that the telephoto camera14can image the user-designated area, that is, the overlapped portion13is moved to the user-designated area, and the imaging device10can perform an image combining on the overlapped portion13to improve the sharpness of the designated area.

FIG. 7illustrates a control method in at least one embodiment of the present disclosure. As shown inFIG. 7, block S36includes following acts.

At block S362, it is determined whether an imaging signal is received.

At block S364, when the imaging signal is received, the wide-angle camera is controlled to image under a first amount of exposure and the telephoto camera is controlled to image under a second amount of exposure simultaneously. The first amount of exposure is different from the second amount of exposure.

FIG. 8illustrates functional modules of an electronic device in at least one embodiment of the present disclosure. As shown inFIG. 8, the fifth control module36includes a determining unit362and a first control unit364. The determining unit362is configured to determine whether an imaging signal is received. The first control unit364is configured to control the wide-angle camera12to image under a first amount of exposure and control the telephoto camera14to image under a second amount of exposure simultaneously when the imaging signal is received, in which the first amount of exposure is different from the second amount of exposure.

That is, block S362may be realized by the determining unit362, and block S364may be realized by the first control unit364.

In at least one embodiment, whether the imaging signal is received may be determined by determining whether a photographing key is pressed or whether the user controls the imaging device10through the input device24, which is not limited herein.

In at least one embodiment, the wide-angle camera12and the telephoto camera14may work simultaneously. The overlapped portions of the wide-angle image and the telephoto image obtained at different times may be different, for example, a moving object appears or disappears. Thus, ghosting, image blurring and the like may occur after image combining. By making the wide-angle camera12and the telephoto camera14work simultaneously, the overlapped portions of the wide-angle image and the telephoto image obtained at different times may be basically the same, thereby avoiding a problem of quality deterioration after image combining.

In at least one embodiment, the first amount of exposure may be a long exposure, and the second amount of exposure may be a short exposure. By combining the long exposure image and the short exposure image, a high dynamic range image may be acquired and sharpness of the image may be improved.

In at least one embodiment, block S37may include followings. First, the overlapped portion of the wide-angle image and the overlapped portion of the telephoto image are extracted respectively. Then, pixel values in the overlapped portions of the wide-angle image and the telephoto image are calculated respectively using weighting values. The weighting values may be determined by a related module in the imaging apparatus10or may be set according to the user's beauty-appreciation and needs. Finally, the weighted pixel values of the wide-angle image and of the telephoto image may be added to acquire a high dynamic range image, thereby improving sharpness of the image.

In at least one embodiment, block S37may include followings. First, the overlapped portion of the wide-angle image and the overlapped portion of the telephoto image are extracted respectively. Then, pixels with a pixel value larger than a pixel threshold are extracted from the overlapped portion of the telephoto image. The pixel threshold value may be determined by a related module in the imaging apparatus10or may be set according to the user's beauty-appreciation and needs. Finally, corresponding pixels in the wide-angle image are replaced by the pixels extracted from the telephoto image, thereby acquiring a high dynamic range image and improving sharpness of the image.

FIG. 9illustrates a control method in at least one embodiment of the present disclosure. As shown inFIG. 9, the control method further includes following acts.

At block S38, it is determined whether a zoom ratio exceeds a predetermined zooming-in threshold.

At block S39, the displayer is controlled to display the cached telephoto image output by the telephoto camera as the preview image when the zoom ratio exceeds the predetermined zooming-in threshold.

FIG. 10illustrates functional modules of an electronic device in at least one embodiment of the present disclosure. As shown inFIG. 10, the control device30further includes a first determining module38and a sixth control module39. The first determining module38is configured to determine whether a zoom ratio exceeds a predetermined zooming-in threshold. The sixth control module39is configured to control the displayer22to display the cached telephoto image output by the telephoto camera14as the preview image when the zoom ratio exceeds the predetermined zooming-in threshold.

That is, block S38may be realized by the first determining module38, and block S39may be realized by the sixth control module39.

In at least one embodiment, when the imaging device10is working, the wide-angle camera12is first used for focusing and outputting the cached wide-angle image as the preview image, since the wide-angle camera12has a larger angle of view and a shorter focal length and is suitable for capturing the close-range scene. When the user performs the zooming, or when the imaging device10performs the zooming, the cached wide-angle image is processed to realize digital zoom. When the zoom ratio exceeds the predetermined threshold, since the telephoto camera14has a smaller angle of view and a longer focal length and is suitable for capturing the long-range scene, the telephoto camera14has more advantages over the wide-angle camera12, so that the image device10performs optical zoom, that is, the telephoto camera14is used for focusing and outputting the cached telephoto image as the preview image.

FIG. 11illustrates a control method in at least one embodiment of the present disclosure. As shown inFIG. 11, the control method further includes following acts.

At block S38′, it is determined whether an angle of view of the wide-angle camera12is less than a predetermined angle of view during zooming the preview image.

At block S39′, the displayer is controlled to display the cached telephoto image output by the telephoto camera14as the preview image when the angle of view of the wide-angle camera12is less than the predetermined angle of view.

FIG. 12illustrates functional modules of an electronic device in at least one embodiment of the present disclosure. As shown inFIG. 12, the control device30further includes a second determining module38′ and a seventh control module39′. The second determining module38′ is configured to determine whether an angle of view of the wide-angle camera12is less than a predetermined angle of view during zooming the preview image. The seventh control module39′ is configured to control the displayer22to display the cached telephoto image output by the telephoto camera14as the preview image when the angle of view of the wide-angle camera12is less than the predetermined angle of view.

That is, block S38′ may be realized by the second determining module38′, and block S39′ may be realized by the seventh control module39′.

In at least one embodiment, when the imaging device10is working, the wide-angle camera12is first used for focusing and outputting the cached wide-angle image as the preview image, since the wide-angle camera12has a larger angle of view and a shorter focal length and is suitable for capturing the close-range scene. When the user performs the zooming, or when the imaging device10performs the zooming, the cached wide-angle image is processed to realize digital zoom. When the angle of view of the wide-angle camera12is less than the predetermined angle of view during zooming the preview image, since the telephoto camera14has a smaller angle of view and a longer focal length and is suitable for capturing the long-range scene, the telephoto camera14has more advantages over the wide-angle camera12, so that the image device10performs optical zoom, that is, the telephoto camera14is used for focusing and outputting the cached telephoto image as the preview image.

In at least one embodiment, the predetermined zooming-in threshold is less than or equal to a ratio of an angle of view of the wide-angle camera12to an angle of view of the telephoto camera14.

In at least one embodiment, the predetermined angle of view is less than or equal to a maximum angle of view of the telephoto camera14.

FIG. 13illustrates a control method in at least one embodiment of the present disclosure. As shown inFIG. 13, Block S39or S39′ may include following acts.

At block S392, the cached telephoto image is cropped based on the zoom ratio to obtain a cropped image.

At block S394, the cropped image is stretched and zoomed in for being displayed on the displayer, to acquire a cropped and stretched image.

At block S396, the displayer is controlled to display the cropped and stretched image.

FIG. 14illustrates functional modules of a third control module or a determining module in at least one embodiment of the present disclosure. As shown inFIG. 14, the sixth control module39or the seventh control module39′ includes a cropping unit392, a stretching unit394and a second control unit396. The cropping unit392is configured to crop the cached telephoto image based on the zoom ratio to obtain a cropped image. The stretching unit394is configured to stretch and zoom in the cropped image for being displayed on the displayer22, to acquire a cropped and stretched image. The second control unit396is configured to control the displayer22to display the cropped and stretched image.

That is, block S392may be realized by the cropping unit392, block S394may be realized by the stretching unit394, and block S396may be realized by the second control unit396.

In at least one embodiment, when the telephoto camera14is working, the zooming in performed by the imaging device10belongs to digital zoom. The image after digital zoom may be obtained by image processing for the cached telephoto image, and the control device30may control the displayer24to display the image after the digital zoom as the preview image.

In the description of the present disclosure, it is to be understood that, terms such as “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “over”, “below”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “in”, “out”, “clockwise”, and “anti-clockwise”, refer to the directions and location relations which are the directions and location relations shown in the drawings, and for describing the present disclosure and for describing in simple, and which are not intended to indicate or imply that the device or the elements are disposed to locate at the specific directions or are structured and performed in the specific directions, which should not limit the present disclosure.

In addition, terms such as “first” and “second” are used herein for purposes of description and are not intended to indicate or imply relative importance or significance, or imply the number of defined features. Thus, the feature defined with “first” and “second” may comprise one or more this feature. In the description of the present disclosure, “a plurality of” means two or more than two, unless specified otherwise.

In the description of the present disclosure, it should be understood that, unless specified or limited otherwise, the terms “mounted,” “connected,” and “coupled” and variations thereof are understood broadly, such as fixed, detachable mountings, connections and couplings or integrated, and can be mechanical or electrical mountings, connections and couplings, and also can be direct and via media indirect mountings, connections, and couplings, and further can be inner mountings, connections and couplings of two components or interaction relations between two components, which can be understood by those skilled in the art according to the detail embodiment of the present disclosure.

In the present disclosure, unless specified or limited otherwise, the first feature is “on” or “under” the second feature refers to the first feature and the second feature can be direct or via media indirect mountings, connections, and couplings. And, the first feature is “on”, “above”, “over” the second feature may refer to the first feature is right over the second feature or is diagonal above the second feature, or just refer to the horizontal height of the first feature is higher than the horizontal height of the second feature. The first feature is “below” or “under” the second feature may refer to the first feature is right over the second feature or is diagonal under the second feature, or just refer to the horizontal height of the first feature is lower than the horizontal height of the second feature.

Various embodiments and examples are provided in the above description to implement different structures of the present disclosure. In order to simplify the present disclosure, certain elements and settings will be described. However, these elements and settings are only by way of example and are not intended to limit the present disclosure. In addition, reference numerals may be repeated in different examples in the present disclosure. This repeating is for the purpose of simplification and clarity and does not refer to relations between different embodiments and/or settings. Furthermore, examples of different processes and materials are provided in the present disclosure. However, it would be appreciated by those skilled in the art that other processes and/or materials may be also applied.

Any process or method described in a flow chart or described herein in other ways may be understood to include one or more modules, segments or portions of codes of executable instructions for achieving specific logical functions or steps in the process, and the scope of a preferred embodiment of the present disclosure includes other implementations, which should be understood by those skilled in the art.

The storage medium mentioned above may be read-only memories, magnetic disks or CD, etc.

It should be noted that, although the present disclosure has been described with reference to the embodiments, it will be appreciated by those skilled in the art that the disclosure includes other examples that occur to those skilled in the art to execute the disclosure. Therefore, the present disclosure is not limited to the embodiments.