Patent Description:
In general, electronic devices dominate all aspects of modern life. The electronic devices include image sensors which are used to capture images with a wide variety of photo effects, which enhance the quality of the image. However, the electronic devices with a single image sensor may not be capable of capturing wide angle images/videos without a dedicated wide angle lens as the single image sensor has a limited field of view (FOV). Further, the electronic devices with a dual image sensor also have a fixed FOV and hence the electronic devices cannot capture a portion of a scene which is out of the FOV of the dual image sensors.

Due to the limitations of the single image sensor and the dual image sensor, the electronic devices are not able to provide various photo effects to the images. For example, when the user wants to capture the scene with a panorama effect then the user will have to perform various actions like holding the electronic device in a specific position and horizontally moving the electronic device, etc., which are time consuming and complex and which degrade the user experience.

The above information is presented as background information only to help the reader to understand the present disclosure. Applicants have made no determination and make no assertion as to whether any of the above might be applicable as prior art with regard to the present application. <CIT> discloses a device and method for processing an image in an electronic device. <CIT> discloses a device with an adaptive camera array. <CIT> discloses an image acquisition technique. <CIT> discloses a camera mounting apparatus. <CIT> discloses a portable electronic device with integrated image/video compositing. <CIT> discloses a method for operating panorama image and electronic device thereof. <CIT> discloses a mobile terminal and method of controlling an image photographing therein. <CIT> discloses multishot tilt optical image stabilization for shallow depth of field. <CIT> discloses image enhancement based on combining images from multiple cameras. <CIT> discloses methods, apparatuses and computer program products for generating panoramic images using depth map data. <CIT> discloses a mobile terminal and control method therefor.

According to the invention, an electronic device and method for capturing view in the electronic device are provided comprising at least two image sensors.

In accordance with an aspect of the disclosure, a method for capturing view in an electronic device including at least two image sensors includes determining a folding angle between a first side of a fixed bend axis of the electronic device including a first image sensor and a second side of the fixed bend axis of the electronic device including a second image sensor; capturing a first view of a scene using the first image sensor; capturing a second view of the scene using the second image sensor; and determining whether the first view and the second view partially overlap with each other, completely overlap with each other, or do not overlap with each other based on the folding angle, and determining a first operating mode when the first view partially overlaps with the second view, a second operating mode when the first view completely overlaps with the second view, and a third operating mode when the first view does not overlap with the second view.

In accordance with an aspect of the disclosure, an electronic device includes at least two image sensors including a first image sensor and a second image sensor; a memory; at least one processor coupled to the memory, wherein the at least one processor is configured to determine a folding angle between a first side of a fixed bend axis of the electronic device including the first image sensor and a second side of the fixed bend axis of the electronic device including the second image sensor; capture a first view of a scene using the first image sensor; capture a second view of the scene using the second image sensor; and determine whether the first view and the second view partially overlap with each other, completely overlap with each other, or do not overlap with each other based on the folding angle, and determine a first operating mode when the first view partially overlaps with the second view, a second operating mode when the first view completely overlaps with the second view, and a third operating mode when the first view does not overlap with the second view.

It should be understood, however, that the following descriptions, while indicating embodiments and numerous specific details thereof, are given by way of illustration and not of limitation. Many changes and modifications may be made within the scope of the embodiments herein, and the embodiments herein include all such modifications.

The disclosure is illustrated in the accompanying drawings, throughout which like reference letters indicate corresponding parts in the various figures.

Various embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. In the following description, specific details such as detailed configuration and components are merely provided to assist the overall understanding of these embodiments of the present disclosure. Therefore, it should be apparent to those skilled in the art that various changes and modifications of the embodiments described herein can be made. In addition, descriptions of well-known functions and constructions are omitted for clarity and conciseness.

The term "or" as used herein refers to a non-exclusive or, unless other indicated.

As is traditional in the field, embodiments may be described and illustrated in terms of blocks which carry out a described function or functions. These blocks, which may be referred to herein as units, engines, managers, modules or the like, are physically implemented by analog and/or digital circuits such as logic gates, integrated circuits, microprocessors, microcontrollers, memory circuits, passive electronic components, active electronic components, optical components, hardwired circuits and the like, and may optionally be driven by firmware and/or software. The circuits may, for example, be embodied in one or more semiconductor chips, or on substrate supports such as printed circuit boards and the like. The circuits constituting a block may be implemented by dedicated hardware, or by a processor (e.g., one or more programmed microprocessors and associated circuitry), or by a combination of dedicated hardware to perform some functions of the block and a processor to perform other functions of the block. Each block of the embodiments may be physically separated into two or more interacting and discrete blocks without departing from the scope of the disclosure. Likewise, the blocks of the embodiments may be physically combined into more complex blocks without departing from the scope of the disclosure.

Accordingly the embodiments herein provide a method for bend angle-based imaging in an electronic device comprising at least two image sensors. The method includes capturing by a first image sensor of the at least two image sensors a first view of a scene. Further, the method also includes determining, by the electronic device, a bend angle of a second image sensor of the at least two image sensors of the electronic device based on the gesture and capturing, by the second image sensor, a second view of the scene from the bend angle. Further, the method includes performing at least one action in the electronic device based on the first view, the second view and the bend angle.

In an embodiment, determining the bend angle of the electronic device includes measuring a reading of a magnetometer when a first electromagnet and a second electromagnet are turned-off and detecting that the first electromagnet is turned-on. The method also includes determining a reading of the magnetometer when the first electromagnet is turned-on and the second electromagnet is turned-off without bend and determining a difference between the reading of the magnetometer when the first electromagnet and the second electromagnet are off and the reading of the magnetometer when the first electromagnet is turned-on without bend. Further, the method includes determining a reading of the magnetometer when the first electromagnet is turned-on and the second electromagnet is turned-off with bend and determining the bend angle of the electronic device based on the difference and the reading of the magnetometer when the first electromagnet is turned-on and the second electromagnet is turned-off with bend.

Performing the at least one action in the electronic device based on the first view, the second view and the bend angle includes determining whether the first view and the second view are one of partially overlaps with each other, completely overlaps with each other, and does not overlap with each other based on the bend angle. The method also includes determining at least one first operating mode when the first view partially overlaps with the second view or at least one second operating mode when the first view completely overlaps with the second view, and a third operating mode when the first view does not overlap with the second view. Further, the method also includes automatically configuring the electronic device in one of the determined first or second or third operating mode and automatically displaying the first view and the second view of the scene in one of the determined first or second or third operating mode.

In an embodiment, the at least one first operating mode comprises a panorama mode, an object removal mode, or a stereoscopic effect mode, wherein the at least one second operating mode comprises a double exposure mode or a stereoscopic effect mode, and wherein the at least one third operating mode comprises a double exposure mode or a background replacement mode.

In an embodiment, the object removal mode configures the electronic device to automatically retain background information in a composite view of the scene when an object is removed from at least one of the first view and the second view.

In an embodiment, the double exposure mode configures the electronic device to automatically blend at least one portion of the first view with at least one portion of the second view to produce a composite view illustrating an artistic effect of double exposure.

In an embodiment, the panorama mode configures the electronic device to automatically stitch at least one overlapping portion of the first view and the second view to produce a composite view.

In an embodiment, the composite view in the panorama mode is produced by determining whether the second image sensor is in an independent operating mode or assisted operating mode. The method also includes generating the composite view by stitching the first view of the scene with the second view of the scene when the second image sensor is in the independent operating mode or generating the composite view by superimposing the second view of the scene with the first view of the scene when the second image sensor is in the assisted operating mode.

In an embodiment, the stereoscopic effect mode configures the electronic device to automatically encode the first view and the second view using filters of different colors and produce a composite view by shifting a perspective of the first view and the second view and overlapping the first view and the second view.

The bokeh effect mode configures the electronic device to automatically operate the first image sensor in a shorter focal length to capture a first image and the second image sensor in a pan focal length to capture a second image in exact shape as the first image, and produce a composite view, wherein the composite view is produced by blurring the first view and blending the blurred first view with the second view.

The tilt shift/spot focus mode configures the electronic device to automatically operate the first image sensor in a shorter focal length to capture a first image and the second image sensor in a focal length to capture a second image in exact shape and produce a composite view, wherein the composite view is produced by blurring the first view and blending the blurred first view with the second view.

In an embodiment, the background replacement mode configures the electronic device to automatically identify a primary object and a secondary object in the first view and the second and produce a composite view by replacing remaining area, in at least one of the first view and the second view having the primary object, with the secondary object.

In an embodiment, the method also includes determining a group of imaging options of the first image sensor and determining a group of imaging options of the second image sensor. Further, the method also includes sorting the group of imaging options of the first image sensor and the group of imaging options of the second image sensor based on user preferences. Furthermore, the method includes overlaying the group of imaging options of the first image sensor over the group of imaging options of the second image sensor based on the bend angle and displaying the overlay group of imaging options of the first image sensor and the second image sensor on the composite view of the scene.

In an embodiment, the group of imaging options of the first image sensor is overlaid with the group of imaging options of the second image sensor by modifying the at least one imaging option from the group of imaging option of the at least one of the first image sensor and the second image sensor based on the bend angle.

In an embodiment, the method further includes detecting an imaging option selected form the group of imaging options of the at least one of the first image sensor and the second image sensor and determining a new bend angle corresponding to the selected imaging option. Further, the method also includes manipulating the first view and the second view by applying the selected imaging option based on the new bend angle and displaying the manipulated first view and the manipulated second view on the electronic device.

In an embodiment, the method further includes detecting a capture event performed by a user and capturing the combined view as a single image.

In an embodiment, the first view comprises at least one of image content and audio content captured using the first image sensor and the second view comprises at least one of image content and audio content captured using the second image sensor, wherein an intensity of the audio content is dynamically changed based on the bend angle of the electronic device.

In an embodiment, the second view is captured by the second image sensor in response to detecting a gesture performed to bend the electronic device.

In an embodiment, the first view and the second view of the scene are different.

In conventional methods and systems, a flexible electronic device is controlled using a shape deformation property of the flexible electronic device with no fixed bend axis (i.e., folding axis). Unlike the conventional methods and systems, the proposed electronic device includes a bend axis along which the electronic device is bent (i.e., folded. Further, the bend angle (i.e., folding angle) is used to control the functions of the image sensors of the electronic device.

Unlike the conventional methods and systems, the proposed method allows the user to capture wide angle images/views which are greater than <NUM> degrees, with dynamic control to adjust the field of view by bending the electronic device without the need for a dedicated wide angle camera module.

Referring now to the drawings, and more particularly to <FIG>, where similar reference characters denote corresponding features consistently throughout the figures, there are shown embodiments of the disclosure.

<FIG> is an example illustrating the field of view (FOV) of an electronic device <NUM> with at least two image sensors <NUM>, according to an embodiment as disclosed herein.

Unlike the conventional methods and systems, the proposed method includes providing the electronic device with the at least two image sensors. The use of the at least two image sensors enables the electronic device to capture a wider field of view (FOV) thereby capturing a larger portion of the scene.

Referring to the <FIG>, in conjunction with <FIG>, a distance Z covered by the electronic device <NUM> with the at least two image sensors is wider than the distance Y covered by the conventional electronic device with a single image sensor. Further, the user can perform the bend gesture on the electronic device to vary the distance covered by the at least two image sensors. Therefore, the distance Z covered by the at least two image sensors is directly proportional to the bend angle A.

Further, the use of the at least two image sensors enables the electronic device to provide various photography effects to the view/image captured by the electronic device, which may not be possible with the conventional electronic device with the single image sensor.

<FIG> is a block diagram of the electronic device <NUM> for providing the bend angle-based imaging, according to an embodiment as disclosed herein.

Referring to the <FIG>, the electronic device <NUM> includes at least two image sensors <NUM>, a bend angle-based imaging management engine <NUM>, a processor <NUM>, a memory <NUM> and a display <NUM>.

In an embodiment, the at least two image sensors <NUM> includes the first image sensor 110a and the second image sensor 110b. Further, the first image sensor 110a includes or is associated with a first microphone and the second image sensor 110b includes or is associated with a second microphone. The first image sensor 110a is configured to capture the first view of the scene along with an audio content associated with the first view. The second image sensor 110b is configured to capture the second view of the scene along with an audio content associated with the second view according to the bend angle of the electronic device <NUM>. The first view and the second view may be portions of the same scene or different scenes. Further, the first view and the second view may be overlapping portions of the same scene where the first view will be same as the second view. Further, the first view and the second view are the portions of the scene which are captured within a field of view of the first image sensor 110a and the second image sensor 110b respectively. In an embodiment, the second view of the scene may be captured by the second image sensor 110b in response to detecting a gesture performed to bend the electronic device <NUM>.

In an embodiment, the first view includes at least one of image content and audio content captured using the first image sensor 110a and the second view includes at least one of image content and audio content captured using the second image sensor 110b.

In an embodiment, the bend angle-based imaging management engine <NUM> is configured to determine the bend angle of the electronic device <NUM>. The bend angle of the electronic device <NUM> is determined as described in <FIG> and <FIG>. The bend angle-based imaging management engine <NUM> is also configured to perform the at least one action in the electronic device <NUM> based on the first view, the second view and the bend angle. Further, the bend angle-based imaging management engine <NUM> is configured to dynamically change an intensity of the audio content captured using the at least one image sensor <NUM> based on the bend angle of the electronic device <NUM>. Further, the detailed functions performed by the bend angle-based imaging management engine <NUM> are described with respect to the <FIG>.

In a non-claimed embodiment, when the electronic device <NUM> is a wearable electronic device, then the bend angle can be varied using a notch on a comfort part which joins a first connection part and a second connection part of the wearable electronic device.

In an embodiment, the processor <NUM> is configured to interact with the units such as the at least two image sensors <NUM>, the bend angle-based imaging management engine <NUM>, the memory <NUM> and the display <NUM> in the electronic device <NUM> to perform the functionalities of the corresponding units.

The memory unit <NUM> can include one or more computer-readable storage media. The memory unit <NUM> can include non-volatile storage elements. Examples of such non-volatile storage elements can include magnetic hard discs, optical discs, floppy discs, flash memories, or forms of electrically programmable memories (EPROM) or electrically erasable and programmable (EEPROM) memories. In addition, the memory unit <NUM> can, in some examples, be considered a non-transitory storage medium. The term "non-transitory" can indicate that the storage medium is not embodied in a carrier wave or a propagated signal. However, the term "non-transitory" should not be interpreted to mean that the memory unit <NUM> is non-movable. In some examples, the memory unit <NUM> can be configured to store larger amounts of information than the memory. In certain examples, a non-transitory storage medium can store data that can, over time, change (e.g., in Random Access Memory (RAM) or cache.

In an embodiment, the display <NUM> is configured to display the overlay group of imaging options of the first image sensor 110a and the second image sensor 110b on the composite view of the scene, as described later. Further, the display <NUM> is also configured to display the manipulated first view and the manipulated second view for the electronic device <NUM> as described later. The display <NUM> is also configured to display the first view, the second view and the bend angle on the electronic device <NUM>. The display <NUM> is configured to display the plurality of imaging options corresponding to the bend angle on the electronic device <NUM> and display the manipulated first view and the manipulated second view on the electronic device <NUM>.

The <FIG> shows exemplary system but it is to be understood that other embodiments are not limited thereto. In other embodiments, the system can include fewer or more units in the electronic device <NUM>. Further, the labels or names of the units in the electronic device <NUM> are used only for illustrative purpose and do not limit the scope of the disclosure. One or more units can be combined together to perform same or substantially similar functions in the system.

<FIG> is a block diagram of the bend angle-based imaging management engine <NUM> of the electronic device <NUM>, according to an embodiment as disclosed herein.

Referring to the <FIG>, the bend angle-based imaging management engine <NUM> includes a flex angle processor <NUM>, a raw image processing engine <NUM>, a camera configuration processor <NUM>, a shooting mode evaluator <NUM>, a real-time intelligent image engine <NUM> and a flex rendering engine <NUM>.

In an embodiment, the flex angle processor <NUM> is configured to determine the bend angle of the electronic device <NUM> which is utilized to determine potential photography effects that can be provided by the electronic device <NUM> based on the bend angle. The information regarding the bend angle provided by the flex angle processor <NUM> includes an exact bend angle and the angle by which the first view and the second view perspective need to be altered. Further, the flex angle processor <NUM> is used in conjunction with a first electromagnet (EM-<NUM>), a second electromagnet (EM-<NUM>) and the single axis magnetometer. Further, the flex angle processor <NUM> is also configured to detect the imaging option selected from the group of imaging options of the at least one of the first image sensor 110a and the second image sensor 110b and determine the new bend angle corresponding to the selected imaging option.

In an embodiment, the raw image processing engine <NUM> is configured to buffer raw camera feeds from the first image sensor 110a and the second image sensor 110b as per a camera configuration which is applied for that instance. Since the view/image capturing process and view/image processing process are two separate parallel processes with different processing speeds a mid-level buffering mechanism is provided by the raw processing engine <NUM>. The raw image processing engine <NUM> is also configured to detect a capture event performed by the user and capture the combined view as the single image.

In an embodiment, the camera configuration processor <NUM> is configured to apply and provide camera configurations of the first view and the second view. Further, the camera configuration processor <NUM> is also configured to provide the camera configuration data to other modules for decision making in a digital processing phase when the first view and the second view are captured. Further, the camera configuration processor <NUM> is also configured to automatically configure the electronic device <NUM> in one of the first operating mode, the second operating mode and the third operating mode.

The camera configuration processor <NUM> is also configured to determine a group of imaging options of the first image sensor 110a and determine a group of imaging options of the second image sensor 110b. Further, the camera configuration processor <NUM> is configured to sort the group of imaging options of the first image sensor 110a and the group of imaging options of the second image sensor 110b based on user preferences.

In an embodiment, the shooting mode evaluator <NUM> is configured to receive the inputs from the flex angle processor <NUM> and the raw processing engine <NUM>. Further, the shooting mode evaluator <NUM> is configured to determine whether the first view and the second view partially overlap with each other, completely overlap with each other, and do not overlap with each other based on the bend angle determined by the flex angle processor <NUM>. Further, the shooting mode evaluator <NUM> is configured to determine at least one first operating mode when the first view partially overlaps with the second view, at least one second operating mode when the first view completely overlaps with the second view, and at least one third operating mode when the first view does not overlap with the second view. The first operating mode is one of a panorama mode, an object removal mode, and a stereoscopic effect mode. The second operating mode is one of a bokeh effect mode, a tilt shift/spot focus mode, a double exposure mode, and a stereoscopic effect mode. The third operating mode is one of a double exposure mode and a background replacement mode. Further, the shooting mode evaluator <NUM> is also configured to manipulate the first view and the second view of the scene by applying the imaging option selected by the user based on the new bend angle determined by the flex angle processor <NUM>.

In an embodiment, the real-time intelligent image engine <NUM> includes image stitching engine 125a, a double exposure blending engine 125b, a tilt/shift engine 125c, a bokeh effect engine 125d, a background replacement engine 125e and a stereoscopic effect engine 125f. The real-time intelligent image engine <NUM> is configured to determine the photography effects that can be made available to be applied to the view captured in the electronic device <NUM> based on the determined shooting mode. In an embodiment, the image stitching engine 125a is configured to automatically stitch the at least one overlapping portion of the first view and the second view to produce a composite view. Further, the image stitching engine 125a automatically stitches the first view and the second view by determining whether the second image sensor 110b is in an independent operating mode or an assisted operating mode. Further, in response to determining that the second image sensor 110b is in the independent operating mode, the image stitching engine 125a generates the composite view by stitching the first view of the scene with the second view of the scene. In response to determining that the second image sensor 110b is in the assisted operating mode, the image stitching engine 125a generates the composite view by superimposing the second view of the scene with the first view of the scene.

In an embodiment, the double exposure blending engine 125b is configured to automatically blend at least one portion of the first view with at least one portion of the second view to produce the composite view illustrating an artistic effect of double exposure.

The tilt/shift engine 125c is configured to automatically operate the first image sensor 110a in a shorter focal length to capture a first image and the second image sensor 110b in a focal length to capture a second image. The second image has the same shape as that of the first image. Further, the tilt/shift engine 125c is also configured to produce the composite view by blurring the first view, and blending the blurred first view with the second view.

The bokeh effect engine 125d is configured to automatically operate the first image sensor 110a in a shorter focal length to capture a first image and the second image sensor 110b in a pan focal length to capture a second image in the same shape as the first image. Further, the bokeh effect engine 125d is also configured to produce the composite view by blurring the first view and blending the blurred first view with the second view.

In an embodiment, the background replacement engine 125e is configured to automatically identify a primary object and a secondary object in the first view and the second view. Further, the background replacement engine 125e is also configured to produce the composite view by replacing remaining area, in at least one of the first view and the second view having the primary object, with the secondary object.

In an embodiment, the stereoscopic effect engine 125f is configured to automatically encode the first view and the second view using filters of different colors and produce a composite view by shifting a perspective of the first view and the second view and overlapping the first view and the second view.

In an embodiment, the flex rendering engine <NUM> is configured to automatically generate the composite view with the photography effect applied to the first view and the second view. Further, the flex rendering engine <NUM> is also configured to overlay the group of imaging options of the first image sensor 110a over the group of imaging options of the second image sensor 110b based on the bend angle. The group of imaging options of the first image sensor 110a is overlaid with the group of imaging options of the second image sensor 110b by modifying the at least one imaging option from the group of imaging options of the at least one of the first image sensor 110a and the second image sensor 110b based on the bend angle.

<FIG> illustrates an example electronic device <NUM> for providing the bend angle-based imaging, according to an embodiment as disclosed herein. <FIG> illustrates example electronic devices <NUM> for providing the bend angle-based imaging, according to an embodiment as disclosed herein. <FIG> illustrates example electronic devices <NUM> for providing the bend angle-based imaging, according to an embodiment as disclosed herein.

In an embodiment, the electronic device <NUM> can be foldable and flexible, as shown in <FIG>. The electronic device <NUM> has a fixed axis about which the electronic device <NUM> can bend. The electronic device <NUM> which is foldable and flexible includes an exterior display panel and a back panel. The first image sensor 110a and the second image sensor 110b of the at least two imaging sensors are embedded on the back panel and the exterior display panel respectively. Further, the electronic device also includes an interior display. The bend angle in case of the electronic device <NUM> which is foldable and flexible is the angle between the first image sensor 110a and the second image sensor 110b which can be varied by folding the two panels of the electronic device <NUM> to various angles.

In a non-claimed embodiment, the electronic device <NUM> can be a wearable device such as a watch, as shown in <FIG>. The wearable electronic device is provided with the first image sensor 110a and the second image sensor 110b.

The wearable electronic device is provided with a display part which is configured to display digital content. The wearable electronic device is also provided with a first connection part connected to one side of the display part and a second connection part connected to the other side of the display part. The first connection part includes the first image sensor 110a and the second connection part includes the second image sensor 110b. The wearable electronic device also includes a comfort part which is configured to connect the first connection part and the second connection part. The comfort part includes a notch to bend the at least one of the first image sensor 110a and the second image senor 110b for performing the bend angle-based imaging.

In a non-claimed embodiment, the electronic device <NUM> can be a mobile phone, a Smartphone, a Personal Digital Assistant (PDA), a tablet, a display device, an Internet of things (IoT) device, etc., as shown in <FIG>. The electronic device <NUM> is provided with the first image sensor 110a and the second image sensor 110b. The first image sensor 110a captures the first view of the scene and the second image sensor 110b captures the second view of the scene. The bend angle of the second image sensor 110b is the angle by which the electronic device <NUM> is tilted, after the first view is captured but before the second view is captured, to capture the second view of the scene.

<FIG> is a flow chart <NUM> for bend angle-based imaging in the electronic device <NUM> comprising the at least two image sensors. <FIG> is a flow chart <NUM> for bend angle-based imaging in the electronic device <NUM> comprising the at least two image sensors, according to an embodiment as disclosed herein.

Referring to the <FIG>, at step <NUM>, the electronic device <NUM> captures the first view of the scene by the first image sensor 110a (as illustrated in <FIG>) of the at least two image sensors <NUM>.

At step <NUM>, the electronic device <NUM> monitors the bend angle of the electronic device <NUM>. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to monitor the bend angle of the electronic device <NUM>.

At step <NUM>, the electronic device <NUM> captures the second view of the scene from the bend angle by the second image sensor 110b of at least two image sensors <NUM>.

At step <NUM>, the electronic device <NUM> performs the at least one action based on the first view, the second view and the bend angle. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to perform the at least one action based on the first view, the second view and the bend angle.

As shown in <FIG>, at step 441a, the electronic device <NUM> determines whether the first view and the second view partially overlap with each other, completely overlap with each other, or do not overlap with each other based on bend angle. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to determine whether the first view and the second view partially overlap with each other, completely overlap with each other, or do not overlap with each other based on bend angle.

At step 442a, the electronic device <NUM> determines at least one first operating mode when the first view partially overlaps with the second view, at least one second operating mode when the first view completely overlaps with the second view and at least one third operating mode when the first view does not overlap with the second view. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to determine at least one first operating mode when the first view partially overlaps with the second view, at least one second operating mode when the first view completely overlaps with the second view and at least one third operating mode when the first view does not overlap with the second view.

At step 443a, the electronic device <NUM> automatically configures itself in one of the determined first, second or third operating mode. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to automatically configure the electronic device <NUM> in one of the determined first, second or third operating mode. Further, the electronic device <NUM> simultaneously loops to step <NUM> and continues to monitor the bend angle of the electronic device <NUM>. On determining the change in the bend angle, the steps after <NUM> are repeated.

At step 444a, the electronic device <NUM> automatically displays the first view and the second view of the scene in one of the determined first, second or third operating mode. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to automatically display the first view and the second view of the scene in one of the determined first, second or third operating mode.

At step 441b, the electronic device <NUM> displays the first view, the second view and the bend angle. For example, in the electronic device <NUM> as illustrated in the <FIG>, the display <NUM> can be configured to display the first view, the second view and the bend angle.

At step 442b, the electronic device <NUM> displays the plurality of imaging options corresponding to the bend angle. For example, in the electronic device <NUM> as illustrated in the <FIG>, the display <NUM> can be configured to display the plurality of imaging options corresponding to the bend angle.

At step 443b, the electronic device <NUM> detects the imaging option selected (e.g., by a user) from the plurality of imaging options. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to detect the imaging option selected from the plurality of imaging options.

At step 444b, the electronic device <NUM> determines the new bend angle corresponding to the selected imaging option. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to determine the new bend angle corresponding to the selected imaging option.

At step 445b, the electronic device <NUM> manipulates the first view and the second view by applying the selected imaging option based on the new bend angle. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to manipulate the first view and the second view by applying the selected imaging option based on the new bend angle.

At step 446b, the electronic device <NUM> displays the manipulated first view and the manipulated second view. For example, in the electronic device <NUM> as illustrated in the <FIG>, the display <NUM> can be configured to display the manipulated first view and the manipulated second view.

The various actions, acts, blocks, steps, or the like in the method may be performed in the order presented, in a different order or simultaneously. Further, in some embodiments, some of the actions, acts, blocks, steps, or the like may be omitted, added, modified, skipped, or the like without departing from the scope of the disclosure.

<FIG> is a flow chart <NUM> for determining the bend angle of the electronic device <NUM>, according to an embodiment as disclosed herein.

Referring to the <FIG>, at step <NUM>, the electronic device <NUM> measures the reading of the magnetometer when the first electromagnet and the second electromagnet are turned off. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to measure the reading of the magnetometer when the first electromagnet and the second electromagnet are turned off.

At step <NUM>, the electronic device <NUM> detects that the first electromagnet is turned on. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to detect that the first electromagnet is turned on.

At step <NUM>, the electronic device <NUM> determines a reading of the magnetometer when the first electromagnet is turned on and the second electromagnet is turned off without bend (i.e., when the electronic device <NUM> is not folded). For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to determine reading of magnetometer when first electromagnet is turned on and second electromagnet is turned off without bend.

At step <NUM>, the electronic device <NUM> determines a difference between the reading of the magnetometer when first electromagnet and second electromagnet are off and the reading of the magnetometer when first electromagnet is turned on without bend. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to determine a difference between the reading of the magnetometer when first electromagnet and second electromagnet are off and the reading of the magnetometer when first electromagnet is turned on without bend.

At step <NUM>, the electronic device <NUM> determines a reading of the magnetometer when the first electromagnet is turned on and the second electromagnet is turned off with bend. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to determine a reading of the magnetometer when the first electromagnet is turned on and the second electromagnet is turned off with bend.

At step <NUM>, the electronic device <NUM> determines the bend angle of electronic device <NUM> based on the determined difference and the reading of magnetometer when the first electromagnet is turned on and the second electromagnet is turned off with bend. For example, in the electronic device <NUM> as illustrated in the <FIG>, the bend angle-based imaging management engine <NUM> can be configured to determine the bend angle of electronic device <NUM> based on the determined difference and the reading of the magnetometer when the first electromagnet is turned on and the second electromagnet is turned off with bend. Further, the step <NUM> to step <NUM> are repeated by alternatively turning on the second electromagnet and turning off the first electromagnet.

Therefore, in order to determine the bend angle of the electronic device <NUM>, the steps from <NUM> to <NUM> are performed by alternatively turning on and turning off the first electromagnet and the second electromagnet.

<FIG> illustrates the determination of the bend angle of the electronic device <NUM> based on a gesture, according to an embodiment as disclosed herein. <FIG> illustrates the determination of the bend angle of the electronic device <NUM> based on a gesture, according to an embodiment as disclosed herein. <FIG> illustrates the determination of the bend angle of the electronic device <NUM> based on a gesture, according to an embodiment as disclosed herein. <FIG> illustrates the determination of the bend angle of the electronic device <NUM> based on a gesture, according to an embodiment as disclosed herein. <FIG> illustrates the determination of the bend angle of the electronic device <NUM> based on a gesture, according to an embodiment as disclosed herein.

According to the proposed method, the electronic device <NUM> is provided with an arrangement of two electromagnets and a single axis magnetometer to determine the bending angle of the electronic device <NUM>. The two electromagnets, i.e., a first electromagnet (EM-<NUM>) and a second electromagnet (EM-<NUM>) are placed on either side of a bend axis of the electronic device <NUM>. A polarity of the first electromagnet and the second electromagnet are along the plane of the display of the electronic device <NUM>. The bend axis of electronic device <NUM> is provided with the single axis magnetometer and the axis of the single axis magnetometer is calibrated when no bending orientation is performed.

Referring to the <FIG>, the ambient magnetic field (BAmbient) at that moment of orientation along the bend axis of the electronic device <NUM> is determined by switching off the first electromagnet and the second electromagnet. Further, the electronic device <NUM> is not bent while determining the ambient magnetic field.

Referring to the <FIG>, the electronic device <NUM> detects that the first electromagnet (EM-<NUM>) is turned on for a specific duration of time. When the EM-<NUM> is turned on, the polarity of the EM-<NUM> leads to an electromagnetic field in the single axis magnetometer which is at the axis of the electronic device <NUM>. The electronic device <NUM> then records a reading of the single axis magnetometer when the EM-<NUM> is turned on and the EM-<NUM> is turned off without the bend in the electronic device <NUM>.

Reading of Magnetometer when the EM-<NUM> is turned on and the EM-<NUM> is turned off without bend= B Ambient Cos A + B EM1
therefore,
<MAT> (when the EM-<NUM> is turned on and the EM-<NUM> is turned off with no bend) - B Ambient Cos A (<NUM>).

Further, the ambient magnetic field generated when the EM-<NUM> and the EM-<NUM> are turned off is cancelled in both cases of no bend position and the bending position.

Referring to the <FIG>, the electronic device <NUM> determines the reading of the single axis magnetometer when the EM-<NUM> is turned on and the EM-<NUM> is turned off after the bend gesture is performed by the user.

Then, Reading of Magnetometer when the EM-<NUM> is turned on and the EM-<NUM> is turned off with bend= B Ambient Cos A + B EM1 Cos X.

Here, X represents the left bend angle as shown in <FIG>. Therefore, the left bend angle X can be obtained as:
<MAT> (when the EM-<NUM> is turned on and the EM-<NUM> is turned off with bend) - B Ambient Cos A) / B EM1 (<NUM>).

Referring to <FIG>, the electronic device <NUM> detects that the EM-<NUM> is turned on and records a reading of the single axis magnetometer when the EM-<NUM> is turned off and the EM-<NUM> is turned on without the bend in the electronic device <NUM>.

Reading of Magnetometer when the EM-<NUM> is turned on and the EM-<NUM> is turned off without bend= B Ambient Cos A - B EM2
therefore,
<MAT> (when the EM-<NUM> is turned on and the EM-<NUM> is turned off with no bend) - B Ambient Cos A (<NUM>).

Referring to <FIG>, the electronic device <NUM> determines the reading of the single axis magnetometer when the EM-<NUM> is turned on and the EM-<NUM> is turned off after the bend gesture is performed by the user.

Then, Reading of Magnetometer when the EM-<NUM> is turned on and the EM-<NUM> is turned off with bend= B Ambient Cos A - B EM1 Cos Y.

Here, Y represents the right bend angle as shown in <FIG>. Therefore, the right bend angle Y can be obtained as:
<MAT> (when the EM-<NUM> is turned on and the EM-<NUM> is turned off with bend) - B Ambient Cos A) / B EM2 (<NUM>).

The equation (<NUM>) and the equation (<NUM>) are used to determine the differential bend angle of each side of the bend axis of the electronic device <NUM> one at a time by switching on the electromagnets alternatively on either sides of the bend axis. Further, the interval of switching the electromagnets can be set in the electronic device <NUM>. Further, the first electromagnet and the second electromagnet can be synchronously polarized one at a time to calculate the relative bending of the display side of the electronic device <NUM>.

When the first electromagnet is polarized, the relative bending can be derived from the effective magnetic field value at that configuration. Similarly after calculating bend degree of one side of the electronic device <NUM>, the second electromagnet is turned on and the bend degree is calculated by the change in magnetic field at the magnetometer position. Since the amount of current passed through the electromagnets is known, the magnitude of generated polarity can be used to calculate the magnetic field generated by the electromagnets. The two electromagnets are used instead of permanent magnets so that the two electromagnets can be turned on/turned off and the polarity of the two electromagnets is more useful than the permanent magnets.

<FIG> is an example illustrating the electronic device <NUM> with the at least two image sensors <NUM> used for capturing the composite view of the scene, according to an embodiment as disclosed herein.

Consider that the user wants to capture the scene using the electronic device <NUM> with the at least two image sensors <NUM>.

Referring to the <FIG>, the first view is captured by the first image sensor 110a of the at least two image sensors <NUM>. Further, the electronic device <NUM> determines the bend angle, i.e., the angle by which the electronic device <NUM> is bent to capture the second view by the second image sensor 110b of the at least two image sensor <NUM> of the electronic device <NUM>. Further, the electronic device <NUM> performs the at least one action based on the first view, the second view and the bend angle. Further, various portions of the scene can be captured by changing the bend angle of the electronic device <NUM>.

In an embodiment, the electronic device <NUM> determines the bend gesture performed by the user and in response to the bend gesture performed by the user, captures the second view of the scene.

When the electronic device <NUM> is activated, the electronic device <NUM> determines whether the first view and the second view partially overlap with each other, completely overlap with each other or do not overlap with each other based on the bend angle. Further, the electronic device <NUM> determines the mode of operation as the first operating mode when the first view partially overlaps with the second view, the second operating mode when the first view completely overlaps with the second view and the third operating mode when the first view does not overlap with the second view. Further, the electronic device <NUM> is automatically configured in one of the determined first, second or third operating mode.

<FIG> is an example illustration for capturing the composite view of the scene by the electronic device <NUM> with the at least two image sensors <NUM>, according to a non-claimed embodiment.

In conjunction with <FIG>, consider that the first view and the second view overlap partially with each other. The electronic device <NUM> determines that the mode of operation is the first operating mode which includes the photography modes such as one of the panorama mode, the object removal mode, and the stereoscopic effect mode which can be applied on the first view and the second view. The electronic device <NUM> provides the list of photography modes on the screen as shown in <FIG>. Further, the electronic device <NUM> determines that the user has selected the panorama mode from the list of photography modes provided on the screen. In response to the user selection of the panorama mode, the electronic device <NUM> is automatically configured to stitch the first view and the second view about the axis of the electronic device <NUM> to produce the composite view.

Further, the electronic device <NUM> determines the group of imaging options associated with the first image sensor 110a and the second image sensor 110b. Further, the electronic device <NUM> sorts the group of imaging options of the first image sensor 110a and the second image sensor based on user preferences. Further, the electronic device <NUM> overlays and displays the overlay group of imaging options of the first image sensor 110a and the second image sensor 110b on the composite view of the scene, as shown in <FIG>.

In another example consider that the user has manually selected the panorama imaging option without taking into consideration whether the first view and the second view is partially overlapping. In such a scenario, the electronic device <NUM> determines that the user has selected the panorama imaging option from the group of imaging options of the at least one of the first image sensor 110a and the second image sensor 110b. Further, the electronic device <NUM> determines the requisite new bend angle corresponding to the panorama imaging option and provides the new bend angle information on the screen. The new bend angle information provided on the screen enables the user to know the angle by which the electronic device <NUM> must be bent to be able to apply the select imaging option (i.e., the panorama imaging option).

Further, the electronic device <NUM> determines that the user has achieved the required new bend angle and manipulates the first view and the second view by applying the panorama imaging option and displays the manipulated composite view of the scene in the panorama mode on the electronic device <NUM>.

<FIG> is example illustrating the application of the object removal effect in the first operating mode to the composite view of the scene, according to an embodiment as disclosed herein. <FIG> is example illustrating the application of the object removal effect in the first operating mode to the composite view of the scene, according to an embodiment as disclosed herein. <FIG> is example illustrating the application of the object removal effect in the first operating mode to the composite view of the scene, according to an embodiment as disclosed herein. <FIG> is example illustrating the application of the object removal effect in the first operating mode to the composite view of the scene, according to an embodiment as disclosed herein.

Referring to the <FIG>, consider the scene where a number series is displayed on a wall. An object present in the front of the wall obstructs the user from capturing the numbers behind the object on the wall, as shown in <FIG>.

Referring to the <FIG>, the field of view of the first image sensor captures the first view of the image which includes the object. The presence of the object leads to the background information (i.e., the information obscured by the object) to be lost. Further, the field of view of the second image sensor overlaps with the field of view of the first image sensor. However, the second image sensor is not able to capture the number series which is behind the object. The electronic device <NUM> determines that the first view and the second view are partially overlapping in the live preview. Further, the electronic device <NUM> determines that the first image sensor and the second image sensor have to be operated in the first operating mode as the first view and the second view partially overlap with each other. Further, the electronic device <NUM> displays the imaging options associated with the first operating mode and detects that the imaging option selected by the user is the object removal effect.

On determining that the imaging option selected by the user is the object removal effect, the electronic device <NUM> displays the new bend angle required to capture the information behind the object. Further, based on the new bend angle information provided by the electronic device <NUM>, the user performs the appropriate bend gesture to achieve the new bend angle. At the new bend angle, the second image sensor is able to recover the information behind the object, as shown in <FIG>.

<FIG> is an example illustration for capturing the first view and the second view of the scene using the wearable electronic device, according to a non-claimed embodiment.

Referring to the <FIG>, at step <NUM>, the wearable electronic device is placed such that the first image sensor 110a and the second image sensor 110b face the scene to be captured. At step <NUM>, the notch provided at the comfort portion of the wearable electronic device can be used to change the bend angle required to capture the first view and the second view of the scene.

Further at step <NUM>, the first view and the second view of the scene are captured with wider and dynamic wide angle coverage due to the use of the notch which enables the user to change the bend angle of the wearable electronic device, as shown in <FIG>. Furthermore, the remote view finder option enables other electronic devices which are paired with the wearable electronic device to control and determine the photo effects that can be applied to the first view and the second view captured by the wearable electronic device.

<FIG> is an example illustrating the application of the panorama effect in the first operating mode to the composite view of the scene, according to an embodiment as disclosed herein.

In the conventional methods and systems, the panorama effect is provided by activating the image sensors and horizontally moving the image sensors to capture the panoramic image. Unlike the conventional methods and systems, in the proposed method the panorama effect is provided by capturing the first view and the second view of the scene with overlapping portions in the first view and the second view and stitching the first view and the second view to obtain the composite view of the scene.

Referring to the <FIG>, at step <NUM>, the electronic device <NUM> determines that the bend angle is such that the first view and the second view partially overlap in the live preview. Further, the electronic device <NUM> determines that the first image sensor and the second image sensor have to be operated in the first operating mode as the first view and the second view partially overlap with each other.

Further, the electronic device <NUM> displays the imaging options associated with the first operating mode and detects that the imaging option selected by the user is panorama effect.

At step <NUM>, in the electronic device <NUM> automatically identifies the overlapping portions in the first view and the second view of the scene. At step <NUM>, the electronic device <NUM> stitches the overlapping portions of the first view and the second view to produce the composite view of the scene.

In an embodiment, when the user manually selects the panorama effect when the electronic device <NUM> is not in the first operating mode, then the electronic device <NUM> displays the required bend angle information so that the user may bend the electronic device to the required angle for the panorama effect.

Unlike the conventional methods and systems, where the panorama effect is produced by horizontally moving the image sensor to capture the scene, the proposed method does not require the user to horizontally move the image sensor to capture the scene. The proposed method determines the overlapping regions in the first view and the second view and stitches the two to obtain the complete scene.

<FIG> is an example illustrating the application of the background replacement effect in the third operating mode to the composite view of the scene, according to an embodiment as disclosed herein.

Referring to the <FIG>, at step <NUM>, the electronic device <NUM> determines that the bend angle is such that the first view and the second view do not overlap in the live preview. Further, the electronic device <NUM> determines that the first image sensor and the second image sensor have to be operated in the third operating mode as the first view and the second view do not overlap with each other.

Further, the electronic device <NUM> displays the imaging options associated with the third operating mode and detects that the imaging option selected by the user is background replacement effect.

At step <NUM>, the electronic device <NUM> automatically identifies the primary object as the human in the first view. At step <NUM>, the electronic device <NUM> identifies the secondary object as the mountains in the second view. Further, the electronic device <NUM> produces the composite view by replacing the background area in the first view having the primary object with the secondary object from the second view and displays the composite view on the screen, as shown in step <NUM>.

<FIG> is an example illustrating the application of the bokeh effect in the second operating mode to the composite view of the scene, according to an embodiment as disclosed herein.

Referring to the <FIG>, at step <NUM>, the electronic device <NUM> determines that the bend angle is such that the first view and the second view completely overlap in the live preview. Further, the electronic device <NUM> determines that the first image sensor and the second image sensor have to be operated in the second operating mode as the first view and the second view completely overlap.

Further, the electronic device <NUM> displays the imaging options associated with the second operating mode and detect the imaging option selected by the user as bokeh effect.

At step <NUM>, in the bokeh effect mode the electronic device <NUM> is configured to automatically operate the first image sensor in a shorter focal length to capture the first image.

At step <NUM>, the electronic device <NUM> is configured to automatically operate the second image sensor in the pan focal length to capture the second image, where the second image is the completely blurred version of the first image. The second image is also captured in the same shape as the first image.

At step <NUM>, the composite view is produced by blending the first image and the second image to provide the bokeh effect.

<FIG> is an example illustrating the capture of the first view and the second view containing the audio content along with the image, according to an embodiment as disclosed herein.

Referring to the <FIG>, in an example, consider that the electronic device <NUM> displays the first view, the second view and the bend angle information on the screen.

Further, the electronic device <NUM> displays a plurality of imaging options corresponding to the bend angle on the screen and allows the user to select one of the imaging options. The electronic device <NUM> determines that the user selects the imaging option where the audio content needs to be recorded while capturing the first scene and the second scene.

In response to determining the imaging option selected by the user, the electronic device <NUM> determines the new bend angle which is required to record the audio content while capturing the first scene and the second scene. The electronic device <NUM> then manipulates the first view and the second view by applying the imaging option selected by the user based on the new bend angle. Further, the first image sensor captures the audio content along with the image content in the first view of the scene. The second image sensor captures the audio content along with the image content in the second view of the scene. Furthermore, the electronic device <NUM> displays the manipulated first view and the manipulated second view of the scene on the screen.

In an embodiment, the first image sensor and the second image sensor may capture only the audio content associated with the first scene and the second scene respectively.

Claim 1:
A method for capturing view in an electronic device (<NUM>) including at least two image sensors (<NUM>), the method comprising:
determining a folding angle between a first side of a fixed bend axis of the electronic device (<NUM>) including a first image sensor (110a) and a second side of the fixed bend axis of the electronic device (<NUM>) including a second image sensor (110b);
capturing a first view of a scene using the first image sensor (110a); and
capturing a second view of the scene using the second image sensor (110b);
the method being characterized by:
determining whether the first view and the second view partially overlap with each other, completely overlap with each other, or do not overlap with each other based on the folding angle, and determining a first operating mode when the first view partially overlaps with the second view, a second operating mode when the first view completely overlaps with the second view, and a third operating mode when the first view does not overlap with the second view.