Patent Description:
An electronic device may obtain a color image and a depth map using at least one image sensor. The color image may include an RGB value of each pixel included therein and the depth map may include a depth value of each pixel. The depth value may be a value corresponding to a distance between a subject and an electronic device (or at least one image sensor). For example, when the depth values in one region including a plurality of pixels are greater than those in another region in a depth map, this may mean that the subject corresponding to the one region is closer to the electronic device than the subject in the another region.

The electronic device may provide various user interfaces (UI) to enable a user of the electronic device to edit an image. For example, the image editing may include image composition or inserting of an object (e.g., a sticker, a label, a drawing, or the like) in an image.

Document <CIT> discloses various embodiments for editing a video sequence. One embodiment, among others, is a method for editing a video in a video editing system. The method comprises obtaining a video sequence and identifying objects in the video sequence with corresponding depth information, displaying the video sequence in a display panel in a user interface, and facilitating insertion of an object into the video sequence by displaying in the user interface, a timeline and a control panel including a graphical representation for each of the identified objects with corresponding depth information. The graphical representations are arranged relative to the timeline and based on the corresponding depth information. The method further comprises obtaining input from a user positioning the object into the video sequence relative to the identified objects with corresponding depth information.

Document <CIT> Al discloses an image processing system, an image processing method, and a program capable of achieving better communication. An information processing apparatus includes a clipping unit configured to perform image processing of clipping a predetermined object from a moving image in which the object is imaged and generate a clipped moving image of the object, and an operation content acquisition unit configured to obtain operation content of operation performed on the clipped moving image of the object. A distribution server includes an image processing unit configured to perform, individually for each of the objects, image processing that corresponds to operation content on a clipped moving image of a plurality of objects, and a combining unit configured to generate a combined moving image in which the plurality of objects is arranged by combining the clipped moving images of the plurality of objects that has undergone image processing. The present technology is applicable, for example, to a communication AI system that enables communication among a plurality of users at remote sites using an image.

Document <CIT> discloses an electronic device and a contents generation method thereof. A first mode and a second mode are provided. In the first mode, a position of at least one object is determined in response to depth information of the at least one object and the at least one object is displayed at the determined position. In the second mode, contents including the at least one object are displayed as a stereoscopic image. Conversion between the first mode and the second mode is controlled on the basis of a motion of the electronic device.

Document <CIT> discloses a mobile terminal including a display, an input unit and a controller. The display is configured to display three-dimensional (3D) content having first and second images for viewing by a left eye and a right eye, respectively. A same object depicted in each of the first and second images includes a common point. A position of the common point in relation to the first and second images is separated by a distance based on a 3D depth of the object. The controller is configured to cause displaying of the 3D content; select the object in response to detection of a first input; and change a position of the object in at least the first or second image in response to a detection of a second input related to changing the 3D depth of the object such that the distance between the common point in the first and second images changes.

An electronic device may provide a UI for editing an image to a user, but does not provide a function of editing an image using a depth map.

Aspects of the present disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure is to provide an electronic device for editing an image using a depth map and a method thereof.

In accordance with an aspect of the present disclosure, an electronic device according to claim <NUM> is provided.

In accordance with another aspect of the present disclosure, a method of an electronic device according to claim <NUM> is provided.

In addition, various effects that are directly or indirectly understood through the present disclosure may be provided.

With regard to description of drawings, similar elements may be marked by similar reference numerals.

Hereinafter, various embodiments of the present disclosure may be described with reference to accompanying drawings. Accordingly, those of ordinary skill in the art will recognize that modification, equivalent, and/or alternative on the various embodiments described herein can be variously made without departing from the scope and spirit of the present disclosure.

<FIG> is a block diagram of an electronic device in a network environment according to various embodiments.

Referring to <FIG>, the electronic device <NUM> may communicate with an electronic device <NUM> through a first network <NUM> (e.g., a short-range wireless communication) or may communicate with an electronic device <NUM> or a server <NUM> through a second network <NUM> (e.g., a long-distance wireless communication) in the network environment <NUM>. According to an embodiment, the electronic device <NUM> may communicate with the electronic device <NUM> through the server <NUM>. According to an embodiment, the electronic device <NUM> may include a processor <NUM>, a memory <NUM>, an input device <NUM>, a sound output device <NUM>, a display device <NUM>, an audio module <NUM>, a sensor module <NUM>, an interface <NUM>, a haptic module <NUM>, a camera module <NUM>, a power management module <NUM>, a battery <NUM>, a communication module <NUM>, a subscriber identification module <NUM>, and an antenna module <NUM>. According to some embodiments, at least one (e.g., the display device <NUM> or the camera module <NUM>) among components of the electronic device <NUM> may be omitted or other components may be added to the electronic device <NUM>. According to some embodiments, some components may be integrated and implemented as in the case of the sensor module <NUM> (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) embedded in the display device <NUM> (e.g., a display or a display unit).

The processor <NUM> may operate, for example, software (e.g., a program <NUM>) to control at least one of other components (e.g., a hardware or software component) of the electronic device <NUM> connected to the processor <NUM> and may process and compute a variety of data. The processor <NUM> may load a command set or data, which is received from other components (e.g., the sensor module <NUM> or the communication module <NUM>), into a volatile memory <NUM>, may process the loaded command or data, and may store result data into a nonvolatile memory <NUM>. According to an embodiment, the processor <NUM> may include a main processor <NUM> (e.g., a central processing unit or an application processor) and an auxiliary processor <NUM> (e.g., a graphic processing device, an image signal processor, a sensor hub processor, or a communication processor), which operates independently from the main processor <NUM>, additionally or alternatively uses less power than the main processor <NUM>, or is specified to a designated function. In this case, the auxiliary processor <NUM> may operate separately from the main processor <NUM> or embedded.

The auxiliary processor <NUM> may control, for example, at least some of functions or states associated with at least one component (e.g., the display device <NUM>, the sensor module <NUM>, or the communication module <NUM>) among the components of the electronic device <NUM> instead of the main processor <NUM> while the main processor <NUM> is in an inactive (e.g., sleep) state or together with the main processor <NUM> while the main processor <NUM> is in an active (e.g., an application execution) state. According to an embodiment, the auxiliary processor <NUM> (e.g., the image signal processor or the communication processor) may be implemented as a part of another component (e.g., the camera module <NUM> or the communication module <NUM>) that is functionally related to the auxiliary processor <NUM>. The memory <NUM> may store a variety of data used by at least one component (e.g., the processor <NUM> or the sensor module <NUM>) of the electronic device <NUM>, for example, software (e.g., the program <NUM>) and input data or output data with respect to commands associated with the software. The memory <NUM> may include the volatile memory <NUM> or the nonvolatile memory <NUM>.

The program <NUM> may be stored in the memory <NUM> as software and may include, for example, an operating system <NUM>, a middleware <NUM>, or an application <NUM>.

The input device <NUM> may be a device for receiving a command or data, which is used for a component (e.g., the processor <NUM>) of the electronic device <NUM>, from an outside (e.g., a user) of the electronic device <NUM> and may include, for example, a microphone, a mouse, or a keyboard.

The sound output device <NUM> may be a device for outputting a sound signal to the outside of the electronic device <NUM> and may include, for example, a speaker used for general purposes, such as multimedia play or recordings play, and a receiver used only for receiving calls. According to an embodiment, the receiver and the speaker may be either integrally or separately implemented.

The display device <NUM> may be a device for visually presenting information to the user and may include, for example, a display, a hologram device, or a projector and a control circuit for controlling a corresponding device. According to an embodiment, the display device <NUM> may include a touch circuitry or a pressure sensor for measuring an intensity of pressure on the touch.

According to various embodiments of the present disclosure, when the display device <NUM> includes a touch circuit or a pressure sensor, the display device <NUM> may receive various types of user inputs. According to an embodiment, a user input may include an input using at least one body (e.g., a finger) of a user. For example, the input using at least one body of a user may include an operation of touching a touch screen at least once (which may be referred to as a tap operation), an operation of touching a touch screen by at least one body of a user for a predetermined time period (which may be referred to as a touch-and-hold or press operation), an operation of touching a touch screen by at least one body of a user at a predetermined pressure or higher (which may be referred to as a pressure touch operation), an operation of moving at least one body of a user without restriction in time and direction while the at least one body touches a touch screen (which may be referred to as a panning operation), an operation of moving at least one body of a user without restriction in time and direction while the at least one body touches a touch screen (which may be referred to as a panning operation), an operation of moving at least one body of a user faster than a swipe operation (which may be referred to as a flick operation), an operation of moving at least one body of a user while the at least one body touches an object displayed on a touch screen (which may be referred to as a drag operation), an operation of narrowing or widening an interval between at least two or more bodies of a user while the at least two or more bodies touch the touch screen (which may be referred to as a pinch-in or pinch-out operation), an operation of rotating at least one body of a user while the at least one body touches a touch screen (which may be referred to as a rotating operation), and combinations thereof. According to another embodiment, a user input may include an input using an external device. For example, the external device may include an electronic pen (which may be referred to as a touch pen). For example, the input using an external device may include a tap operation, a press operation, a pressure touch operation, a hovering operation, a panning operation, a swipe operation, a flick operation, a drag operation, a rotating operation, a button input operation (which may include, for example, a scheme of pushing a button included in an electronic pen in a touch or hovering state), and combinations thereof.

The audio module <NUM> may convert a sound and an electrical signal in dual directions. According to an embodiment, the audio module <NUM> may obtain the sound through the input device <NUM> or may output the sound through an external electronic device (e.g., the electronic device <NUM> (e.g., a speaker or a headphone)) wired or wirelessly connected to the sound output device <NUM> or the electronic device <NUM>.

The sensor module <NUM> may generate an electrical signal or a data value corresponding to an operating state (e.g., power or temperature) inside or an environmental state outside the electronic device <NUM>. The sensor module <NUM> may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface <NUM> may support a designated protocol wired or wirelessly connected to the external electronic device (e.g., the electronic device <NUM>). According to an embodiment, the interface <NUM> may include, for example, an HDMI (high-definition multimedia interface), a USB (universal serial bus) interface, an SD card interface, or an audio interface.

A connection terminal <NUM> may include a connector that physically connects the electronic device <NUM> to the external electronic device (e.g., the electronic device <NUM>), for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module <NUM> may convert an electrical signal to a mechanical stimulation (e.g., vibration or movement) or an electrical stimulation perceived by the user through tactile or kinesthetic sensations.

The camera module <NUM> may shoot a still image or a video image. According to an embodiment, the camera module <NUM> may include, for example, at least one lens, an image sensor, an image signal processor, or a flash.

The power management module <NUM> may be a module for managing power supplied to the electronic device <NUM> and may serve as at least a part of a power management integrated circuit (PMIC).

The battery <NUM> may be a device for supplying power to at least one component of the electronic device <NUM> and may include, for example, a non-rechargeable (primary) battery, a rechargeable (secondary) battery, or a fuel cell.

The communication module <NUM> may establish a wired or wireless communication channel between the electronic device <NUM> and the external electronic device (e.g., the electronic device <NUM>, the electronic device <NUM>, or the server <NUM>) and support communication execution through the established communication channel. The communication module <NUM> may include at least one communication processor operating independently from the processor <NUM> (e.g., the application processor) and supporting the wired communication or the wireless communication. According to an embodiment, the communication module <NUM> may include a wireless communication module <NUM> (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) or a wired communication module <NUM> (e.g., an LAN (local area network) communication module or a power line communication module) and may communicate with the external electronic device using a corresponding communication module among them through the first network <NUM> (e.g., the short-range communication network such as a Bluetooth, a WiFi direct, or an IrDA (infrared data association)) or the second network <NUM> (e.g., the long-distance wireless communication network such as a cellular network, an internet, or a computer network (e.g., LAN or WAN)). The above-mentioned various communication modules <NUM> may be implemented into one chip or into separate chips, respectively.

According to an embodiment, the wireless communication module <NUM> may identify and authenticate the electronic device <NUM> using user information stored in the subscriber identification module <NUM> in the communication network.

The antenna module <NUM> may include one or more antennas to transmit or receive the signal or power to or from an external source. According to an embodiment, the communication module <NUM> (e.g., the wireless communication module <NUM>) may transmit or receive the signal to or from the external electronic device through the antenna suitable for the communication method.

Some components among the components may be connected to each other through a communication method (e.g., a bus, a GPIO (general purpose input/output), an SPI (serial peripheral interface), or an MIPI (mobile industry processor interface)) used between peripheral devices to exchange signals (e.g., a command or data) with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device <NUM> and the external electronic device <NUM> through the server <NUM> connected to the second network <NUM>. Each of the electronic devices <NUM> and <NUM> may be the same or different types as or from the electronic device <NUM>. According to an embodiment, all or some of the operations performed by the electronic device <NUM> may be performed by another electronic device or a plurality of external electronic devices. When the electronic device <NUM> performs some functions or services automatically or by request, the electronic device <NUM> may request the external electronic device to perform at least some of the functions related to the functions or services, in addition to or instead of performing the functions or services by itself. The external electronic device receiving the request may carry out the requested function or the additional function and transmit the result to the electronic device <NUM>. The electronic device <NUM> may provide the requested functions or services based on the received result as is or after additionally processing the received result. To this end, for example, a cloud computing, distributed computing, or client-server computing technology may be used.

<FIG> is a block diagram illustrating a camera module according to various embodiments. Referring to <FIG>, the camera module <NUM> may include a lens assembly <NUM>, a flash <NUM>, an image sensor <NUM>, an image stabilizer <NUM>, a memory (e.g., a buffer memory) <NUM>, or an image signal processor <NUM>. The lens assembly <NUM> may collect light emitted from a subject which is an object of image capturing. The lens assembly <NUM> may include one or more lenses. According to an embodiment, the camera module <NUM> may include a plurality of lens assemblies <NUM>. In this case, the camera module <NUM> may be, for example, a dual camera, a <NUM>-degree camera, or a spherical camera. The plurality of lens assemblies <NUM> may have the same lens properties (e.g., angle of view, focal length, autofocus, f number, or optical zoom), or at least one lens assembly may have a property different from that of another lens assembly. For example, the lens assembly <NUM> may include a wide-angle lens or a telephoto lens. The flash <NUM> may emit a light source used to enhance the light emitted from the subject. The flash <NUM> may include one or more light emitting diodes (e.g., a red-green-blue (RGB) LED, a white LED, an infrared LED, or an ultraviolet LED), or a xenon lamp.

The image sensor <NUM> may acquire an image corresponding to the subject by converting the light transmitted from the subject through the lens assembly <NUM> into an electrical signal. According to an embodiment, the image sensor <NUM> may include, for example, one selected from image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same property, or a plurality of image sensors having different properties. For example, each image sensor included in the image sensor <NUM> may be implemented with a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor. According to an embodiment, when the camera module <NUM> includes the plurality of lens assemblies <NUM>, the image sensor <NUM> includes a plurality of image sensors that acquire images from each of the plurality of lens assemblies <NUM>. For example, one of the image sensors may acquire a color image and another image sensor may acquire a depth map (which may be referred to as a depth map image). As another example, each of the plurality of image sensors may cooperate with each another to obtain a color image and a depth map.

The image stabilizer <NUM> may move or control (e.g., adjustment of read-out timing, and the like) at least one lens included in the lens assembly <NUM> or the image sensor <NUM> in a specific direction to at least partially compensate for a negative effect (e.g., image blurring) due to movement of the camera module <NUM> or the electronic device <NUM> including the camera module <NUM> with respect to the image being photographed in response to the movement of the camera module <NUM> or the electronic device <NUM>. According to an embodiment, the image stabilizer <NUM> may be implemented, for example, with an optical image stabilizer and may detect the movement by using a gyro sensor (not shown) or an acceleration sensor (not shown) located inside or outside the camera module <NUM>.

The memory <NUM> may at least temporarily store at least a part of the image obtained through the image sensor <NUM> for a next image processing operation. For example, when image acquisition by the shutter is delayed or a plurality of images are acquired at a high speed, the acquired original image (e.g., a high-resolution image) is stored in the memory <NUM>, and a copy image (e.g., a low-resolution image) corresponding to the original image may be previewed through the display device <NUM>. Then, when a specified condition (e.g., a user input or system instruction) is met, at least a part of the original image stored in the memory <NUM> may be obtained and processed, for example, by the image signal processor <NUM>. According to an embodiment, the memory <NUM> may be implemented with at least a part of the memory <NUM> or a separate memory operated independent of the memory <NUM>.

The image signal processor <NUM> may perform image processing (e.g., depth map generation, three-dimensional modeling, panorama generation, feature point extraction, image composition, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening)) of an image acquired through the image sensor <NUM> or an image stored in the memory <NUM>. Additionally or alternatively, the image signal processor <NUM> may perform control (e.g., exposure time control, lead-out timing control, or the like) of at least one of the components (e.g., the image sensor <NUM>) included in the camera module <NUM>. The image processed by the image signal processor <NUM> may be again stored in the memory <NUM> for additional processing or may be transmitted to an external component of the camera module <NUM> (e.g., the memory <NUM>, the display device <NUM>, the electronic device <NUM>, the electronic device <NUM>, or server <NUM>). According to an embodiment, the image signal processor <NUM> may be configured as at least a part of the processor <NUM>, or may be configured as a separate processor operating independently of the processor <NUM>. When the image signal processor <NUM> is configured as a separate processor, the images processed by the image signal processor <NUM> may be displayed by the processor <NUM> through the display device <NUM> as they are or after being additionally image-processed.

According to an embodiment, the electronic device <NUM> may include two or more camera modules <NUM> having different properties or functions. In this case, for example, the at least one camera module <NUM> may be a wide-angle camera or a front camera and at least one other camera module may be a telephoto camera or a rear camera.

In the drawings described below, each operation may be implemented by an electronic device (e.g., the electronic device <NUM>), or a processor (e.g., the processor <NUM> or the image signal processor <NUM>) included in the electronic device. When each operation is implemented by the processor, the processor may perform each operation by executing instructions stored in the memory (e.g., the memory <NUM> or the memory <NUM>) of the electronic device.

<FIG> is a flowchart illustrating an operation of an electronic device for editing an image using a UI showing depth information of an image according to various embodiments.

Referring to <FIG>, in operation <NUM>, the electronic device (e.g., the electronic device <NUM>), the processor <NUM> or the image signal processor <NUM> may receive a user input for editing an image. For example, the electronic device may receive the user input for editing an image while displaying the image. As another example, the electronic device may receive a user input for editing one of a plurality of images while displaying thumbnails of the images.

In operation <NUM>, the electronic device may display a UI representing an image and depth information of the image in response to the reception of the user input for editing an image. The relationship of the UI representing an image, a depth map and depth information will be described in <FIG>.

Referring to <FIG>, the electronic device may obtain a color image 500a and a depth map 500b through at least one image sensor. The color image 500a may include color information (e.g., RGB values) of each pixel. The electronic device may display a background subject <NUM> and a foreground subject <NUM> by using the color information of each pixel included in the color image 500a. The depth map 500b may include depth values of each pixel. For example, when the electronic device supports a memory capacity of <NUM> byte per pixel, the depth value may be expressed as a value from <NUM> to <NUM>. According to an embodiment, the electronic device may be set such that the closer the distance between the electronic device and the subject is, the greater the depth value is, or the closer the distance between the electronic device and the subject is, the less the depth value is. Various embodiments of the present disclosure described below describe an example in which the depth value is increased as the distance between the electronic device and the subject is closer. According to an embodiment, the depth values of pixels may be different from each other, but the depth values of the plurality of pixels constituting a part of an image region may be the same or similar to each other. For example, the depth values of the pixels constituting the foreground subject <NUM> in the color image 500a may be the same or similar to each other, and the depth values of the pixels constituting the background subject <NUM> may be the same or similar to each other. In this case, the pixels constituting an image region <NUM> (i.e., the region corresponding to the background subject <NUM>) in the depth map 500b may be represented at the same or similar brightness, and an image region <NUM> (i.e., the region corresponding to the foreground subject <NUM>) may be represented at the same or similar brightness.

According to an embodiment, the electronic device may generate a UI <NUM> representing the depth information of the image based on the depth map 500b. In various embodiments of the present disclosure, an image may refer to an image generated by combining a color image and a depth map. In various embodiments of the present disclosure, the depth information may include a depth value distribution of pixels. <FIG> illustrates a horizontal bar graph type of UI <NUM>, but the type of UI <NUM> is not limited to that shown in <FIG>, and may vary depending on the implementation scheme. For example, the UI <NUM> may be a vertical bar graph. According to an embodiment, the horizontal axis of the UI <NUM> may correspond to a depth value range (e.g., from <NUM> to <NUM>) of the depth map 500b, or may correspond to a value obtained by converting the depth value range into the range of <NUM> to <NUM>. According to an embodiment, the UI <NUM> may represent depth information of at least a region in the depth map 500b. For example, the depth values of the pixels corresponding to the image region <NUM> in the depth map 500b may be distributed in a specific range, so that the electronic device may display a depth range <NUM> representing the depth information of the image region <NUM> in the UI <NUM>. In the same principle, the electronic device may display a depth range <NUM> that represents the depth information of the image region <NUM> in the UI <NUM>.

In operation <NUM>, the electronic device may display at least a part of the object in the image based on the depth value of the object being added in the image and the depth information of the image. For example, the object may include a sticker, a label, a drawing, a memo, an image, a mosaic, or calligraphy. According to an embodiment, the electronic device may display at least a part of the object in the image by comparing the depth value of the object with the depth information of the region (which may be referred to as a first region) in which the object is displayed in the image. For example, referring to <FIG>, the object may be inserted at a location at which a part of the background subject <NUM> overlaps a part of the foreground subject <NUM>. The electronic device may compare the depth value of the object, the depth information of the image region <NUM> and the depth information of the image region <NUM> with one another. When the depth value of the object is greater than the maximum depth value of the image region <NUM>, the electronic device may display the entire object in the image. In this case, the object may be seen to the user as being arranged forward in the image. When the depth value of the object is less than the minimum depth value of the image region <NUM>, the electronic device may not display the object in the image. When the depth value of the object is less than the minimum depth value of the image region <NUM> and greater than the maximum depth value of the image region <NUM>, the electronic device may display only a part of the object that overlaps the image region <NUM>. In this case, the object may be arranged behind the foreground subject <NUM> in the image, and may be seen to the user as being arranged in front of the background subject <NUM>.

In operation <NUM>, the electronic device may display, in the UI, an indicator that indicates the depth value of the object. According to an embodiment, the electronic device may display the indicator in response to receiving a user input for selecting an object. The indicator may be displayed in the UI based on the relationship between the depth value of the object and the depth information of the image determined in operation <NUM>. For example, based on whether the depth value of the object is greater than the depth value of each of the pixels corresponding to the first region, the indicator may be arranged left (or top) or right (or bottom) in the UI.

The electronic device may provide a function of adjusting the depth of an object in the image by displaying a UI representing the depth value of the object and the depth information of the image. A specific embodiment for adjusting the depth of an object will be described in <FIG>.

<FIG>, <FIG> and <FIG> are views illustrating an operation of an electronic device for editing an image using a UI showing depth information of an image and an indicator representing a depth value of an object according to various embodiments. <FIG> may illustrate more specifically implemented operations of operations <NUM> and <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the electronic device (e.g., the electronic device <NUM>, the processor <NUM>, or the image signal processor <NUM>) may receive a user input for selecting an object while the UI representing the image and the depth information of the image is displayed. The user input for selecting an object may include at least one of operations of selecting one of various types of objects (e.g., a sticker, a label, a drawing, a memo, an image, a mosaic, or calligraphy) and arranging the selected object in the first region.

For example, referring to <FIG>, the electronic device may display an image 600a including the background and foreground subjects <NUM> and <NUM> and the UI <NUM> representing the depth information of the image 600a. For example, since the depth values of the pixels constituting the background subject <NUM> are the same or similar to each other and the depth values of the pixels constituting the foreground subject <NUM> may be the same or similar to each other, the UI <NUM> may include the depth range <NUM> representing the depth information of the image region corresponding to the background subject <NUM> and the depth range <NUM> representing the depth information of the image region corresponding to the foreground subject <NUM>. Although <FIG> illustrates the UI <NUM> in a horizontal form, which is arranged in a lower end area in the image 600a, the form and location of the UI <NUM> is not limited to those illustrated in <FIG>, and may be variously implemented depending on the implementation schemes. For example, the UI <NUM> may be arranged horizontally at an upper end in the image 600a, or vertically at the left or right side in the image. As another example, the UI <NUM> may be arranged horizontally on a lower or an upper screen than the image 600a, or vertically on the left or right screen rather than the image 600a. According to an embodiment, the UI <NUM> may be displayed in a transparent form. According to an embodiment, the lightness of each of the depth ranges <NUM> and <NUM> may be substantially equal to or different from each other.

In operation <NUM>, in response to the user input for selecting an object, the electronic device may display the object having a pre-determined depth value and the indicator representing the depth value of the object. For example, the predetermined depth value may be the maximum depth value of the image. In this case, the electronic device can display the entire object in the image. The object may be seen to the user as being arranged ahead of other subjects. The electronic device may display the indicator representing the depth of the object to be arranged at the leftmost (or rightmost) position in the UI. As another example, the predetermined depth value may be the minimum depth value of the image. In this case, the electronic device may not display the object in the image. The object may be seen to the user as being arranged behind other objects. The electronic device may display the indicator representing the depth of the object to be arranged at the rightmost (or leftmost) position in the UI.

For example, referring to <FIG>, the electronic device may display an object <NUM> and an indicator <NUM> representing the depth of the object <NUM> in response to receiving a user input <NUM> for selecting an object while the image 600a is displayed. According to an embodiment, the electronic device may further display an indicator <NUM> representing the state that the object <NUM> is currently being edited. According to an embodiment, the electronic device may set a default (i.e., predetermined) depth value of the object <NUM> to the maximum depth value of the image 600a. In this case, the object <NUM> may be seen to the user to be arranged most forward (i.e., forward of the foreground subject <NUM>) in the image 600a. The electronic device may display the indicator <NUM> such that the indicator <NUM> is arranged at the leftmost side in the UI <NUM>. Although <FIG> illustrates the indicator <NUM> arranged at the left side in proportion to the magnitude of the depth value, the indicator <NUM> may be set to be arranged at the right side in proportion to the magnitude of the depth value according to an implement scheme. The color or brightness of the indicator <NUM> may be substantially the same as or different from the color or brightness of each of the depth ranges <NUM> and <NUM>.

In operation <NUM>, the electronic device may receive a user input for moving the displayed indicator. For example, referring to <FIG>, the electronic device may receive a user input <NUM> for moving the indicator <NUM>. For example, the user input <NUM> may include a tap operation, a press operation, a pressure touch operation, a swipe operation, a flick operation, or a drag operation.

In operation <NUM>, the electronic device may modify the depth value of the object based on the indicator moved by the user input. For example, the electronic device may increase or decrease the depth value of the object based on the direction and travel distance of the moved indicator.

In operation <NUM>, the electronic device may display at least a part of the object in the image based on the modified depth value of the object and the depth information of the image. The electronic device may display at least a part of the object in the image by comparing the modified depth value of the object with the depth information of the region (i.e., the first region) in which the object is displayed in the image.

For example, referring to <FIG>, the electronic device may display at least a part of the object <NUM> having the modified depth value in response to the user input <NUM>. Since the indicator <NUM> has moved to the right (i.e., the direction in which the depth value decreases), the electronic device can reduce the depth value of the object <NUM> based on the travel distance of the indicator <NUM>. When the reduced depth value of the object <NUM> is smaller than the minimum depth value of the image area corresponding to the foreground subject <NUM> and greater than the maximum depth value of the image region corresponding to the background subject <NUM> (in other words, when the indicator <NUM> is arranged between the depth ranges <NUM> and <NUM> in the UI <NUM>), the electronic device may display the object <NUM> except for the region which overlaps the foreground subject <NUM> (where the object <NUM> may be seen to the user as being arranged in front of the background subject <NUM> and behind the foreground subject <NUM>).

According to an embodiment, the electronic device may provide a user experience of adjusting the depth of the object using a UI in which the depth ranges of the subjects are not represented. For example, referring to <FIG>, the UI <NUM> may not include the depth ranges <NUM> and <NUM> corresponding to the background subject <NUM> and the foreground subject <NUM>, respectively. In other words, the electronic device only analyzes the color image 500a and the depth map 500b to determine the depth range <NUM> and the depth range <NUM>, and does not display the determined depth ranges <NUM> and <NUM> through the display. In this case, the user of the electronic device may receive a visual effect in which the depth of the object <NUM> is modified using the relative position of the indicator <NUM> in the UI <NUM>, without visually comparing the position of the indicator <NUM> with the depth ranges <NUM> and <NUM>.

<FIG> is a view illustrating a sequence of operations of releasing an indicator representing the edited state of an object according to various embodiments.

Referring to <FIG>, while the object <NUM> and the indicator <NUM> representing that the object <NUM> is in the edit state are displayed in the image 600a, the electronic device may receive a user input <NUM> for selecting a region other than the object <NUM> in the image 600a. The user input <NUM> may include, for example, at least one or more tap operations.

According to an embodiment, in response to the user input <NUM>, the electronic device may release the display of the indicator <NUM>. Depending on the implement scheme, the electronic device may change the color of the indicator <NUM> in response to the user input <NUM>.

<FIG> is a view illustrating a sequence of operations of combining background images based on depth information of an image according to various embodiments.

Referring to <FIG>, the electronic device may receive a user input <NUM> for selecting a background image. Although <FIG> illustrates an example in which the electronic device receives the user input <NUM> while the object <NUM> is displayed, the electronic device may receive the user input <NUM> while the image 600a into which the object <NUM> is not inserted is displayed. For example, the user input <NUM> may include at least one or more tap operations.

According to an embodiment, in response to the user input <NUM>, the electronic device may combine a background image 600b having the predetermined depth value with the image 600a, and display an indicator <NUM> representing the depth value of the background image 600b in the UI <NUM>. For example, as illustrated in <FIG>, the predetermined depth value may be smaller than the depth value of the object <NUM> and greater than the maximum depth value of the depth information corresponding to the depth range <NUM> (i.e., the indicator <NUM> may be arranged between the indicator <NUM> and the depth range <NUM>). In this case, the electronic device may display the background image 600b except for the region that overlaps the object <NUM> and the foreground subject <NUM>. The background image 600b may be seen to the user as being located behind the foreground subject <NUM> and the object <NUM>.

Although not illustrated in <FIG>, the electronic device may display the background image 600b of which the depth is modified, in response to the user input for moving the indicator <NUM>. For example, when the indicator <NUM> is moved to the indicator <NUM> by the user input, the electronic device may display the background image 600b except for the region that overlaps the foreground subject <NUM>. The background image 600b may be seen to the user as being located behind the foreground subject <NUM>, and the object <NUM> may not be seen to the user.

The electronic device may provide a function of more easily combining the background image by adjusting the depth of the background image combined with the image using the UI representing the depth information and the depth value.

<FIG> are views illustrating a sequence of operations of editing the size of an object based on a modified depth value according to various embodiments. The operations illustrated in <FIG> may be operations that more specifically implement operations <NUM> and <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the electronic device may determine the size of the object based on the modified depth value of the object. For example, the electronic device may determine the size of the object based on the principle illustrated in <FIG>.

Referring to <FIG>, the distance between a depth <NUM> and a user may be shorter than the distance between a depth <NUM> and a user. When it is assumed that the electronic device is set to increase the depth value proportionally as the distance between the subject and the user (or the electronic device) is closer, the depth value of the depth <NUM> may be greater than that of the depth <NUM>. The electronic device may receive the user input for modifying the depth value of an object <NUM> having the depth value of the depth <NUM> into the depth value of the depth <NUM>. The depth value of the object <NUM> may be reduced by reference numeral <NUM>. The electronic device may modify the size (or area) of the object <NUM> into the size of an object <NUM> in proportion to the depth value reduced by reference numeral <NUM>.

In operation <NUM>, the electronic device may display the object of which the depth and size are modified, based on the modified depth value of the object, the size of the object and the depth information of the image. For example, referring to <FIG>, while the image 600a, the object <NUM>, and the indicator <NUM> are displayed, the electronic device may receive a user input <NUM> for moving the indicator <NUM> to the right side. For example, the user input <NUM> may include a tap operation, a press operation, a pressure touch operation, a swipe operation, a flick operation, or a drag operation. In response to the user input <NUM>, the electronic device may display the object of which the size is reduced in proportion to the distance that the indicator <NUM> is moved to the right (or the reduced depth value of the object <NUM>). In response to a user input <NUM> moving the indicator <NUM> to the right again, the electronic device may display the object <NUM> of which the depth value and size are further reduced.

The electronic device may provide a visual effect in which the perspective of the object is adjusted according to the depth, by adjusting the size of the object while modifying the depth value of the object using the UI representing the depth information.

<FIG> illustrates a sequence of operations of editing a plurality of objects in an image by using a UI representing depth information of the image according to various embodiments.

Referring to <FIG>, while the image 600a and the object <NUM> are displayed, the electronic device may receive a user input <NUM> for selecting another object <NUM>. For example, the another object <NUM> may include a sticker, a label, a drawing, a memo, an image, a mosaic, or calligraphy. Although an embodiment of selecting another object <NUM> different from the object <NUM> is illustrated in <FIG>, the another object <NUM> may include an object of the same kind as the object <NUM>.

According to an embodiment, in response to the user input <NUM>, the electronic device may display the another object <NUM> and an indicator <NUM> representing the depth of another object <NUM>. According to an embodiment, the electronic device may display another object <NUM> having a predetermined depth value. For example, the predetermined depth value may be the maximum depth value of the image 600a. In this case, the electronic device may display the indicator <NUM> arranged at the leftmost side of the UI <NUM>, and may display the entire another object <NUM> in the image 600a. The other object <NUM> may be seen to the user as being arranged at the front-most position in the image 600a. According to an embodiment, to represent that the other object <NUM> is currently in the edit state, the electronic device may release the display of the indicator <NUM> representing the edit state of the object <NUM> and may display an indicator <NUM> representing the edit state of the other object <NUM>. According to an embodiment, the color or brightness of the indicator <NUM> may be substantially the same as or at least partially different from those of the indicator <NUM>.

According to an embodiment, while the other object <NUM> is displayed, the electronic device may receive a user input <NUM> for moving the indicator <NUM>. In response to the user input <NUM>, the electronic device may display at least a part of the other object <NUM> of which the depth is modified. For example, since the indicator <NUM> is moved to the right (i.e., the direction in which the depth value is decreased), the electronic device may determine the reduced depth value of the other object <NUM> based on the distance that the indicator <NUM> moves. When the reduced depth value of the other object <NUM> is less than the minimum depth value of the image region corresponding to the foreground subject <NUM> and greater than the depth value of the object <NUM> (i.e., the indicator <NUM> is arranged between the depth range <NUM> and the indicator <NUM> in the UI <NUM>), the electronic device may display the other object <NUM> except for the region which overlaps the foreground subject <NUM>. The other object <NUM> may be seen to the user as being located in front of the background subject <NUM> and the object <NUM> and behind the foreground subject <NUM>.

The electronic device may easily adjust the depth of each of a plurality of objects in an image by using a UI representing depth information. Although not illustrated in <FIG>, the electronic device adjusts the size of the other object <NUM> based on the same or similar principle as that of the operations described in <FIG>, so that the electronic device may provide a visual effect in which the perspective of each of the plurality of objects is adjusted.

<FIG> illustrate a sequence of operations of selecting a subject in an image by using a UI representing depth information of the image according to various embodiments. The operations illustrated in <FIG> may be operations that more specifically implement operation <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the electronic device (e.g., the electronic device <NUM>, the processor <NUM>, or the image signal processor <NUM>) may receive an input for selecting a depth range. For example, referring to <FIG>, the electronic device may display an image 1400a and a UI <NUM> representing depth information of the image 1400a. The image 1400a may include background subjects <NUM> and <NUM>, and a foreground subject <NUM>. The UI <NUM> may include a depth range <NUM> representing depth information of the image region corresponding to the background subject <NUM>, a depth range <NUM> representing depth information of the image region corresponding to the background subject <NUM>, and a depth range <NUM> representing depth information of the image region corresponding to the foreground subject <NUM>. The colors or brightness of the depth ranges <NUM>, <NUM> and <NUM> may substantially be the same as, or at least partially different from each other based on the depth information. The electronic device may receive a user input for moving an indicator <NUM> for selecting a depth range. For example, as illustrated in <FIG>, the electronic device may receive the user input for moving the indicator <NUM> such that the indicator <NUM> indicates the depth range <NUM>. Although an embodiment of selecting a depth range using two indicators is illustrated in <FIG>, various embodiments for selecting a depth range may be provided. For example, the user input for selecting a depth range may include at least one or more tap operations, press operations, pressure touch operations, pinch-in operations, pinch-out operations, button operations, or combinations thereof using a user's body (e.g., a finger) or an external device (e.g., a touch pen).

In operation <NUM>, in response to the user input for selecting a depth range, the electronic device may select an image region corresponding to the depth range selected in the image. For example, referring to <FIG>, in response to the user input for moving the indicator <NUM> indicating the depth range <NUM>, the electronic device may select the image area (e.g., the image region corresponding to the foreground subject <NUM> in the image 1400a) corresponding the depth range <NUM>.

In operation <NUM>, the electronic device may edit the selected image region. According to an embodiment, the electronic device may copy or remove the selected image region. For example, referring to <FIG>, the electronic device may remove another image region except for the image region corresponding to the foreground subject <NUM> from the image 1400a. As another example, although not illustrated in <FIG>, the electronic device may remove only the image region corresponding to the foreground subject <NUM> from the image 1400a.

According to an embodiment, the electronic device may combine the selected image region with another image. For example, referring to <FIG>, while an image 1500a and a UI <NUM> are displayed, the electronic device may receive a user input for selecting a depth range <NUM> in the UI <NUM> and may select the image region (i.e., the image region corresponding to the foreground subject <NUM>) corresponding to the selected depth range <NUM>. The electronic device may combine the selected image region with an image 1500b. The image 1500b may include background subjects <NUM> and <NUM>, and a foreground subject <NUM>. A UI <NUM> representing the depth information of the image 1500b may include a depth range <NUM> representing depth information of an image region corresponding to the background subject <NUM>, a depth range <NUM> representing depth information of an image region corresponding to the background subject <NUM>, and a depth range <NUM> representing depth information of an image region corresponding to the foreground subject <NUM>. According to an embodiment, the electronic device may combine the image region corresponding to the foreground subject <NUM> with the image 1500b and may display the depth range <NUM> of the combined image region in the UI <NUM>. According to an embodiment, in response to the user input for moving the depth range <NUM>, the electronic device may display the depth range <NUM> of which the location is changed and at least a part of the image region <NUM> of which the depth is modified.

Although an embodiment in which the depth range <NUM> is added into the UI <NUM> is illustrated in <FIG>, the electronic device may display the additional UI. For example, referring to <FIG>, the electronic device may display the UIs <NUM> and <NUM>. Although an example of arranging the UIs <NUM> and <NUM> are arranged in the image 1500b is illustrated in <FIG>, the locations and forms of the UIs <NUM> and <NUM> are not limited to those of <FIG>. For example, the UIs <NUM> and <NUM> may be arranged on the screen below the image 1500b. As another example, at least one of the UIs <NUM> and <NUM> may be displayed in a transparent form. As still another example, the UI <NUM> may be arranged on a top end of the UI <NUM>.

The electronic device may provide functions of more easily selecting and editing an image by selecting a specific image region in the image using a UI representing a depth range.

<FIG> is a flowchart illustrating an electronic device for displaying an object of which a depth value is modified based on a user input according to various embodiments.

Referring to <FIG>, in operation <NUM>, the electronic device (e.g., the electronic device <NUM>, the processor <NUM>, or the image signal processor <NUM>) may display an image including at least one subject through the display device (e.g., the display device <NUM>). For example, the image may include an image captured through the camera sensor of the electronic device or a preview image.

In operation <NUM>, the electronic device may display the object within the displayed image. The object may include, for example, a sticker, a label, a drawing, a memo, an image, a mosaic, or calligraphy. For example, an electronic device may display an object in response to receiving a user input for inserting an object in the image.

In operation <NUM>, the electronic device may modify the depth value of the object based on the received user input. The user input may include various types of user inputs for modifying the depth of the displayed object. For example, the user input may include a tap operation, a press operation, a pressure touch operation, a hovering operation, a panning operation, a swipe operation, a flick operation, a hovering operation, a button input operation, a drag operation, or a combination thereof, using a user's body or an external device. In operation <NUM>, the electronic device may display at least a part of the object of which the depth is modified in response to receiving the user input.

<FIG> are views illustrating a sequence of operations of displaying an object of which a depth value is modified based on a user input according to various embodiments.

According to an embodiment, the electronic device may modify the depth value of the object based on the depth information or the color information of the region where the object moved based on the user input for moving the object is located. For example, referring to <FIG>, while an image 1710a into which an object <NUM> is inserted is displayed, the electronic device may receive a user input 1716a (e.g., a swipe action, a panning operation, a drag operation, or a flick operation) for moving the object <NUM> in a specific direction. In response to the user input 1716a, the electronic device may change the depth value of object <NUM> based on the depth or color information of the region in which the moved object <NUM> is located. For example, when the depth values or RGB values of a certain number or more of pixels among pixels in the region in which the moved object <NUM> is located are the same as or similar to those of the pixels constituting a subject <NUM>, the electronic device may display the entire object <NUM> in the image 1710a. The object <NUM> may be seen to the user as being arranged in front of the subject <NUM>. As another example, when the depth values or RGB values of a certain number or more of pixels among pixels in the region in which the moved object <NUM> is located are the same as or similar to those of the pixels constituting a background subject, the electronic device may display the object <NUM> except for the region that overlaps the subject <NUM> in the image 1710a. The object <NUM> may be seen to the user as being arranged behind the subject <NUM>.

According to an embodiment, the electronic device may modify the depth value of the object in response to a user input for modifying the depth value of the object by operating a button. For example, referring to <FIG>, while an image 1720a in which an object <NUM> is arranged in front of a subject <NUM> is displayed, the electronic device may receive a user input for selecting a button <NUM> to reduce the depth value of the object <NUM>. The electronic device may modify the depth value of the object <NUM> to be less than the minimum depth value of the image region corresponding to the subject <NUM> in response to a user input for selecting the button <NUM>. As another example, while the object <NUM> is displayed behind the subject <NUM>, in response to a user input for selecting a button <NUM> to increase the depth value of the object <NUM>, the electronic device may modify the depth value of the object <NUM> to be greater than the maximum depth value of the image region corresponding to the subject <NUM>.

According to another embodiment, the electronic device may modify the depth value of the object in a preview image. For example, referring to <FIG>, while a preview image 1730a is displayed, the electronic device may receive a user input <NUM> for auto-focusing a subject <NUM>. As illustrated as reference numeral 1730b of <FIG>, the electronic device may increase the depth value of the subject <NUM> or decrease the depth value of an object <NUM> in response to the user input <NUM>. While the object <NUM> is displayed behind the subject <NUM>, the electronic device may increase the depth value of the subject <NUM> in response to the user input for selecting a button <NUM>.

The electronic device may provide convenience to the user by displaying an object having a modified depth value in response to various user inputs in addition to a scheme using a UI representing depth information.

As described above, the electronic device (e.g., the electronic device <NUM>) disclosed in the present disclosure may include a display unit (e.g., the display <NUM>), a memory (e.g., the memory <NUM>) for storing instructions, and a processor (e.g., the processor <NUM> or the image signal processor <NUM>), where the processor may execute the stored instructions to display the image and a user interface (e.g., the UI <NUM>) representing the depth information of the image through the display unit in response to a first user input for editing the image (e.g., the image 600a), receive a second user input for selecting an object (e.g., the object <NUM>) to be added in the image, display at least a part of the object in the image based on a depth value of the object and depth information of a first region in which the object is located in the image, and display an indicator (e.g., the indicator <NUM>) representing the depth value of the object in the UI. According to an embodiment, the UI may be displayed in the image or on a lower end of the image.

According to an embodiment, the processor may execute the stored instructions to display the object having a predetermined depth value in the first region in response to the second user input, modify the predetermined depth value of the object in response to a third user input (e.g., the user input <NUM>) for moving the indicator, and display at least a part of the object in the image based on the modified depth value of the object and the depth information of the first region.

According to an embodiment, the processor may execute the stored instructions to determine a size of the object based on the modified depth value of the object, and display at least a part of the object in the image based on the modified depth value of the object, the depth information of the first region and the size of the object.

According to an embodiment, the processor may execute the stored instructions to receive a fourth user input (e.g., the background image 600b) for selecting a background image to be added in the image, and display at least a part of the background image in the image based on a depth value of the background image and the depth information of the image.

According to an embodiment, the processor may execute the stored instructions to receive a fifth user input for selecting a depth range in the UI, and display a second region corresponding to the selected depth range in the image. In addition, the processor may execute the stored instructions to combine an image of the second region with another image.

According to an embodiment, the processor may execute the stored instructions to display a second indicator (e.g., the indicator <NUM>) representing an edited state of the object in response to the second user input, and release the display of the second indicator in response to a sixth user input (e.g., the user input <NUM>) for selecting a region except the first region in the image.

As described above, a method of an electronic device disclosed in the present disclosure may include an operation of displaying an image (e.g., the image 600a) a user interface (e.g., the UI <NUM>) representing and depth information of the image in response to a first user input for editing the image, an operation of receiving a second user input for selecting an object (e.g., the object <NUM>) to be added in the image, an operation of displaying at least a part of the object in the image based on a depth value of the object and depth information of a first region in which the object is located in the image, and an operation of displaying an indicator (e.g., the indicator <NUM>) representing the depth value of the object in the UI.

According to an embodiment, the method may further include an operation of displaying the object having a predetermined depth value in the first region in response to the second user input, an operation of modifying the predetermined depth value of the object in response to a third user input (e.g., the user input <NUM>) for moving the indicator, and an operation of displaying at least a part of the object in the image based on the modified depth value of the object and the depth information of the first region.

According to an embodiment, the method may further include an operation of determining a size of the object based on the modified depth value of the object, and an operation of displaying at least a part of the object in the image based on the modified depth value of the object, the depth information of the first region and the size of the object.

According to an embodiment, the method may further include an operation of receiving a fourth user input for selecting a background image (e.g., the background image 600b) to be added in the image, and an operation of displaying at least a part of the background image in the image based on a depth value of the background image and the depth information of the image.

According to an embodiment, the method may further include an operation of receiving a fifth user input for selecting a depth range in the UI, and an operation of displaying a second region corresponding to the selected depth range in the image. In addition, the method may further include an operation of combining an image of the second region with another image.

According to an embodiment, the method may further include an operation of displaying a second indicator representing an edited state of the object in response to the second user input, and an operation of releasing the display of the second indicator in response to a sixth user input for selecting a region except the first region in the image.

As described above, the electronic device (e.g., the electronic device <NUM>) disclosed in the present disclosure may include at least one image sensor (e.g., the camera module <NUM> or the image sensor <NUM>), a display unit (e.g., the display <NUM>), a memory (e.g., the memory <NUM>) for storing instructions, and a processor (e.g., the processor or the image signal processor <NUM>), where the processor may execute the stored instructions to obtain a color image (e.g., the color image 500a) and a depth map (e.g., the depth map 500b) corresponding to the color image through the at least one image sensor, generate an image (e.g., the image 600a) by combining the color image with the depth map, display the image and a user interface (e.g., the UI <NUM>) representing depth information of the image through the display unit in response to a first user input for editing the image, receive a second user input for selecting an object (e.g., the object <NUM>) to be added in the image, display at least a part of the object in the image based on a depth value of the object and depth information of a first region in which the object is located in the image, and display an indicator (e.g., the indicator <NUM>) representing the depth value of the object in the UI.

According to an embodiment, the processor may execute the stored instructions to receive a fourth user input for selecting a background image (e.g., the background image 600b) to be added in the image, and display at least a part of the background image in the image based on a depth value of the background image and the depth information of the image.

According to an embodiment, the processor may execute the stored instructions to receive a fifth user input for selecting a depth range in the UI, and display a second region corresponding to the selected depth range in the image.

The electronic device according to various embodiments disclosed in the present disclosure may be various types of devices. The electronic device may include, for example, at least one of a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a mobile medical appliance, a camera, a wearable device, or a home appliance. The electronic device according to an embodiment of the present disclosure should not be limited to the above-mentioned devices.

It should be understood that various embodiments of the present disclosure and terms used in the embodiments do not intend to limit technologies disclosed in the present disclosure to the particular forms disclosed herein; rather, the present disclosure should be construed to cover various modifications, equivalents, and/or alternatives of embodiments of the present disclosure. With regard to description of drawings, similar components may be assigned with similar reference numerals. As used herein, singular forms may include plural forms as well unless the context clearly indicates otherwise. In the present disclosure disclosed herein, the expressions "A or B", "at least one of A or/and B", "A, B, or C" or "one or more of A, B, or/and C", and the like used herein may include any and all combinations of one or more of the associated listed items. The expressions "a first", "a second", "the first", or "the second", used in herein, may refer to various components regardless of the order and/or the importance, but do not limit the corresponding components. The above expressions are used merely for the purpose of distinguishing a component from the other components. It should be understood that when a component (e.g., a first component) is referred to as being (operatively or communicatively) "connected," or "coupled," to another component (e.g., a second component), it may be directly connected or coupled directly to the other component or any other component (e.g., a third component) may be interposed between them.

The term "module" used herein may represent, for example, a unit including one or more combinations of hardware, software and firmware. The term "module" may be interchangeably used with the terms "logic", "logical block", "part" and "circuit". The "module" may be a minimum unit of an integrated part or may be a part thereof. The "module" may be a minimum unit for performing one or more functions or a part thereof. For example, the "module" may include an application-specific integrated circuit (ASIC).

Various embodiments of the present disclosure may be implemented by software (e.g., the program <NUM>) including an instruction stored in a machine-readable storage media (e.g., an internal memory <NUM> or an external memory <NUM>) readable by a machine (e.g., a computer). The machine may be a device that calls the instruction from the machine-readable storage media and operates depending on the called instruction and may include the electronic device (e.g., the electronic device <NUM>). When the instruction is executed by the processor (e.g., the processor <NUM>), the processor may perform a function corresponding to the instruction directly or using other components under the control of the processor. The instruction may include a code generated or executed by a compiler or an interpreter. The machine-readable storage media may be provided in the form of non-transitory storage media. Here, the term "non-transitory", as used herein, is a limitation of the medium itself (i.e., tangible, not a signal) as opposed to a limitation on data storage persistency.

According to an embodiment, the method according to various embodiments disclosed in the present disclosure may be provided as a part of a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of machine-readable storage medium (e.g., a compact disc read only memory (CD-ROM)) or may be distributed only through an application store (e.g., a Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or generated in a storage medium such as a memory of a manufacturer's server, an application store's server, or a relay server.

Claim 1:
An electronic device comprising:
at least one image sensor;
a display unit;
a memory configured to store instructions; and
a processor,
wherein the processor executes the stored instructions to:
obtain, via the at least one image sensor, a color image and a depth map corresponding to the color image;
generate an image by combining the color image with the depth map;
in response to a first user input for editing the image, display the image and a user interface, UI, representing a depth value distribution of pixels of the image through the display unit, wherein the depth value distribution of pixels (<NUM>) is determined based on the depth map;
while displaying the image and the UI, receive a second user input for selecting an object to be added in the image;
in response to the second user input, display at least a part of the object in the image based on a predetermined depth value of the object and depth information of a first region in which the object is located in the image; and
display a first indicator representing the predetermined depth value of the object in the UI;
characterized in that, the processor executes the stored instructions to:
receive a third user input for selecting a depth range in the UI;
display a second region corresponding to the selected depth range in the image; and
combine an image of the second region with another image.