Electronic device and method for providing content based on the motion of the user

An electronic device includes a sensor, a display, a processor operatively coupled to the sensor and the display, and a memory operatively coupled to the processor. The memory stores instructions that, when executed by the processor, causes the processor to identify a first body part of a user based on the at least one sensor, identify a virtual region spaced apart by a designated distance from the first body part, based on the identified first body part, identify a second body part distinct from the first body part within the virtual region, based on the at least one sensor, and change at least part of content displayed on the display based on a position of the second body part within the virtual region.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based on and claims priority under 35 U.S.C. 119 to Korean Patent Application No. 10-2018-0153737 filed on Dec. 3, 2018, in the Korean Intellectual Property Office, the disclosure of which is herein incorporated by reference in its entirety.

BACKGROUND

Various embodiments relate to a method for providing content based on a motion of a user in an electronic device, and the electronic device supporting the method.

2. Description of Related Art

With the technical advancement, an electronic device (e.g., a smartphone, etc.) includes various sensors to perform a specific sensing function. The electronic device may use the sensing function to provide content, based on a motion of a user.

SUMMARY

An electronic device according to various embodiments may include at least one sensor, a display, a processor operatively coupled to the at least one sensor and the display, and a memory operatively coupled to the processor. The memory may store instructions, when executed, for allowing the processor to identify a first body part of a user based on the at least one sensor, identify a virtual region spaced apart by a designated distance from the first body part, based on the identified first body part, and in response to identifying a second body part distinct from the first body part within the virtual region, based on the at least one sensor, change at least part of content displayed on the display based on a position of the second body part within the virtual region.

An electronic device according to various embodiments may include at least one sensor, a communication interface, a processor operatively coupled to the at least one sensor and the communication interface, and a memory operatively coupled to the processor. The memory may store instructions, when executed, for allowing the processor to identify an external electronic device distinct from the electronic device via the communication interface, identify a first body part of a user based on the at least one sensor while the content is displayed, identify a virtual region spaced apart by a designated distance from the first body part, in response to identifying the first body part, and in response to identifying a second body part distinct from the first body part within the virtual region, change at least part of the display content based on a position of the second body part within the virtual region, based on the at least one sensor, while the content is displayed.

An electronic device according to various embodiments may include at least one sensor, a display, a processor operatively coupled to the at least one sensor and the display, and a memory operatively coupled to the processor. The memory may store instructions, when executed, for allowing the processor to in response to identifying a body part of a user at a first position based on the at least one sensor, display a visual element within the display based on the first position and a motion of the body part of the user spaced apart from the display, identify that the user moves from the first position to a second position while the visual element is displayed, identify the body part of the user who moves to the second position, in response to identifying that the user moves from the first position to the second position, and change a position of a visual element displayed within the display based on the second position and a motion of the body part of the user, in response to identifying the body part of the user who moves to the second position.

An electronic device according to various embodiments may provide a method for controlling content based on a motion of a user.

An electronic device according to various embodiments may provide a method for controlling content by rapidly detecting a motion of a user even in low illuminance.

Advantages acquired in various embodiments of the disclosure are not limited to the aforementioned advantages, and other advantages not mentioned herein can be clearly understood by those skilled in the art to which the disclosure pertains from the following descriptions.

DETAILED DESCRIPTION

FIG. 1is a block diagram illustrating an electronic device (101) in a network environment (100) according to various embodiments. Referring toFIG. 1, the electronic device (101) in the network environment (100) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to an embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to an embodiment, the electronic device (101) may include a processor (120), memory (130), an input device (150), a sound output device (155), a display device (160), an audio module (170), a sensor module (176), an interface (177), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (SIM) (196), or an antenna module (197). In some embodiments, at least one (e.g., the display device (160) or the camera module (180)) of the components may be omitted from the electronic device (101), or one or more other components may be added in the electronic device (101). In some embodiments, some of the components may be implemented as single integrated circuitry. For example, the sensor module (176) (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented as embedded in the display device (160) (e.g., a display).

The auxiliary processor (123) may control at least some of functions or states related to at least one component (e.g., the display device (160), the sensor module (176), or the communication module (190)) among the components of the electronic device (101), instead of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active state (e.g., executing an application). According to an embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module (180) or the communication module (190)) functionally related to the auxiliary processor (123).

The input device (150) may receive a command or data to be used by other component (e.g., the processor (120)) of the electronic device (101), from the outside (e.g., a user) of the electronic device (101). The input device (150) may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus pen).

The antenna module (197) may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device (101). According to an embodiment, the antenna module (197) may include a plurality of antennas. In such a case, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network (198) or the second network (199), may be selected, for example, by the communication module (190) (e.g., the wireless communication module (192)) from the plurality of antennas. The signal or the power may then be transmitted or received between the communication module (190) and the external electronic device via the selected at least one antenna.

According to an embodiment, commands or data may be transmitted or received between the electronic device (101) and the external electronic device (104) via the server (108) coupled with the second network (199). Each of the electronic devices (102) and (104) may be a device of a same type as, or a different type, from the electronic device (101). According to an embodiment, all or some of operations to be executed at the electronic device (101) may be executed at one or more of the external electronic devices (102), (104), or (108). For example, if the electronic device (101) should perform a function or a service automatically, or in response to a request from a user or another device, the electronic device (101), instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device (101). The electronic device (101) may provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing, distributed computing, or client-server computing technology may be used, for example.

FIG. 2Aillustrates an example of a functional structure of an electronic device101for displaying content based on a motion of a user according to various embodiments. At least part of the functional structure ofFIG. 2Amay be included in the electronic device101ofFIG. 1.

Referring toFIG. 2A, the electronic device101may include a processor120, a sensor module176, and a display unit160. However, the disclosure is not limited thereto, and thus some components may be omitted.

In various embodiments, the sensor module176may include a Dynamic Vision Sensor (DVS) module210. The DVS module210may sense the motion of the user. According to an embodiment, the DVS module210may use at least one sensor to sense a portion where motion has occurred in a subject. The DVS module210may trace a motion trajectory of the portion where the motion has occurred.

According to an embodiment, the DVS module210may include a plurality of light receiving elements. The DVS module210may configure a plurality of pixels from the plurality of light receiving elements. The DVS module210may measure an intensity of light introduced from the outside through each of the plurality of pixels. The DVS module210may identify that the subject moves when an intensity change of light introduced from the outside from each of the plurality of pixels is greater than or equal to a threshold. Data output from the DVS module210may include data related to one or more pixels in which the intensity change of light is greater than or equal to the threshold among intensities of light output from all of the plurality of pixels. In an embodiment, among the intensities of light output from all of the plurality of pixels, data related to one or more pixels in which the intensity change of light is less than or equal to the threshold or less than the threshold may be excluded from the data output from the DVS module210.

According to an embodiment, the DVS module210may include a plurality of DVSs. The DVS module210may detect a 3-dimensional motion of the subject. In an embodiment, the 3-dimensional motion of the subject may be detected based on a distance between the plurality of DVSs. In an embodiment, the 3-dimensional motion of the subject may be detected based on a difference of the plurality of DVSs (e.g., a parallax between images measured respectively in the plurality of DVSs). The DVS module210may represent the motion of the subject on a 3-dimensional coordinate. According to an embodiment, the DVS module210may transmit information on the motion of the identified subject to the processor120.

According to an embodiment, the DVS module210may operate when a brightness change of the pixel is greater than or equal to a threshold. The DVS module210may detect the motion of the subject also in a dark environment (e.g., a low illuminance less than or equal to about 10 Lux). Since the DVS module210operates in response to the brightness change of the pixel, energy may be less consumed.

In some embodiments, the sensor module176may include one or more image sensors (not shown) for detecting the 3-dimensional motion of the subject. Based on a distance or parallax between the one or more image sensors, the sensor module176or the processor120may measure the 3-dimensional motion of the subject.

In various embodiments, the display unit160may output content, data, or signals. According to an embodiment, the display unit160may display image data processed by the processor120. According to an embodiment, the display unit160may use a beam to display content by projecting a screen on a plane of incidence. The display unit160may include a circuit for projecting the screen through a beam or a light source for outputting the beam.

According to an embodiment, the display unit160may be configured with an integrated touch screen by being coupled with a plurality of touch sensors capable of receiving a touch input. When the display unit160is configured with the touch screen, the plurality of touch sensors may be disposed above the display unit160or may be disposed below the display unit160.

In various embodiments, the processor120may provide overall control to the electronic device101. According to an embodiment, to provide overall control to the electronic device101, the processor120may be operatively coupled to other components in the electronic device101, such as the sensor module176or the display unit160. According to an embodiment, the processor120may receive a command of other components (e.g., the sensor module176or the display unit160). The processor120may interpret the received command. The processor120may perform computations according to the interpreted command, and may process data. The processor120may be implemented in software, or may be implemented in hardware such as a chip or a circuitry, or may be implemented in a combination of software and/or hardware. The processor120may be one entity or may be a combination of a plurality of processors.

According to an embodiment, the processor120may interpret a message, data, command, or signal received from the sensor module176or the display unit160. The processor120may process the message, data, command, or signal received from the sensor module176or the display unit160. The processor120may generate a new message, data, command, or signal based on the received message, data, command, or signal. The processor120may provide the processed or generated message, data, command, or signal to the sensor module176or the display unit160.

In various embodiments, the processor120may identify the user of the electronic device101via the DVS module210. The processor120may identify a first body part of the user of the electronic device101. According to an embodiment, the first body part may include at least one of an arm, a torso, a shoulder, an eye, and a head.

According to an embodiment, the processor120may identify (or determine) a virtual region spaced apart by a designated distance from the first body part. According to an embodiment, the processor120may identify the virtual region spaced apart by the designated distance from the first body part, in response to identifying the first body part. According to an embodiment, the processor120may set the designated distance based on the user identified by using the DVS module210. For example, the processor120may change the designated distance based on a distance between the identified user and the electronic device101. According to an embodiment, the processor120may identify the virtual region spaced apart from the first body part, in a space accessible through a second body part (e.g., a hand, a palm, or an elbow) of the user. According to an embodiment, the virtual region may imply a region invisible to eyes of the user of the electronic device101but recognizable as a screen by the user.

According to an embodiment, the processor120may identify (or determine) the virtual region based on the display unit160. For example, the processor120may identify the virtual region so as to have a ratio of a resolution of the display unit160. For example, when the display unit160has a Full High Definition (FHD) resolution, the processor120may identify a ratio of the virtual region as a ratio of 16:9. For another example, when the display unit160has the FHD resolution, the processor120may identify the virtual region through an absolute coordinate having the ratio of 16:9. According to an embodiment, the processor120may identify the virtual region based on the user of the electronic device101. For example, the processor120may identify a length from the eyes to waist of the user of the electronic device101as a vertical length of the virtual region. The processor120may identify a horizontal length of the virtual region based on the resolution of the display unit160. The processor120may identify the virtual region so that the virtual region is located at a center of the user's body.

According to an embodiment, the processor120may change the display of content based on a position of the second body part of the user of the electronic device101. According to an embodiment, the second body part may include at least one of a hand, a palm, a finger, and an elbow. According to an embodiment, the processor120may identify that the second body part of the user approaches (or enters) the virtual region. The processor120may identify a position where the second body part of the user enters within virtual region. The processor120may identify a point (or area) within a display region displayed via the display unit160corresponding to the position where the second body part of the user enters. The processor120may change the display of content of the point (or area) within the display region.

According to an embodiment, the processor120may identify an absolute coordinate of the virtual region at the position where the second body part of the user enters. The processor120may change the display of content displayed on the point (or area) of the display region displayed via the display unit160, corresponding to the identified absolute coordinate of the virtual region. According to an embodiment, the processor120may change the display of content based on a motion of the second body part of the user of the electronic device101. For example, the processor120may recognize a tap action within the display region displayed via the display unit160, in response to identifying that a hand of the user of the electronic device101enters the virtual region. For another example, the processor120may recognize a drag-and-drop action within the display region displayed via the display unit160, in response to identifying that the user of the electronic device101moves to the right within the virtual region with a clenched fist.

In various embodiments, in response to identifying a body part of the user located at the first position, the processor120may display a visual element via the display unit160based on the first position and the motion of the body part of the user spaced apart from the display unit160. According to an embodiment, the first position where the user of the electronic device101is located may be located within a region measurable by the DVS module210. According to an embodiment, the body part of the user may include at least one of a hand, a finger, a foot, a head, a hand, and an elbow. According to an embodiment, the visual element may include a cursor. According to an embodiment, the processor120may identify (or determine) a first virtual region in front of the user located at the first position. The processor120may display the visual element based on the motion of the user's body part within the first virtual region.

According to an embodiment, the processor120may identify that the user of the electronic device101moves from the first position to the second position. The processor120may identify the movement of the user via the DVS module210. According to an embodiment, the movement of the user from the first position to the second position may include that the user rotates in place or that a geographical position of the user changes. According to an embodiment, the second position may be located within a region measurable by the DVS module210.

According to an embodiment, the processor120may identify the body part of the user who moves to the second position, in response to identifying the movement of the user of the electronic device101from the first position to the second position. According to an embodiment, the processor120may identify the user who moves to the second position, and may identify the body part of the user.

According to an embodiment, the processor120may change a position of the visual element displayed via the display unit160based on the second position and the motion of the user's body part, in response to identifying the body part of the user of the electronic device101. For example, the processor120may change a position of a cursor according to a motion of a hand of the user located at the second position. According to an embodiment, the processor120may identify (or determine) a second virtual region in front of the user located at the second position. The processor120may change the position of the visual element displayed via the display unit160based on the motion of the user's body part within the second virtual region.

FIG. 2Billustrates another example of a functional structure of the electronic device101for displaying content based on a motion of a user and an external electronic device201according to various embodiments. At least part of the functional structure ofFIG. 2Amay be included in the electronic device101ofFIG. 1.

Referring toFIG. 2B, the electronic device101may include the processor120, the sensor module176, and a communication module190. The external electronic device201may include a processor220, a communication module290, and a display unit260. However, the disclosure is not limited thereto, and thus some components may be omitted.

In various embodiments, the electronic device101may operate by establishing a connection with the external electronic device201. According to an embodiment, the external electronic device201may include at least one of electronic devices for displaying a screen such as a projector or a TV. According to an embodiment, the electronic device101may include at least one of electronic devices having a sensor for detecting a motion of the user of the electronic device101. According to an embodiment, the electronic device101and the external electronic device201may be connected through at least one of a Bluetooth communication scheme, a Bluetooth Low Energy (BLE) communication scheme, a Wireless Fidelity (Wi-Fi) communication scheme, a cellular or mobile communication scheme, and a wired communication scheme.

In various embodiments, the sensor module176and DVS module210of the electronic device101may perform an operation similar to those of the sensor module176and DVS module210described inFIG. 2A.

In various embodiments, the communication module190of the electronic device101may be used to generate or establish a communication path between the external electronic device201and the electronic device101. For example, the communication module190may be a module for at least one of a Bluetooth communication scheme, a Bluetooth Low Energy (BLE) communication scheme, a Wireless Fidelity (Wi-Fi) communication scheme, a cellular or mobile communication scheme, and a wired communication scheme. The communication module190may provide the processor120with a signal, information, data, or messages received from the one or more external electronic devices. The communication module190may transmit to the at least one or more external electronic devices the signal, information, data, or messages provided from the processor120.

In various embodiments, the processor120of the electronic device101may perform an operation similar to that of the processor120described inFIG. 2A. According to an embodiment, the processor120may identify the external electronic device201via the communication module190. The processor120may generate or establish a communication path between the external electronic device201and the electronic device101via the communication module190.

In various embodiments, the communication module290of the external electronic device201may perform an operation similar to that of the communication module190of the electronic device101.

In various embodiments, the display unit260of the external electronic device201may perform an operation similar to that of the display unit160ofFIG. 2A. According to an embodiment, the external electronic device201may include a beam projector. The display unit260may include a structure (or circuit) for projecting a screen through a beam or a light source. For example, the display unit260may include a structure (or circuit) for projecting a screen through at least one of a Liquid Crystal Display (LCD) scheme, a Cathode Ray Tube (CRT) scheme, and a Digital Light Processing (DLP) scheme.

In various embodiments, the processor220of the external electronic device201may provide overall control to the external electronic device201. According to an embodiment, to provide overall control to the external electronic device201, the processor220may be operatively coupled to other components in the electronic device201, such as the communication module290or the display unit260. According to an embodiment, the processor220may receive a command of other components (e.g., the communication module290or the display unit260). The processor220may interpret the received command. The processor220may perform computations according to the interpreted command, and may process data. The processor120may be implemented in software, or may be implemented in hardware such as a chip or a circuitry, or may be implemented in a combination of software and/or hardware. The processor220may be one entity or may be a combination of a plurality of processors.

According to an embodiment, the processor220may interpret a message, data, command, or signal received from the communication module290or the display unit260. The processor220may process the message, data, command, or signal received from the communication module290or the display unit260. The processor220may generate a new message, data, command, or signal based on the received message, data, command, or signal. The processor220may provide the processed or generated message, data, command, or signal to the communication module290or the display unit260.

According to an embodiment, the processor220of the external electronic device201may receive information on content via the communication module290from the electronic device101. The processor220may display the content via the display unit260. For example, if the external electronic device201is a projector, the processor220may receive the information on the content to be displayed from the electronic device101via the communication module290. The processor220may control the display unit260to project the content on a plane of incidence.

FIG. 3Aillustrates an example of an electronic device101for displaying content based on a motion of a user according to various embodiments. The electronic device101ofFIG. 3Aaccording to an embodiment may be related to the electronic device101ofFIG. 2A.

Referring toFIG. 3A, a processor120of the electronic device101may detect a motion of a user340within a measurement region330-1measurable by using a DVS module210. The processor120may identify the user340. The processor120may identify a first body part of the user340. For example, the processor120may identify a torso of the user340. According to an embodiment, the processor120may identify (or determine) a virtual region320-1spaced apart by a designated distance from the first body part of the user340. For example, the processor120may identify (or determine) the virtual region320-1at a position accessible through a second body part (e.g., a hand, a palm, or an elbow) of the user340. According to an embodiment, the processor120may identify that the second body part of the user340enters the virtual region320-1via the DVS module210. The processor120may identify an absolute coordinate of a position where the second body part of the user340enters within the virtual region320-1. The processor120may identify a point (or area) within a display region310-1corresponding to the absolute coordinate of the position where the second body part of the user340enters within the virtual region320-1. The processor120may change the display of content displayed on the point (or area) within a display region310-2. For example, the processor120may display a cursor on the point (or area) within the display region310-1. The processor120may move the cursor within the display region310-1according to the movement of the second body part of the user340within the virtual region320-1.

FIG. 3Billustrates an example of the electronic device101for displaying content based on a motion of a user and an external electronic device201according to various embodiments. The electronic device101ofFIG. 3Baccording to an embodiment may be related to the electronic device101ofFIG. 2B. The external electronic device201according to an embodiment may be related to the external electronic device201ofFIG. 2B.

Referring toFIG. 3B, the electronic device101may operate by establishing a wired or wireless communication connection with the external electronic device201. Although it is shown inFIG. 3Bthat the external electronic device201displays the display region310-2by projecting a screen, the disclosure is not limited thereto. According to an embodiment, the external electronic device201may include at least of electronic devices for displaying a screen (or content) such as a TeleVision (TV), a monitor, a Virtual Reality (VR) device, and a hologram image display device. According to an embodiment, the electronic device101may include at least one of electronic devices having a sensor for detecting a motion of the user340of the electronic device101. According to an embodiment, the electronic device101may establish a communication connection with the external electronic device201. For example, the processor120of the electronic device101may establish a connection with the external electronic device201through at least one of a Bluetooth communication scheme, a Bluetooth Low Energy (BLE) communication scheme, a Wireless Fidelity (Wi-Fi) communication scheme, a cellular or mobile communication scheme, and a wired communication scheme.

According to an embodiment, the processor120may detect the motion of the user340within a measurement region330-2measurable by using the DVS module210. The processor120may identify the user340. The processor120may identify a first body part of the user340. For example, the processor120may identify a torso of the user340. According to an embodiment, the processor120may identify (or determine) a virtual region320-2spaced apart by a designated distance from the first body part of the user340. For example, the processor120may identify (or determine) the virtual region320-2at a position accessible through a second body part (e.g., a hand, a palm, or an elbow) of the user340. According to an embodiment, the processor120may identify that the second body part of the user340enters the virtual region320-2via the DVS module210. The processor120may identify an absolute coordinate of a position where the second body part of the user340enters within the virtual region320-2. The processor120may identify a point (or area) within the display region310-2corresponding to the absolute coordinate of the position where the second body part of the user340enters within the virtual region320-1. The processor120may transmit, to the external electronic device201, information on a screen (or content) in which the display of content of the point (or area) within the display region is changed. The external electronic device201may display the display region310-2based on the information on the screen (or content), received from the electronic device101.

Hereinafter, the display region310-1and display region310-2ofFIG. 3AandFIG. 3Bmay be referred to as a display region310for convenience of explanation. The virtual region320-1and virtual region320-2ofFIG. 3AandFIG. 3Bmay be referred to as a virtual region320. The measurement region330-1and measurement region330-2ofFIG. 3AandFIG. 3Bmay be referred to as a measurement region330.

An electronic device (e.g., the electronic device101) according to various embodiments described above may include at least one sensor (e.g., the sensor module176), a display (e.g., the display unit160), a processor (e.g., the processor120) operatively coupled to the at least one sensor and the display, and a memory (e.g., the memory130) operatively coupled to the processor. The memory may store instructions, when executed, for allowing the processor to identify a first body part of a user (e.g., the user340) based on the at least one sensor, identify a virtual region (e.g., the virtual region320) spaced apart by a designated distance from the first body part, based on the identified first body part, identify a second body part distinct from the first body part within the virtual region, based on the at least one sensor, and change at least part of content displayed on the display based on a position of the second body part within the virtual region.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify a resolution of the display (e.g., the display unit160), and identify the virtual region (e.g., the virtual region320) based on a ratio of the resolution.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify a motion of the second body part within the virtual region (e.g., the virtual region320), and change at least part of the displayed content, based on the motion of the second body part.

According to various embodiments, the at least one sensor (e.g., the sensor module176) may include a Dynamic Vision Sensor (DVS) (e.g., the DVS module210).

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify the virtual region (e.g., the virtual region320) set as an absolute coordinate system.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify an absolute coordinate, based on a position of the second body part within the virtual region (e.g., the virtual region320), identify a position on the display, corresponding to the absolute coordinate, and change at least part of the content based on the identified position.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to change at least part of the content, in response to identifying that the second body part is deviated from the virtual region.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify a second user (e.g., the user340-2) distinct from the user (e.g., the user340), identify a second virtual region (e.g., the virtual region840) spaced apart by a designated distance from a first body part of the second user, in response to identifying the first body part of the second user, and change at least part of the content based on a position of the second body part of the second user within the second virtual region.

An electronic device (e.g., the electronic device101) according to various embodiments may include at least one sensor (e.g., the sensor module176), a communication interface (e.g., the communication module190), a processor (e.g., the processor120) operatively coupled to the at least one sensor and the communication interface, and a memory (e.g., the memory130) operatively coupled to the processor. The memory may store instructions, when executed, for allowing the processor to identify an external electronic device (e.g., the external electronic device201) distinct from the electronic device via the communication interface, identify a first body part of a user (e.g., the user340) based on the at least one sensor while the content is displayed, identify a virtual region spaced apart by a designated distance from the first body part, in response to identifying the first body part, and in response to identifying a second body part distinct from the first body part within the virtual region, change at least part of the display content based on a position of the second body part within the virtual region, based on the at least one sensor, while the content is displayed.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to establish a connection with the external electronic device (e.g., the external electronic device201) via the communication interface (e.g., the communication module190).

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify a motion of the second body part within the virtual region (e.g., the virtual region320), and change at least part of the displayed content, based on the motion of the second body part.

According to various embodiments, the at least one sensor (e.g., the sensor module176) may include a Dynamic Vision Sensor (DVS) (e.g., the DVS module210).

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify the virtual region (e.g., the virtual region320) set as an absolute coordinate system.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify an absolute coordinate, based on a position of the second body part within the virtual region (e.g., the virtual region320), and change at least part of the displayed content at a position corresponding to the absolute coordinate.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to change at least part of the displayed content, in response to releasing of the identifying of the second body part within the virtual area (e.g., the virtual region320).

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify a second user distinct from the user (e.g., the user340), identify a second virtual region spaced apart by a designated distance from a first body part of the second user, in response to identifying the first body part of the second user, and change at least part of the content based on a position of the second body part of the second user within the second virtual region.

According to various embodiments, an electronic device (e.g., the electronic device101) may include at least one sensor (e.g., the sensor module176), a display (e.g., the display unit160), a processor (e.g., the processor120) operatively coupled to the at least one sensor and the display, and a memory (e.g., the memory130) operatively coupled to the processor. The memory may store instructions, when executed, for allowing the processor to, in response to identifying a body part of a user (e.g., the user340) at a first position based on the at least one sensor, display a visual element within the display based on the first position and a motion of the body part of the user spaced apart from the display, identify that the user moves from the first position to a second position while the visual element is displayed, identify the body part of the user who moves to the second position, in response to identifying that the user moves from the first position to the second position, and change a position of a visual element displayed within the display based on the second position and a motion of the body part of the user, in response to identifying the body part of the user who moves to the second position.

According to various embodiments, the movement may include at least one of a rotation movement and a parallel movement.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify a first virtual region corresponding to the first position, and identify the body part of the user at the first position based on the first virtual region.

According to various embodiments, the instructions may allow the processor (e.g., the processor120) to identify a second virtual region distinct from the first virtual region and corresponding to the second position, in response to identifying that the user moves from the first position to the second position, and identify the body part of the user based on the second virtual region.

FIG. 4Aillustrates an example of an operation of the electronic device101according to various embodiments.

Referring toFIG. 4A, in operation401, the processor120may identify a first body part of the user340. According to an embodiment, the processor120may identify the first body part of the user340of the electronic device101based on at least one sensor (e.g., the DVS module210) of the electronic device101. According to an embodiment, the first body part may include at least one of an arm, a torso, a shoulder, a foot, a leg, an eye, and a head. According to an embodiment, the first body part may include a region consisting of a plurality of body parts. For example, the processor120may identify a region from an eye to a waist. According to an embodiment, the processor120may identify a position of the user340via the DVS module210. For example, the processor120may identify a direction and distance between the electronic device101and the user340.

According to an embodiment, when the electronic device101operates in connection with the external electronic device201, the processor120may identify the external electronic device201before identifying a body part of the user340. The processor120may identify the external electronic device201via the communication module190. According to an embodiment, the external electronic device201may be an electronic device for projecting content on a plane of incident. According to an embodiment, the external electronic device201may include at least one of electronic devices for displaying a screen (or content) such as a TeleVision (TV), a monitor, a Virtual Reality (VR) device, and a hologram image display device.

In operation403, the processor120may identify (or determine) the virtual region320spaced apart by a designated distance from the first body part. According to an embodiment, in response to identifying the first body part, the virtual region320spaced apart by the designated distance from the first body part may be identified (or determined). According to an embodiment, the processor120may set the designated distance based on the user340identified via the DVS module210. For example, the processor120may change the designated distance based on the distance between the user340and the electronic device101. According to an embodiment, the processor120may identify the virtual region320spaced apart from the first body part accessible through a second body part (e.g., a hand, a palm, or an elbow) of the user340. According to an embodiment, the virtual region320may imply a region invisible to eyes of the user340of the electronic device101but recognizable as a screen by the user340. According to an embodiment, the processor120may identify (or determine) the virtual region320as a coordinate system having an absolute coordinate. A method in which the processor120identifies (or determines) the virtual region320as the coordinate system having the absolute coordinate will be described below in detail with reference toFIG. 5AandFIG. 5B.

According to an embodiment, the processor120may identify (or determine) the virtual region320based on the display unit160. For example, the processor120may identify the virtual region320so as to have a ratio of a resolution of the display unit160. For example, when the display unit160has a High Definition (HD) resolution of 1360×768, the processor120may identify the ratio of the virtual region320as a ratio of 16:9. For another example, when the display unit160has the HD resolution, the processor120may identify the virtual region320through an absolute coordinate system having the ratio of 16:9. For another example, the processor120may identify (or determine) the virtual region320based on a shape (or figure) of the display unit160. For example, if the display unit160has a circular shape, the processor120may identify (or determine) the virtual region320as the circular shape. For another example, the processor120may identify (or determine) the virtual region320based on the display region310(e.g., the display region310-1or display region310-2ofFIG. 3AandFIG. 3B) displayed via the display unit160. For example, if the display region310displayed via the display unit160has a circular shape, the processor120may identify (or determine) the virtual region320as the circular shape.

According to an embodiment, the processor120may identify the virtual region320based on the user340of the electronic device101. For example, the processor120may identify a length from the eyes to waist of the user340of the electronic device101as a vertical length of the virtual region320. The processor120may identify a horizontal length of the virtual region320based on the resolution of the display unit160. The processor120may identify the virtual region320so that the virtual region is located at a center of the body of the user340.

In operation405, the processor120may change the display of content based on a position (or motion) of a second body part within the virtual region320. According to an embodiment, while the content is displayed in the display region310, the processor120may change the display of content based on the position of the second body part within the virtual region320, in response to identifying the second body part within the virtual region320, distinct from the first body part, based on at least one sensor (e.g., the DVS module210). The second body part may include at least one of a hand, a palm, a finger, and an elbow.

According to an embodiment, the processor120may identify that the second body part of the user340approaches (or enters) the virtual region320. The processor120may identify a position where the second body part of the user340enters within virtual region320. According to an embodiment, the processor120may identify a 3-dimensional position of the second body part of the user340. The processor120may obtain data (e.g., a coordinate value including three different numbers) corresponding to the identified 3-dimensional position.

The processor120may identify that the second body part of the user340approaches (or enters) the virtual region320. The processor120may identify an absolute coordinate in which the second body part of the user340enters within the virtual region320set as a 2-dimensional absolute coordinate system. The processor120may obtain data (e.g., a coordinate value including two different numbers) corresponding to an absolute coordinate based on the identified 2-dimensional absolute coordinate system. For example, the processor120may identify that a palm of the user340approaches the virtual region320. The processor120may identify an absolute coordinate of a position (or area) where the palm of the user340enters within the virtual region320set as a coordinate system of 1920×1080. For example, the processor120may identify that the palm of the user340enters a coordinate of (800, 1150) or a region including the coordinate of (800, 1150).

According to an embodiment, the processor120may change the display of content displayed on a point (or area) of the display region310displayed via the display unit160, corresponding to an absolute coordinate of the virtual region320. According to an embodiment, the processor120may change the display of content based on a motion of the second body part of the user340of the electronic device101.

For example, the processor120may recognize a tap action within the display region310displayed via the display unit160, in response to identifying that a hand of the user340of the electronic device101enters the virtual region320. For another example, the processor120may recognize a double click or double tap action within the display region310indicated via the display unit160, in response to identifying that a palm of the user340of the electronic device101enters the virtual region320two times continuously.

For another example, the processor120may recognize a drag-and-drop action, a swipe action, or a scroll action within the display region displayed via the display unit160, in response to identifying that the user340of the electronic device101moves to the right within the virtual region320with a clenched fist.

According to an embodiment, the processor120may change the display of content based on a motion speed of the second body part. For example, the processor120may identify that the palm of the user340approaches and changes to an action of clenching a fist, at a coordinate of the virtual region320corresponding to a position of first content of the display region310. Thereafter, the processor120may delete the first content based on a change in a position of a hand of the user340to the outside of the virtual region320with a speed higher than or equal to a designated speed.

For another example, the processor120may identify that the palm of the user340approaches and changes to an action of clenching a fist, at a coordinate of the virtual region320corresponding to a position of the first content of the display region310. Thereafter, the processor120may move the first content based on a change in a position of a hand of the user340to the outside of the virtual region320with a speed lower than a designated speed.

According to an embodiment, the processor120may identify that a plurality of second body parts of the user340approach (or enter) the virtual region320. For example, it may be identified that both hands of the user340approach (or enter) the virtual region320. For example, the processor120may change the display of content according to a motion of the both hands of the user340within the virtual region320.

According to an embodiment, the processor120may change the display of content based on a position (or motion) of the second body part and a voice of the user340. According to an embodiment, the electronic device101may include a circuit (or structure) for receiving the voice of the user340. For example, the processor120may identify that the palm of the user340approaches at a coordinate of the virtual region320corresponding to a position of an application displayed within the display region310. The processor120may identity that the palm of the user340approaches, and thereafter may identify an utterance of “execute” of the user340. The processor120may perform an operation of executing the application displayed within the display region310. According to an embodiment, the processor120may control an operation of the electronic device101based on the motion of the second body part within the virtual region320. For example, the processor120may control volume of the electronic device101based on the motion of the second body part.

FIG. 4Billustrates another example of an operation of the electronic device101according to various embodiments.

Referring toFIG. 4B, in operation410, the processor120may display a visual element (e.g., a cursor) via the display unit160based on a first position and a motion of a body part of the user340, spaced apart by a designated distance from the display unit160(e.g., the display), in response to identifying the body part of the user340at the first position based on at least one sensor (e.g., the DVS module210). According to an embodiment, the first position where the user340of the electronic device101is located may be located within the measurement region330(e.g., the measurement region330-1ofFIG. 3AandFIG. 3B) which is a region measurable by the DVS module210. According to an embodiment, the processor120may identify that the user is located at the first position via the DVS module210. For example, the processor120may identify a direction or distance between the electronic device101and the user340. According to an embodiment, the processor120may represent the measurement region330as a 3-dimensional coordinate. The processor120may identify a region where the user340of the electronic device101is located on the 3-dimensional coordinate. According to an embodiment, a body part of the user340may include at least one of a hand, a finger, a foot, a head, an arm, and an elbow. According to an embodiment, a visual element may include at least one of a cursor and content. For example, the processor120may identify a palm of the user340. The processor120may identify a motion of the palm of the user340. The processor120may move a cursor displayed within the display region310based on the identified motion of the palm of the user340. For example, the processor120may identify that the palm of the user340moves in an upper direction. The processor120may move the cursor displayed within the display region310to the upper direction based on the upward motion of the palm of the user340. According to an embodiment, the processor120may use the DVS module210to identify the motion of the user's body part in a situation where the electronic device101and the user340are spaced apart. For example, the processor120may measure an intensity of light introduced from the outside of the electronic device101via the DVS module210. When the body part of the user340moves, the processor120may identify a change in the light intensity measured at the body part of the user340. The processor120may identify that the body part of the user340moves within the measurement region330. According to an embodiment, the processor120may identify (or determine) a first virtual region in front of the user340located at the first position. The processor120may display the visual element based on the motion of the body part of the user340within the first virtual region.

In operation430, the processor120may identify that the user340of the electronic device101moves from the first position to the second position. According to an embodiment, the processor120may identify a movement of the user340via the DVS module210. The processor120may identify that a region where the user340of the electronic device101is located on a 3-dimensional coordinate changes from the first position to the second position. According to an embodiment, the movement of the user340from the first position to the second position may include that the user340rotates in place or that a geographical position of the user340changes. According to an embodiment, the second position may be located within the measurement region330measurable by the DVS module210.

In operation450, the processor120may identify the body part of the user340who moves to the second position, in response to identifying the movement of the user340from the first position to the second position. According to an embodiment, the processor120may identify the user340who moves to the second position and may identify the body part of the user340.

In operation470, the processor120may change a position of a visual element within the display region330based on the second position and the movement of the body part of the user340, in response to identifying the body part of the user340who moves to the second position. For example, the processor120may change a position of a cursor according to a motion of a hand of the user340located at the second position. According to an embodiment, the processor120may identify (or determine) a second virtual region in front of the user340located at the second position. The processor120may change the position of the visual element displayed via the display unit160based on the motion of the user's body part within the second virtual region. According to an embodiment, the processor120may newly identify the body part of the user340even if the user340moves from the first position to the second position. The processor120may change the position of the visual element based on the motion of the newly identified body part of the user340.

According to an embodiment, when the user340approaches a first point (or area) of the first virtual region at the first position, the processor120may display the visual element at a position (or area) of the display region310corresponding to the first point. When the user340approaches a second point (or area) of the second virtual region at the second position, the processor120may display the visual element at a position (or area) of the display region310corresponding to the second point. According to an embodiment, when the first point (or area) corresponds to the same position as the second point (or area), the processor120may display the visual element at the same position (or area) as the display region310. According to an embodiment, when the first point (or area) is different from the second point (or area), the visual element displayed at the position (or area) of the display region310corresponding to the first point may be displayed at the position (or area) of the display region310corresponding to the second point. When the visual element is displayed at the position (or area) of the display region310corresponding to the second point, the processor120may display the visual element by changing the position discontinuously at the position (or area) of the display region310corresponding to the first point.

FIG. 5Aillustrates an example in which a virtual region is set as an absolute coordinate system according to various embodiments.

Referring toFIG. 5A, the processor120may determine the virtual region320based on a shape (or figure) of the display region310displayed via the display unit160. For example, when the display region310displayed via the display unit160has a circular shape, the processor120may set (or determine) the virtual region320as the circular shape. For another example, when the display region310displayed via the display unit160has a rectangular shape, the processor120may set (or determine) the virtual region320as the rectangular shape. According to an embodiment, the processor120may identify the virtual region to have a ratio of a resolution of the display unit160. According to an embodiment, the processor120may identify the virtual region320by scaling the display region310displayed via the display unit160. For example, when the display unit160has a Full High Definition (FHD) resolution, the processor120may identify the ratio of the virtual region320as a ratio of 16:9. For another example, when the display unit160has the FHD resolution, the processor120may identify the virtual region320through an absolute coordinate system having the ratio of 16:9.

According to an embodiment, the processor120may identify (or determine) a coordinate system having an absolute coordinate according to the virtual region320of which a shape is determined. According to an embodiment, the processor120may identify a horizontal axis of the virtual region320as an X-axis. The processor120may identify a vertical axis of the virtual region320as a Y-axis. The processor120may identify an absolute coordinate of one point of the virtual region320as (x, y). According to an embodiment, the processor120may identify (or determine) the virtual region320having a rectangular shape consisting of points501to504. The processor120may identify (or determine) a center of the virtual region320as a center of the absolute coordinate system. The processor120may identify (or determine) the center of the virtual region320as an absolute coordinate of (0, 0). According to an embodiment, the coordinate of the points501to504of the virtual region may be identified (or determined) based on a resolution (or pixel) of the display unit160. For example, when the resolution of the display unit160is FHD of 1920×1080, the processor120may identify (or determine) the absolute coordinate of the point501as (−960, 540), the absolute coordinate of the point502as (−960, −540), the absolute coordinate of the point503as (960, −540), and the absolute coordinate of the point504as (960, 540) according to a pixel based on the resolution. According to an embodiment, the processor120may determine the absolute coordinate of the virtual region320in various manners. For example, the processor120may change an interval between grids by fixing the coordinate of the points501to504to a predetermined coordinate.

According to an embodiment, the processor120may map the absolute coordinate of the virtual region320to the display region310. The processor120may identify that a body part of the user340approaches (or enters) within the virtual region320. The processor120may identify an absolute coordinate of the virtual region320at a position where the body part of the user340approaches. The processor120may change content at the position of the display region310mapped to the absolute coordinate of the virtual region320.

FIG. 5Billustrates another example in which a virtual region is set as an absolute coordinate system according to various embodiments.

Referring toFIG. 5B, the processor120may identify (or determine) a coordinate system having an absolute coordinate according to the virtual region320of which a shape is determined. According to an embodiment, the processor120may identify a horizontal axis of the virtual region320as an X-axis. The processor120may identify a vertical axis of the virtual region320as a Y-axis. The processor120may identify an absolute coordinate of one point of the virtual region320as (x, y). According to an embodiment, the processor120may identify (or determine) the virtual region320having a rectangular shape consisting of points510to540. The processor120may identify (or determine) the point510of the virtual region320as a center of the absolute coordinate system. The processor120may identify (or determine) the point510of the virtual region320as an absolute coordinate of (0, 0). According to an embodiment, the coordinate of the points510to540of the virtual region may be identified (or determined) based on a resolution (or pixel) of the display unit160. For example, when the resolution of the display unit160is FHD of 1920×1080, the processor120may identify (or determine) the absolute coordinate of the point510as (0, 0), the absolute coordinate of the point520as (0, 1080), the absolute coordinate of the point530as (1920, 1080), and the absolute coordinate of the point540as (1920, 0), based on a pixel depending on the resolution. According to an embodiment, the processor120may determine the absolute coordinate of the virtual region320in various manners. For example, the processor120may change an interval between grids by fixing the coordinate of the points501to504to a predetermined coordinate.

Although it is described that the virtual region320has a rectangular shape with reference toFIG. 5AandFIG. 5Bfor convenience of explanation, the disclosure is not limited thereto, and thus the processor120may indicate the virtual region320having various shapes as an absolute coordinate system.

FIG. 6illustrates another example of the electronic device101for displaying content based on a motion of a user according to various embodiments.

Referring toFIG. 6, the processor120may identify the user340within the measurement region330via the DVS module210. The processor120may identify the virtual region320based on a position of the user340located within the measurement region330. The processor120may identify that a body part of the user340is located at a first point601. According to an embodiment, the processor120may identify that the body part of the user340approaches (or enters) the first point601within the virtual region320. The processor120may identify a first coordinate of the first point601in the virtual region320set as an absolute coordinate system. For example, the processor120may identify that an index finger of the user340approaches (or enters) the first point601of the virtual region320. The processor120may identify the first coordinate of the first point601where the index finger of the user340approaches (or enters).

According to an embodiment, the processor120may display the display region310corresponding to an absolute coordinate system of the virtual region320via the display unit160. The processor120may display a cursor630-1of a first position610within the display region310corresponding to the identified first coordinate. According to an embodiment, the processor120may perform at least one of click, tap, double click, and drag-and-drop actions through the cursor630-1based on a motion of the user340.

According to an embodiment, the processor120may identify the first point601where the body part of the user340is deviated from the virtual region320. The processor120may maintain a position of the cursor630-1of the first position610. According to an embodiment, the processor120may identify that the approach of the body part of the user340is released from the first point601of the virtual region320. The processor120may make the cursor630-1of the first position610hidden (or disappear), in response to identifying that the body part of the user340is deviated from the virtual region320.

According to an embodiment, the processor120may identify that a body part of the user340is located at a second point602. According to an embodiment, the processor120may identify that the body part of the user340approaches (or enters) the second point602within the virtual region320. The processor120may identify a second coordinate of the second point602in the virtual region320set as an absolute coordinate system. For example, the processor120may identify that an index finger of the user340approaches (or enters) the second point602of the virtual region320. The processor120may identify the second coordinate of the second point602where the index finger of the user340approaches (or enters).

According to an embodiment, the processor120may display a cursor630-2of a second position620within the display region310corresponding to the identified second coordinate. According to an embodiment, the processor120may display the cursor630-2at the second position620by discontinuously moving the cursor630-1located at the first position610to the second position620, in response to identifying the second coordinate of the second point602where a body part (e.g., an index finger) of the user340approaches (or enters). According to an embodiment, the processor120may display at the second position620the same cursor630-2as the cursor630-1which is hidden at the first position610, in response to identifying the second coordinate of the second point602where the body part (e.g., the index finger) of the user340approaches (or enters).

According to an embodiment, the processor120may identify that the body part of the user340moves from the first point601to the second point602within the virtual region320. The processor120may display the cursor630-2at the second position620by continuously moving to the second position620the cursor630-1located at the first position610, in response to identifying that the body part of the user340moves from the first point601to the second point602.

Although an example in which the display region310is displayed via the electronic device101is shown with reference toFIG. 6, the disclosure is not limited thereto. As shown inFIG. 3B, the electronic device101may establish a connection with the external electronic device201, and may display the display region310via the external electronic device201.

FIG. 7Aillustrates another example of the electronic device101for displaying content based on a motion of the user340according to various embodiments.

Referring toFIG. 7A, the processor120may identify the user340of the electronic device101located at a first position721via the DVS module210. The first position721where the user340of the electronic device101is located may be located within the measurement region330which is a region measurable by the DVS module210. The processor120may identify a direction or distance between the electronic device101and the user340. According to an embodiment, the processor120may represent the measurement region330as a 3-dimensional coordinate. The processor120may identify that a region where the user340of the electronic device101is located on the 3-dimensional coordinate is the first position721. The processor120may identify the first virtual region320-1based on the first position721.

According to an embodiment, the processor120may identify that a body part of the user340at the first position721is located at a point701. According to an embodiment, the processor120may identify that the body part of the user340approaches (or enters) the point701within the first virtual region320-1. The processor120may identify a first coordinate of the point701in the first virtual region320-1set as an absolute coordinate system. For example, the processor120may identify that an index finger of the user340approaches (or enters) the point701of the first virtual region320-1. The processor120may identify the first coordinate of the point701where the index finger of the user340approaches (or enters).

According to an embodiment, the processor120may display the display region310corresponding to an absolute coordinate system of the first virtual region320-1via the display unit160. The processor120may change the display of content of a point710within the display region310corresponding to the identified first coordinate. According to an embodiment, the point710may include a specific region.

According to an embodiment, the processor120may identify that the user340of the electronic device101moves from the first position721to a second position723along a direction725. According to an embodiment, the processor120may use the DVS module210to identify that the user340of the electronic device101moves from the first position721to the second position723on the identified 3-dimensional coordinate. The second position723may be located within the measurement region330which is a region measurable by the DVS module210.

According to an embodiment, the processor120may identify the second virtual region320-2in response to identifying that the user340of the electronic device101is located at the second position723. According to an embodiment, the processor120may newly set (or determine) the second virtual region320-2based on the user340of the second position723. For example, the processor120may identify the second virtual region320-2spaced apart by a designated distance from the first body part of the user340. The processor120may identify (or determine) the second virtual region320-2to have the same size and shape as the first virtual region320-1.

According to an embodiment, the processor120may identify that the body part of the user340located at the second position723is located at the point702. According to an embodiment, the processor120may identify that the body part of the user340approaches (or enters) the point702within the second virtual region320-2. The processor120may identify the second coordinate of the point702at the second virtual region320-2set as the absolute coordinate system. For example, the processor120may identify that an index finger of the user340approaches (or enters) the point702of the second virtual region320-2. The processor120may identify the second coordinate of the point702where the index finger of the user340approaches (or enters). According to an embodiment, the processor120may identify that the first coordinate and the second coordinate have the same coordinate value. The processor120may change the display of content of the point710within the display region310corresponding to the second coordinate. According to an embodiment, the point710may include a specific region.

According to an embodiment, even if the user340is located at another position, when the body part of the user340approaches (or enters) at a point having the same absolute coordinate within a virtual region (e.g., the first virtual region320-1or the second virtual region320-2), the processor120may change content of the same point (or area) within the display region310.

FIG. 7Billustrates another example of the electronic device101for displaying content based on a motion of the user340according to various embodiments.

Referring toFIG. 7B, the processor120may identify the user340of the electronic device101via the DVS module210. The user340of the electronic device101may be located within the measurement region330which is a region measurable by the DVS module210. The processor120may identify a third virtual region320-3based on the position of the user340within the measurement region330.

According to an embodiment, the processor120may identify that a body part of the user340is located at a point703. According to an embodiment, the processor120may identify that the body part of the user340approaches (or enters) the point703within the third virtual region320-3. The processor120may identify a first coordinate of the point703in the third virtual region320-3set as an absolute coordinate system. For example, the processor120may identify that an index finger of the user340approaches (or enters) the point703of the third virtual region320-3. The processor120may identify the first coordinate of the point703where the index finger of the user340approaches (or enters).

According to an embodiment, the processor120may display the display region310corresponding to an absolute coordinate system of the third virtual region320-3via the display unit160. The processor120may change the display of content of a point720within the display region310corresponding to the identified first coordinate. According to an embodiment, the point720may include a specific region.

According to one embodiment, the processor120may identify that the user340of the electronic device101rotates in place. According to an embodiment, the processor120may identify a fourth virtual region320-4in response to identifying that the user340of the electronic device101rotates in place (e.g., rotates to the left). According to an embodiment, the processor120may newly set (or determine) the fourth virtual region320-4based on a direction in which the user340is looking. For example, the processor120may identify the fourth virtual region320-4spaced apart by a designated distance from the first body part of the user340. The processor120may identify (or determine) the fourth virtual region320-4to have the same size and shape as the third virtual region320-3. According to an embodiment, the processor120may identify (or determine) the third virtual region320-3and the fourth virtual region320-4to be located in front of the user340.

According to an embodiment, the processor120may identify that the body part of the user340who has rotated in place is located at a point704. According to an embodiment, the processor120may identify that the body part of the user340approaches (or enters) the point704within the fourth virtual region320-4. The processor120may identify a second coordinate of the point704in the fourth virtual region320-4set as an absolute coordinate system. For example, the processor120may identify that an index finger of the user340approaches (or enters) the point704of the fourth virtual region320-4. The processor120may identify the second coordinate of the point704where the index finger of the user340approaches (or enters). According to an embodiment, the processor120may identify that the first coordinate and the second coordinate have different coordinate values. The processor120may change the display of content of the point730within the display region310corresponding to the identified second coordinate. According to an embodiment, the point730may include a specific region.

According to an embodiment, when the user340rotates in place (e.g., rotates to the right), the processor120may newly identify (or determine) a virtual region (e.g., the third virtual region320-3) in front of the user340. The processor120may change the display of content based on a motion of the body part of the user340within the newly identified (or determined) virtual region.

Although an example in which the display region310is displayed via the electronic device101is shown with reference toFIG. 7AandFIG. 7B, the disclosure is not limited thereto. As shown inFIG. 3B, the electronic device101may establish a connection with the external electronic device201, and may display the display region310via the external electronic device201.

FIG. 8illustrates another example of the electronic device101for displaying content based on a motion of a user according to various embodiments.

Referring toFIG. 8, the processor120may identify a plurality of users within the measurement region330via the DVS module210. The processor120may identify a plurality of virtual regions respectively corresponding to the plurality of users. According to an embodiment, the processor120may identify a virtual region830corresponding to a first user340-1. The processor120may identify a virtual region840corresponding to a second user340-2. Each of the virtual region830and the virtual region840may correspond to the display region310.

According to an embodiment, the processor120may identify that a body part of the first user340-1approaches (or enters) a first point801within the virtual region830. The processor120may identify a first coordinate of the first point801in the virtual region830set as an absolute coordinate system. For example, the processor120may identify that an index finger of the first user340-1approaches (or enters) the first point801of the virtual region830. The processor120may identify the first coordinate of the first point801where the index finger of the first user340-1approaches (or enters). The processor120may display a first cursor811, which moves based on a motion of the body part of the first user340-1, at a first display point810within the display region310corresponding to the first coordinate.

The processor120may identify that the body part of the second user340-2approaches (or enters) a second point802within the virtual region840. The processor120may identify a second coordinate of the second point802in the virtual region840set as an absolute coordinate system. For example, the processor120may identify that an index finger of the second user340-2approaches (or enters) the second point802of the virtual region840. The processor120may identify the second coordinate of the second point802where the index finger of the second user340-2approaches (or enters). The processor120may display a second cursor821, which moves based on a motion of the body part of the second user340-2, at a second display point820within the display region310corresponding to the second coordinate.

According to an embodiment, the processor120may move the cursor811within the display region310based on the motion of the body part of the first user340-1. The processor120may move a cursor821within the display region310based on the motion of the body part of the second user340-2. According to an embodiment, the processor120may independently identify the motion of the body part of the first user340-1and the motion of the body part of the second user340-2. The processor120may independently display the cursor811and the cursor821within the display region310.

According to an embodiment, the processor120may move one cursor (e.g., the cursor811) within the display region310based on the motion of a plurality of users (e.g., the first user340-1or the second user340-2). For example, the processor120may move the cursor811within the display region310based on the motion of a body part of the first user340-1. The processor120may move the cursor811, which moves based on the motion of the first user340-1, within the display region310based on the motion of the body part of the second user340-2. According to an embodiment, the processor120may simultaneously identify a plurality of inputs from a plurality of users (e.g., the first user340-1or the second user340-2). The processor120may identify priorities of the plurality of inputs identified from the plurality of users. The processor120may move one cursor (e.g., the cursor811) within the display region310based on the identified priority. For example, the processor120may receive the first input from the first user340-1and the second input from the second user340-2at the same timing. The processor120may identify that the first input has a higher priority than the second input. The processor120may move one cursor (e.g., the cursor811) within the display region310based on the first input received from the first user.

Although an example in which the display region310is displayed via the electronic device101is shown with reference toFIG. 8, the disclosure is not limited thereto. As shown inFIG. 3B, the electronic device101may establish a connection with the external electronic device201, and may display the display region310via the external electronic device201.