Patent Description:
Many electronic devices that are wearable on the human body have been introduced. Such electronic devices are typically referred to as wearable devices and are provided in various types, such as head mounted, glasses, watches, bands, contact lenses, rings, shoes, clothes, or other manners to be worn on the human body or clothes, leading to increased portability and accessibility.

Head mounted wearable devices, such as head mounted displays (HMD) are being rapidly developed. An HMD may provide images in a see-through type providing augmented reality (AR) and in a see-closed type providing virtual reality (VR).

The see-through type may synthesize or combine a virtual object or target with a real-life base using the characteristics of a semi-transmissive lens to reinforce additional information that may be difficult to obtain otherwise. The see-closed type places two displays ahead of the user's eyes and allows the user alone to view contents, such as games, movies, streaming, or broadcast provided through an external input through an independent screen, so that the user may focus on only the contents.

Under research as per existing technology are methods allowing an electronic device such as a smartphone equipped with a separate display to be mounted on a wearable device as a display means for the wearable device.

Upon mounting an electronic device on a wearable device for use, data related to a user's entry, such as a motion acceleration, may be considered to control objects outputted through the display of the electronic device. To this point, however, the prior art is deficient in the development of wearable device technology that considers such data, giving rise to a need in the art for improvement in the control of objects outputted through the electronic device display.

<CIT> relates to systems and methods to allow a user to interact with an augmented reality device. A wearable device establishes a communication path with a user of the wearable device and at least one individual. The wearable device includes a display; at least one sensor configured to provide an output indicative of a viewing direction of the user; and at least one processing device. The at least one processing device is configured to monitor the viewing direction of the user based on the output of the at least one sensor; determine, based on the monitored viewing direction, whether the user is looking in the direction of the at least one individual; and establish the communication path between the user and the at least one individual if the user is determined to be looking in the direction of the at least one individual.

<CIT> relates to a method of performing a hands-free selection of an object on a display includes displaying various objects within a screen view on a display, and moving a pointer-timer, in response to movements of the headset computer, to a selectable object within the screen view. The method further includes selecting the selectable object if the pointer-timer overlaps the selectable object for a predetermined amount of time. The method may further include transitioning the pointer-timer from a first state to a second state over a predetermined period of time. The pointer-timer may include a collection of elements that sequentially transitions from the first state to the second state, such that the collection of elements gradually changes from all being in the first state to all being in the second state.

<CIT> relates to a head mounted display device that displays three dimensional images from a mobile device, which includes a strap that secures the head mounted display to the head of a viewer, a viewing assembly connected to the strap, that includes a housing, a mobile device holder, connected to the housing, a reflecting surface, connected to the housing, that reflects images displayed by the mobile device; and an eyepiece, connected to the housing, onto which the reflecting surface reflects the images.

<CIT> relates to a method and system to facilitate navigating through a video. A video-player system identifies on a video-controller one or more scene-boundaries. A scene-boundary is associated with a video frame of a scene-start or a scene-end of a video. The video-player system receives a request to move a pointing-indicator. The pointing-indicator is a graphical element rendered on a display device of a video-player system and coincides with input to the video-player system. The video-player system calculates, in response to the request to move the pointing-indicator, a distance between the pointing-indicator and a particular scene-boundary. The video-player system determines whether the distance between the pointing-indicator and a particular scene-boundary is less than a threshold. The video-player system then snaps the pointing-indicator to the particular scene-boundary in response to determining the distance is less than the threshold.

<CIT> relates to a method and system for assisting physically challenged users in positioning cursor objects at desired icons displayed within a graphic interface of a computer system. Icons are displayed within the graphic interface, such that an icon, when graphically selected by a user, facilitates a particular application function. Icon domains are established about each icon, wherein each icon domain is larger than the icon itself. The cursor object may thereafter be automatically positioned at the center of a particular icon, in response to moving the cursor object into an icon domain associated with that particular icon, thereby assisting physically challenged users in efficiently positioning the cursor object at the icon in order to graphically select a particular function associated with the icon. According to this method and system, the icons are thereby graphically magnetized, such that a cursor object is immediately snapped toward a desired icon when entering a graphically magnetized domain surrounding the desired icon, eliminating the need for positioning the cursor object precisely on the icon or other graphical object to be selected.

<CIT> relates to a wearable computing device which performs tracking of a focal point with respect to one or menu navigation elements.

An aim of certain embodiments of the present disclosure is to provide an electronic device equipped with a display means, which may identify a user input sensed when the electronic device is mounted on a wearable device, identify an object related to the user input among objects displayed, determine that the object is intended to be selected by the user, and output the object.

According to an aspect of the present disclosure, an electronic device according to claim <NUM> is provided.

According to another aspect of the present disclosure, a method according to claim <NUM> is provided.

The above and other aspects, features and advantages of the present disclosure will become better understood by reference to the following detailed description when considered in connection with the accompanying drawings, in which:.

Embodiments of the present disclosure are described with reference to the accompanying drawings. However, it should be appreciated that the present disclosure is not limited to the embodiments, and all changes or replacements thereto also pertain to the scope of the present disclosure. The same or similar reference denotations may be used to refer to the same or similar elements throughout the specification and the drawings. Descriptions of well-known functions and/or configurations will be omitted for the sake of clarity and conciseness.

As used herein, the expressions "have," "may have," "include," or "may include" a feature (e.g., a number, function, operation, or a component such as a part) indicate the existence of the feature and do not exclude the existence of other features.

As used herein, the expressions "A or B," "at least one of A and/or B," and "one or more of A and/or B" may include all possible combinations of A and B. For example, "A or B," "at least one of A and B," and "at least one of A or B" may indicate (<NUM>) including at least one A, (<NUM>) including at least one B, or (<NUM>) including at least one A and at least one B.

As used herein, the terms "first" and "second" may modify various components regardless of importance and/or order and are used to distinguish a component from another without limiting the components. For example, a first user device and a second user device may indicate different user devices from each other regardless of the order or importance of the devices. A first component may be referred to as a second component, and vice versa without departing from the scope of the present disclosure.

It will be understood that when an element, such as a first element, is referred to as being operatively or communicatively "coupled with/to," or "connected with/to" another element, such as a second element, the first element can be coupled or connected with/to the second element directly or via a third element. In contrast, it will be understood that when the first element is referred to as being "directly coupled with/to" or "directly connected with/to" the second element, no third element exists between the first and second elements.

As used herein, the expression "configured (or set) to" may be interchangeably used with the expressions "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of" depending on circumstances. The expression "configured (or set) to" does not essentially indicate "specifically designed in hardware to. " Rather, the expression "configured to" may indicate that a device can perform an operation together with another device or parts of a device. For example, the expression "processor configured (or set) to perform A, B, and C" may indicate a generic-purpose processor, such as a central processing unit (CPU) or application processor that may perform the operations by executing one or more software programs stored in a memory device or a dedicated or embedded processor for performing the operations.

The terms as used herein are provided merely to describe some embodiments thereof, but not to limit the scope of other embodiments of the present disclosure. The terms including technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiments of the present disclosure pertain. The terms defined herein should not be interpreted to exclude embodiments of the present disclosure.

For example, an electronic device according to embodiments of the present disclosure may include at least one of a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop computer, a netbook computer, a workstation, a personal digital assistant (PDA), a portable multimedia player (PMP), a motion pictures experts group (MPEG) layer audio <NUM> (MP3) player, a mobile medical device, a camera, or a wearable device.

According to an embodiment of the present disclosure, the wearable device may include at least one of an accessory-type device, such as a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or an HMD, a fabric- or clothes-integrated device such as electronic clothes, a body attaching-type device such as a skin pad or tattoo, or a body implantable device, such as an implantable circuit.

According to an embodiment of the present disclosure, an object may be an indication outputted on a display through a stereoscopic image, and when a particular object is selected, an operation previously set for the selected object may be performed on the electronic device.

According to an embodiment of the present disclosure, a pointer object may be an object to indicate a particular object. When a preset user input is entered with the pointer object positioned in an area of a first object, an operation related to the first object may be performed on the electronic device.

According to an embodiment of the present disclosure, a movement of the electronic device may include an angle of the movement of the electronic device that is based on a preset reference position. For example, the user may wear the electronic device-mounted wearable device on his/her face and may move his/her face angle up, down, left, or right, and the electronic device may determine the movement as a movement of the electronic device.

According to an embodiment of the present disclosure, a movement of a first object to a second object may indicate that the first object goes into an area of the second object related to the first object among a plurality of objects, and the first object and the second object may be displayed overlapping each other.

Hereinafter, an electronic device, and method for controlling an object displayed through the electronic device according to embodiments of the present disclosure are described with reference to the accompanying drawings. As used herein, the term "user" may denote a human or an artificial intelligence electronic device using the electronic device.

According to embodiments of the present disclosure, by the electronic device, wearable device, and method for controlling objects displayed through the electronic device, movements of a plurality of objects may be controlled corresponding to a sensed movement of the electronic device, and one of a first object and a second object related to the first object may be moved to the position of the other object, enabling a movement of an object to be controlled with minimal user movement.

<FIG> illustrates a configuration of an electronic device according to an.

Hereinafter, an electronic device, wearable device, and method for controlling an object displayed through the electronic device according to embodiments of the present disclosure are described with reference to the accompanying drawings. As used herein, the term "user" may denote a human or an artificial intelligence electronic device using the electronic device.

<FIG> illustrates a configuration of an electronic device according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may include a display <NUM>, a sensor module <NUM>, a processor <NUM>, and a memory <NUM>.

According to an embodiment of the present disclosure, when the electronic device <NUM> is mounted on a wearable device <NUM>, the electronic device <NUM> may be operated in an HMD mode. When the electronic device <NUM> is functionally connected with the wearable device <NUM>, an HMD mode screen may be outputted through the electronic device <NUM>.

When the electronic device <NUM> is mounted on the wearable device <NUM> and operated in the HMD mode, the screen displayed through the display <NUM> may display two screens respectively corresponding to the user's left and right eyes.

The display <NUM> may output a VR screen when the electronic device <NUM> is mounted on the wearable device <NUM>, such as in the manner of a stereoscopic image.

The sensor module <NUM> may include an acceleration sensor <NUM> sensing a movement acceleration of the electronic device <NUM> and a touch sensor <NUM> sensing a touch input, and the sensor module <NUM> may further include various sensors capable of sensing the movement of the electronic device <NUM> or another electronic device. For example, according to a movement angle of the electronic device <NUM>, objects displayed in a VR space may be selected or a pointer object indicating that a particular object is selectable may be moved.

According to an embodiment of the present disclosure, the electronic device <NUM> may set a reference position in the VR space, and the sensor module <NUM> may sense an angle at which the electronic device <NUM> is moved based on the set reference position. For example, as the reference position, a position value corresponding to an angle of the electronic device <NUM> when the user views the front of the worn electronic device <NUM> may be set. Other position values as designated by the user may be set as the reference position.

The processor <NUM> may include a VR screen output unit <NUM>, an object display controller <NUM>, an object movement controller <NUM>, and an object selection setting unit <NUM> and may further include various components for controlling objects displayed based on the determined user movement.

The VR screen output unit <NUM> may perform control to output a VR screen, such as to output a pointer object for selecting and controlling objects included in the VR screen. The pointer object may perform control to output a fixed pointer that has a fixed position on the VR screen, and a location where an object is snapped or a moving pointer moving as the electronic device <NUM> moves.

According to an embodiment of the present disclosure, when the electronic device <NUM> is determined to be mounted on the wearable device <NUM>, the VR screen output unit <NUM> may perform control to output a stereoscopic image through the display <NUM> and to output the VR screen under other circumstances.

The object display controller <NUM> may perform control to display, through the display <NUM>, a movement of a pointer object or object included in an application execution screen. For example, when a particular object is set to be selectable as per at least one reference, the object display controller <NUM> may display the object such that the pointer object overlaps the object.

The object movement controller <NUM> may control a movement of the object displayed through the VR screen based on a movement angle of the electronic device <NUM> sensed through the sensor module <NUM>.

According to an embodiment of the present disclosure, the object movement controller <NUM> may control the movement of the object further considering a sensor input identified from the wearable device <NUM>.

When the pointer object is rendered to have a fixed position according to the movement of the electronic device <NUM> sensed through the sensor module <NUM>, and a first object of the VR screen is included in an area of the pointer object having the fixed position, the object selection setting unit <NUM> may determine that the first object is pointed out.

According to an embodiment of the present disclosure, when the pointer object is positioned to overlap a particular object, the object selection setting unit <NUM> may set such that the overlapping object may be selected. For example, upon identifying a preset input, such as a gesture input or button selection for the object set to be selectable, the object selection setting unit <NUM> may perform control to run an operation related to the object overlapping the pointer object.

According to an embodiment of the present disclosure, the object selection setting unit <NUM> may determine an object corresponding to a movement of the electronic device <NUM> among objects outputted on the VR screen as per at least one reference, which may include the position of each object and the pointer object, the importance of the objects, and the attribute of connection between the objects or input method, or may further include various references for determining an object intended to be selected by the user among from the plurality of objects.

The memory <NUM> includes pointer control information <NUM> and an application program <NUM>, and may further include information for determining a movement of the electronic device <NUM> and determining an object to be selected based on the movement of the electronic device <NUM>.

The pointer control information <NUM> may include information for moving objects outputted in a stereoscopic image into another object. For example, the information may include information about the position of each object and the pointer object, the importance of the objects, and the attribute of connection between the objects or input method, and may further include information for moving any one of the plurality of objects into the position of another object.

The application program <NUM> may include information related to an application for running on a stereoscopic image screen.

The wearable device <NUM> may include a device for outputting an HMD mode screen. For example, the electronic device <NUM> and the wearable device <NUM> may be configured in their respective devices or both may be configured in a single device.

According to an embodiment of the present disclosure, upon identifying that the electronic device <NUM> and the wearable device <NUM> are functionally or electrically coupled together, the display <NUM> of the electronic device <NUM> may perform control to output an HMD mode screen.

<FIG> illustrates a method of controlling an object displayed by an electronic device, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device in step <NUM> senses a movement of the electronic device, such as through a device functionally connected with the electronic device or through an acceleration sensor or gyro sensor in the electronic device.

In step <NUM>, the electronic device moves a first object in the stereoscopic image from a first position to a second position corresponding to the sensed movement. For example, the first object may be moved up, down, left, or right in the stereoscopic image, corresponding to an angle of the electronic device with respect to a predetermined position.

In step <NUM>, the electronic device may move one of the first object and second object to the position of the other object. For example, the electronic device may determine whether to move the first object or the second object according to the type of the running application or whether the object is moved.

According to an embodiment of the present disclosure, when the second object is a fixed object on the screen, the first object moving corresponding to the movement of the electronic device may be moved to the position of the second object.

According to an embodiment of the present disclosure, when the second object is a progress bar object moving in continuous actions on the screen, the second object may be moved into the position of the first object corresponding to the movement of the electronic device.

<FIG> illustrates a method of determining at least one object among a plurality of objects according to at least one reference by an electronic device, according to an embodiment of the present disclosure.

Objects and a pointer object between the objects are displayed on a screen outputted from the electronic device, and the pointer object positioned between the objects may be moved into an area of any one of the objects according to at least one reference for the objects, according to embodiments of the present disclosure.

The steps of <FIG> described below may be performed in a different order or at least one configuration may be varied or omitted.

Referring to <FIG>, in step <NUM>, the electronic device may determine whether the position of the pointer object between the objects can be determined.

When the position between the objects is determined to be determinable in step <NUM>, the electronic device in step <NUM> may identify an object positioned closest to the pointer object among the objects.

When the position between the objects is determined not to be determinable in step <NUM>, the electronic device in step <NUM> may determine whether an importance between the objects is determinable, such as based on one of the count of running a corresponding object and relevance with the user.

When the importance between the objects is determined to be determinable in step <NUM>, the electronic device in step <NUM> may identify the higher in importance of the objects.

When the importance between the objects is determined not to be determinable in step <NUM>, the electronic device <NUM> may determine whether a movement direction of the pointer object is determinable.

When the movement direction of the pointer object is determined to be determinable in step <NUM>, the electronic device in step <NUM> identifies an object positioned in the direction along which the pointer object moves among the objects.

When the movement direction of the pointer object is determined not to be determinable in step <NUM>, the electronic device in step <NUM> may determine whether a connection attribute between the objects is determinable. For example, the connection attribute between the objects may be related information about an object selected earlier than the objects and each of the objects and may be considered to identify an object related to the pointer object among the objects.

When the connection attribute between the objects is determined to be determinable in step <NUM>, the electronic device in step <NUM> may identify an object related to the previously selected object among the objects.

When the connection attribute between the objects is determined not to be determinable in step <NUM>, the electronic device in step <NUM> may determine whether a user input, other than the user movement for controlling the pointer object is entered. For example, the user input may include the user's voice data, gesture input such as touch, biological information or other inputs related to the user that are entered through the electronic device.

When entry of the other user input is determined to be determinable in step <NUM>, the electronic device in step <NUM> may identify an object related to the entered user input among the objects.

As at least one of the above-described operations <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> is performed, the electronic device in step <NUM> may move the pointer object into an area of the object identified through the above-described operations.

<FIG> and <FIG> illustrate an example of a wearable device, according to an embodiment of the present disclosure.

Referring to <FIG> and <FIG>, the wearable device <NUM> may be the electronic device <NUM> of <FIG>, for example. The wearable device <NUM> may provide only functions of a mount or support with no communication functionality with the electronic device <NUM>. The wearable device <NUM> may include a body <NUM> and a cover <NUM>.

When the electronic device <NUM> is mounted on the wearable device <NUM>, the cover <NUM> may cover the edge of a rear surface of the electronic device <NUM> to be fastened to the wearable device <NUM> so that the electronic device <NUM> may remain in a mounted position. The wearable device <NUM> may have a support available for the user to wear the wearable device <NUM> on his/her head.

The wearable device <NUM> may have lenses respectively corresponding to an eye of the user (wearer). The user may view the display of the electronic device <NUM> through the lenses with the electronic device <NUM> mounted on the wearable device <NUM>. The wearable device <NUM> may have a mechanical or instrumental structure allowing the electronic device <NUM> to be mounted on the wearable device <NUM> as shown.

According to an embodiment of the present disclosure, the wearable device <NUM> may include at least one of the components of the electronic device <NUM> shown in <FIG>, such as a touch panel, a button, a wheel key, and a touch pad. The touch panel may receive the user's touch input, such as the user's touch on the touch panel or a hovering input near the touch panel. When the electronic device <NUM> is mounted, the wearable device <NUM> may connect with the electronic device <NUM> via an interface such as USB, to communicate with the electronic device <NUM>.

The electronic device <NUM> may control a function corresponding to an input received from the wearable device <NUM> in response to the input, such as adjusting the sound volume or controlling the screen (e.g., an image playing screen of the HMD mode) in response to the received input. For example, when the electronic device <NUM> is mounted on the wearable device <NUM>, an external device connecting unit of the electronic device <NUM> may be electrically connected with the connecting unit of the wearable device <NUM> to enable communication between the devices.

<FIG> illustrates an example in which a user wears an electronic device-mounted wearable device, according to an embodiment of the present disclosure.

In <FIG>, the user may control the functions of the electronic device <NUM> or of the wearable device <NUM> through the touch pad <NUM> provided in a side surface of the wearable device <NUM>.

Referring to <FIG>, <FIG>, and <FIG>, the electronic devices <NUM> and <NUM> may be the electronic device <NUM> of <FIG>, such as smartphones with a display means. The wearable devices <NUM> and <NUM> may be the electronic device <NUM> or wearable device <NUM> of <FIG> or may be instrumental, wearable mounts.

As shown in <FIG>, <FIG>, and <FIG>, the electronic devices <NUM> and <NUM> may be mounted on the wearable devices <NUM> and <NUM> so that the display, i.e., the touchscreen530 faces the user's face. The user may fasten the electronic devices <NUM> and <NUM> to the wearable devices <NUM> and <NUM> by getting closer to the covers of the wearable devices <NUM> and <NUM>. In <FIG>, the user may wear the electronic device <NUM>-mounted wearable device <NUM> on his/her head, and may view the screen of the display of the electronic device <NUM> through the lenses of the wearable device <NUM>.

<FIG> illustrates a screen mode of an electronic device, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be the electronic device <NUM> or <NUM> as shown in <FIG>, <FIG>, and <FIG>. When operating in the normal mode, the electronic device <NUM> may display one operation screen <NUM> as shown in the upper screen of <FIG>.

According to an embodiment of the present disclosure, when mounted on a wearable device, the electronic device <NUM> may be operated in the HMD mode as shown in the lower screen of <FIG>. When the electronic device <NUM> is operated in the HMD mode, a screen 620a corresponding to the user's left eye and another screen 620b corresponding to the user's right eye may be distinctively displayed. In the screen of the HMD mode, one image may be separately displayed as two images 620a and 620b.

According to an embodiment of the present disclosure, when the electronic device <NUM> is mounted on the wearable device and operated in the HMD mode, the display area or display position of the screen corresponding to the HMD mode (the screen 620a corresponding to the left eye and the screen 620b corresponding to the right eye) may be determined.

<FIG> illustrates an example of a display screen of an electronic device when the electronic device is mounted on a wearable device, according to an embodiment of the present disclosure.

Referring to <FIG>, the user <NUM> may wear an electronic device <NUM>-mounted wearable device <NUM>. For example, an HMD mode screen <NUM> may be outputted on the display of the electronic device <NUM>.

According to an embodiment of the present disclosure, the HMD mode screen <NUM> is configured in a three-dimension (3D) stereoscopic image, and objects corresponding to points of a movement of the electronic device <NUM> among objects of the HMD mode screen <NUM> may be outputted through the electronic device <NUM>. For example, when the user <NUM> lifts his/her face up, the electronic device <NUM> may move upwards accordingly, and a screen and objects positioned over a reference position of the HMD mode screen <NUM> may be outputted through the electronic device <NUM>.

According to an embodiment of the present disclosure, when a pointer object is outputted on the HMD mode screen <NUM>, the electronic device <NUM> may control the pointer object according to the movement of the electronic device <NUM>.

<FIG> illustrate screens displayed through an electronic device, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device may output a screen 800a including thumbnail images 810a for at least one webpage or control objects 820a for accessing a particular webpage. For example, when one of the thumbnail images is selected through the screen 800a, the electronic device may access the website corresponding to the selected thumbnail image 810a.

According to an embodiment of the present disclosure, when one of the control objects 820a is selected, the electronic device may perform an operation such as move back or go to home screen, for controlling the previously selected object (e.g., the thumbnail image 810a).

Referring to <FIG>, the electronic device may output an execution screen 800b of a program (e.g., "quick access") for running at least one application. For example, the at least one application may be run on the electronic device for a preset time or may be designated according to the count of execution.

According to an embodiment of the present disclosure, the execution screen may include thumbnail images 810b for the at least one application. For example, when one of the thumbnail images 810b is selected, the electronic device may run an application corresponding to the selected thumbnail image, or may run a website corresponding to the selected thumbnail image or a new website.

Referring to <FIG>, the electronic device may output an execution screen 800c of a media playing application, which may include an area 810c where a playing media file is outputted and an area 820c for controlling the playing of the media file.

Referring to <FIG>, the screen 800d displayed through the electronic device may include a thumbnail image 810d of at least one program and an object related to a particular program. For example, the at least one program may include a program (e.g., "quick access") for running at least one application, a web browser (e.g., VR Internet), or bookmarks and may further include a thumbnail image of a program designated according to the count of running on the electronic device for a preset time.

According to an embodiment of the present disclosure, when a user input is entered or pointer object is overlapped for an area (e.g., the thumbnail image 810d) of any one program, the electronic device may run a program related to the selected thumbnail image 810d.

<FIG> illustrates a screen displayed through an electronic device, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device may output an HMD mode screen <NUM> which may include an object such as a first webpage <NUM>, second webpage <NUM>, and third webpage <NUM> of an execution screen of at least one application and a button object <NUM> and pointer object <NUM> performing a pre-designated operation.

According to an embodiment of the present disclosure, the pointer object <NUM> may be moved as the electronic device moves, and when the moving pointer object <NUM> overlaps one of the outputted objects, a control may be performed such that the object overlapping the pointer object <NUM> is highlighted. For example, a control may be performed such that other indications that the pointer object <NUM> is overlapped, such as by enlarging or brightening, may be outputted through the particular object on the HMD mode screen <NUM>.

According to an embodiment of the present disclosure, when the pointer object <NUM> is positioned between the second webpage <NUM> and the button object <NUM>, the electronic device may move the pointer object <NUM> into the position of one of the second webpage <NUM> and the button object <NUM>. For example, the electronic device may move the pointer object <NUM> into the position of one of the objects based on the distance between the pointer object <NUM> and each of the second webpage <NUM> and button object <NUM> and the movement direction of the pointer object <NUM>.

<FIG> illustrates a screen displayed in an HMD mode, according to an embodiment of the present disclosure.

Referring to <FIG>, the HMD mode screen <NUM> may include at least one object, such as a first object <NUM> and second object <NUM> for performing a pre-designated operation and a pointer object <NUM> for indicating the at least one object.

According to an embodiment of the present disclosure, the movement of the pointer object <NUM> may be controlled according to the movement of the user wearing the electronic device outputting the HMD mode screen <NUM>.

According to an embodiment of the present disclosure, when the pointer object <NUM> is moved into an area between the first object <NUM> and the second object <NUM>, the electronic device may move the pointer object <NUM> to overlap one of the first object <NUM> or the second object <NUM> according to at least one reference. For example, when the distance between the pointer object <NUM> and the first object <NUM> is greater than the distance between the pointer object <NUM> and the second object <NUM>, the electronic device may move the pointer object <NUM> into the position of the second object <NUM>.

<FIG> illustrates when an object is moved, according to an embodiment of the present disclosure.

Referring to <FIG>, the HMD mode screen <NUM> may include at least one object, such as a first object (e.g., 'A') <NUM> and second object (e.g., 'B') <NUM> for performing a pre-designated operation and a pointer object (e.g., `P') <NUM> for indicating the at least one object.

When the pointer object <NUM> is positioned between the first object <NUM> and the second object <NUM> for a preset time such as <NUM> seconds, the electronic device moves the pointer object <NUM> to overlap one of the first object <NUM> or the second object <NUM> according to the movement direction of the pointer object <NUM>. For example, when the pointer object <NUM> moves in a direction from the first object <NUM> to the second object <NUM>, the electronic device moves the pointer object <NUM> into an area where the second object is displayed such that the pointer object <NUM> is displayed overlapping the second object <NUM>.

<FIG> illustrates when an object is moved, according to an example falling outside of the presently claimed invention.

Referring to <FIG>, the HMD mode screen may include a keypad object <NUM> for entering a pre-designated character or a pointer object <NUM> for indicating the at least one object. The keypad object <NUM> may include an object (e.g., a "j" button or "i" button) related to at least one character (e.g., an alphabet character, number, symbol, consonant, or vowel).

According to an embodiment of the present disclosure, the movement of the pointer object <NUM> may be controlled according to the movement of the user wearing the electronic device outputting the HMD mode screen.

According to an embodiment of the present disclosure, when the pointer object <NUM> is positioned between the "j" button and the "i" button for the preset time, the electronic device may identify an object where the pointer object <NUM> was previously positioned and move the pointer object <NUM> to overlap the object where the pointer object <NUM> was previously positioned. For example, when the pointer object <NUM> was positioned on the "s" button corresponding to a consonant, the electronic device may move the pointer object <NUM> into the area where the "i" button is displayed to overlap the "i" button corresponding to a vowel.

According to an embodiment of the present disclosure, the keypad object <NUM> may be set to receive an input of a Korean character. When a character showing the end of a sentence, such as "<IMG>" or "<IMG>," is entered, the electronic device may move the pointer object <NUM> into an object corresponding to a period among objects positioned adjacent to the pointer object <NUM>.

Referring to <FIG>, the HMD mode screen <NUM> may include at least one of a first object (e.g., 'A') <NUM> and second object (e.g., 'B') <NUM> for performing a pre-designated operation and a pointer object (e.g., 'P') <NUM> for indicating the at least one object.

According to an embodiment of the present disclosure, when the pointer object <NUM> is positioned between the first object <NUM> and the second object <NUM> for the preset time, the electronic device may move the pointer object <NUM> to overlap one of the first object <NUM> and the second object <NUM> further considering a user input, such as voice data or touch input, other than the user's movement.

For example, the electronic device may move the pointer object <NUM> into the area where the second object is displayed further considering the user's voice data so that the pointer object <NUM> is displayed overlapping the first object <NUM> related to information (e.g., a command for running a gallery application, entry of the name ("B") of the second object <NUM> or "right-hand") contained in the voice data.

For example, when a touch input sensed through the electronic device or wearable device is identified to be a pre-designated input (e.g., a swipe input to the left), the electronic device may move the pointer object <NUM> into the object corresponding to the designated input.

<FIG> illustrates a method of moving an object displayed through an electronic device, according to an example falling outside of the presently claimed invention.

Referring to <FIG>, in step <NUM>, the electronic device may determine whether a pointer object is positioned within a preset area for a particular object. For example, the preset area may include at least a portion of the particular object.

When the pointer object is determined not to be positioned within the preset area in step <NUM>, the electronic device in step <NUM> may determine whether the pointer object is positioned in an area of an independent object, such as at least a portion of an area other than the area of the particular object in the entire display area.

When the pointer object is determined not to be positioned in the area of the independent object in step <NUM>, the electronic device in step <NUM> may determine whether an object moving in continuous actions is identified. For example, the object moving in continuous actions may include an indicator on a progress bar.

When the pointer object is determined to be positioned in the preset area or independent area or an object moving in continuous actions in step <NUM>, <NUM>, or <NUM>, the electronic device in step <NUM> may move the pointer object into the position on which the user's eyes focus. For example, the position on which the user's eyes focus may correspond to where the user's eyes remain and an angle at which the electronic device moves up, down, left, or right with respect to a predesignated reference position.

<FIG> illustrates when a displayed object is moved, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device may output an execution screen <NUM> of a media playing application, which may include an area where the media file plays and a video controller button <NUM> for controlling the playing of the media file. For example, the video controller button <NUM> may be outputted as the pointer object <NUM> has a fixed position in a preset area of the screen <NUM> for a predetermined time.

According to an embodiment of the present disclosure, when the video controller button <NUM> is outputted, the electronic device may move the pointer object <NUM> into the position of the video controller button <NUM>.

According to an embodiment of the present disclosure, the electronic device may control the movement of displayed objects to perform various operations related to an object with minimized user movement.

Referring to <FIG>, the electronic device may output an execution screen <NUM> of an application managing a list of objects set as bookmarks by the user in the HMD mode. For example, the execution screen <NUM> may include thumbnail images <NUM> respectively corresponding to the bookmarks and a control button area <NUM> for controlling the thumbnail images. The control button area <NUM> may include a "SELECT ALL" button <NUM> for selecting all the thumbnail images, a "CANCEL" button <NUM> for canceling the selection of a thumbnail image, and a "DONE" button <NUM> for ensuring that a thumbnail image is selected.

According to an embodiment of the present disclosure, when a preset operation is run through the execution screen, the electronic device may move the pointer object <NUM> into the control button area <NUM>. For example, when at least one object (e.g., <NUM>, <NUM>, or <NUM>) is selected from the bookmarks, and the electronic device moves at an angle allowing the electronic device to face in a lower direction, the electronic device may move the pointer object <NUM> into the position of the CANCEL button <NUM> or DONE button <NUM>.

According to an embodiment of the present disclosure, the electronic device may move the pointer object <NUM> into the area of one of the CANCEL button <NUM> or DONE button <NUM> or an area between the CANCEL button <NUM> and the DONE button <NUM>, considering at least one reference position of each of the buttons on the execution screen <NUM>.

According to an embodiment of the present disclosure, upon failing to sense the user's movement for a predetermined time through the execution screen, the electronic device may move the pointer object <NUM> into the position of the SELECT ALL button <NUM>.

<FIG> illustrates an example of an application execution screen where a displayed object is moved, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may output an execution screen of a media playing application, such as a video file. The execution screen may include an area <NUM> where the video file plays and a control button area <NUM> for controlling the playing of the video file.

According to an embodiment of the present disclosure, the control button area <NUM> may include a progress bar area <NUM> having a first object <NUM> indicating a time played and a pointer object <NUM> moving as the electronic device moves.

According to an embodiment of the present disclosure, the first object <NUM> of the progress bar area <NUM> may be moved in a predetermined action as the media file plays and may move into the position of the pointer object <NUM> as the electronic device moves.

The user may fasten the pointer object <NUM> to an area corresponding to a first time for a predetermined time. For example, the electronic device may identify the time when the movement of the pointer object <NUM> is fastened and move the first object <NUM> into the area corresponding to the identified first time.

When a predetermined time passes after the first object <NUM> has moved into the area corresponding to the first time, the video file may be played from the section corresponding to the first time through the area <NUM> where the video file plays.

Referring to <FIG>, the electronic device may output a screen <NUM> for setting functions of the display. For example, the setting screen <NUM> may include a button <NUM> for setting brightness.

When the brightness setting button <NUM> is selected, the electronic device may output a progress bar <NUM> for adjusting brightness. The progress bar <NUM> may include a first object <NUM> indicating a brightness level and a pointer object <NUM> moving as the electronic device moves.

According to an embodiment of the present disclosure, the first object <NUM> of the progress bar area <NUM> may be moved into the position of the pointer object <NUM> as the electronic device moves.

The user may fasten the pointer object <NUM> into a position <NUM> corresponding to a first brightness level, such as level <NUM>, for a predetermined time. For example, the electronic device may identify the brightness level at which the movement of the pointer object <NUM> is fastened and may move the first object <NUM> into the position <NUM> corresponding to the identified first brightness level.

When a predetermined time elapses after the first object <NUM> has moved into the position <NUM> corresponding to the first brightness level, the electronic device may control the display so that the brightness of the display is set to the first brightness level.

Referring to <FIG>, the electronic device may output an execution screen <NUM> of a web browser application. For example, the execution screen <NUM> may include at least one webpage (e.g., a first webpage <NUM>), a button area <NUM> for controlling functions related to the outputted webpage, and a pointer object <NUM> moving as the user moves.

According to an embodiment of the present disclosure, when the pointer object <NUM> remains on at least a portion of the area of the first webpage <NUM> for a predetermined time, the electronic device may identify a left-right scroll button <NUM> designated for where the pointer object <NUM> has a fixed position for a predetermined time, and may move the left-right scroll button <NUM> into the pointer object <NUM>.

For example, the user may designate an application displaying a list of thumbnail images or webpages, for an application where a preset object moves into the position of the pointer object <NUM>, and other objects may be positioned at left and right sides to implement various applications requiring the left-right scroll button <NUM>. The electronic device may move an object which is positioned in line with the pointer object <NUM> in an upward, downward, right, or left direction, into the position of the pointer object <NUM>.

According to an embodiment of the present disclosure, the electronic device may perform control to output a prior or subsequent webpage with respect to the first webpage <NUM> according to the left or right movement of the electronic device, with the left-right scroll button <NUM> relocated into the pointer object <NUM>.

Referring to <FIG>, the electronic device may output, through a displayed screen <NUM>, an execution screen (e.g., a first webpage <NUM>) of a web browser application having run for a predetermined time or a pointer object <NUM> moving as the electronic device moves.

According to an embodiment of the present disclosure, when the pointer object <NUM> remains in a designated area in the area of the first webpage <NUM> for a predetermined time, the electronic device may output an upper-lower scroll button <NUM> and move the pointer object <NUM> into the designated object. For example, the designated area in the area of the first webpage <NUM> may be a character data-free portion of the area of the first webpage <NUM> or an advertisement data-displayed portion of the area of the first webpage <NUM>.

According to an embodiment of the present disclosure, while the pointer object <NUM> is positioned on the upper-lower scroll button <NUM>, the electronic device may perform control to output an upper or lower portion of the first webpage <NUM> as the electronic device moves up or down.

<FIG> illustrates when a displayed object is run, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device may output a stereoscopic image <NUM> through a display. For example, a pointer object <NUM> moving as the electronic device moves may be outputted on the stereoscopic image <NUM>.

The electronic device may identify the position of the pointer object <NUM> and trigger a timer. For example, the timer may determine whether the pointer object <NUM> has a fixed position for a predetermined time.

According to an embodiment of the present disclosure, when the pointer object <NUM> has a fixed position in the area of a first object <NUM>, the electronic device may perform a function related to the first object <NUM>. For example, a function (e.g., "shots") showing pictures captured for the first object may be designated, and the electronic device may output a screen <NUM> including the captured pictures, as shown in the lower image of <FIG>.

<FIG> illustrates an example network environment, according to an embodiment of the present disclosure.

Referring to <FIG>, the network environment environment <NUM> may include an electronic device <NUM>, at least one of a first electronic device <NUM> and a second electronic device <NUM>, and a server <NUM>, and each of the components may be connected with the electronic device <NUM> through a network <NUM> or through a communication interface <NUM> of the electronic device <NUM>.

The electronic device <NUM> may include a bus <NUM>, a processor <NUM>, a memory <NUM>, an input/output interface <NUM>, a display <NUM>, and the communication interface <NUM>. In some embodiments, the electronic device <NUM> may exclude at least one of the components or may add another component.

The bus <NUM> may include a circuit for connecting the components <NUM> to <NUM> with one another and transferring communications (e.g., control messages and/or data) between the components.

The processing module <NUM> may include one or more of a central processing unit (CPU), an application processor (AP), and a communication processor (CP). The processor <NUM> may perform control on at least one of the other components of the electronic device <NUM>, and/or perform an operation or data processing relating to communication.

The memory <NUM> may include a volatile and/or non-volatile memory. For example, the memory <NUM> may store commands or data related to at least one other component of the electronic device <NUM>. According to an embodiment of the present disclosure, the memory <NUM> may store software and/or a program <NUM> including a kernel <NUM>, middleware <NUM>, an application programming interface (API) <NUM>, and/or applications <NUM>. At least a portion of the kernel <NUM>, middleware <NUM>, or API <NUM> may be denoted an operating system (OS).

For example, the kernel <NUM> may control or manage system resources (e.g., the bus <NUM>, processor <NUM>, or a memory <NUM>) used to perform operations or functions implemented in other programs. The kernel <NUM> may provide an interface that allows the middleware <NUM>, the API <NUM>, or the applications <NUM> to access the individual components of the electronic device <NUM> to control or manage the system resources.

The middleware <NUM> may function as a relay to allow the API <NUM> or the applications <NUM> to communicate data with the kernel <NUM>, for example.

The middleware <NUM> may process one or more task requests received from the applications <NUM> in order of priority. For example, the middleware <NUM> may assign at least one of the applications <NUM> with priority of using system resources of at least one electronic device <NUM>. For example, the middleware <NUM> may perform scheduling or load balancing on the one or more task requests by processing the one or more task requests according to the priority assigned to the at least one application program <NUM>.

The API <NUM> enables the applications <NUM> to control functions provided from the kernel <NUM> or the middleware <NUM>. For example, the API <NUM> may include at least one interface or function for filing control, window control, image processing or text control.

The input/output interface <NUM> may serve as an interface that may transfer commands or data input from a user or other external devices to other component(s) of the electronic device <NUM>, and may output commands or data received from other component(s) of the electronic device <NUM> to the user or the other external device.

The display <NUM> may include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical systems (MEMS) display, or an electronic paper display. The display <NUM> may display various contents such as text, images, videos, icons, and symbols to the user. The display <NUM> may include a touchscreen and may receive a touch, gesture, proximity or hovering input using an electronic pen or a body portion of the user.

For example, the communication module <NUM> may set up communication between the electronic device <NUM> and an external device (e.g., a first electronic device <NUM>, a second electronic device <NUM>, or a server <NUM>). For example, the communication module <NUM> may be connected with the network <NUM> through wireless or wired communication to communicate with the external electronic device.

The wireless communication may use at least one of long term evolution (LTE), long term evolution- advanced (LTE-A), code division multiple access (CDMA), wideband code division multiple access (WCDMA), universal mobile telecommunication system (UMTS), wireless broadband (WiBro), or global system for mobile communication (GSM), as a cellular communication protocol, and may include short-range communication <NUM>, such as wireless fidelity (Wi-Fi), Bluetooth®, near-field communication (NFC), or global navigation satellite system (GNSS), such as global positioning system (GPS), Beidou navigation satellite system (Beidou) or Galileo, or the European global satellite-based navigation system. The terms "GPS" and "GNSS" may be interchangeably used herein. The wired connection may include at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard (RS)-<NUM>, or plain old telephone service (POTS). The network <NUM> may include at least one of communication networks, such as a computer network (e.g., local area network (LAN) or wide area network (WAN)), the Internet, or a telephone network.

The first and second external electronic devices <NUM> and <NUM> each may be the same type as or a different type than the electronic device <NUM>. According to an embodiment of the present disclosure, the server <NUM> may include a group of one or more servers. All or some of operations executed on the electronic device <NUM> may be executed on another or multiple other electronic devices. When the electronic device <NUM> should perform some function or service automatically or at a request, the electronic device <NUM>, instead of executing the function or service by itself or additionally, may request another device to perform at least some functions associated therewith. The other electronic device, such as electronic devices <NUM> and <NUM> or server <NUM>, may execute the requested functions or additional functions and transfer a result of the execution to the electronic device <NUM>. The electronic device <NUM> may provide a requested function or service by processing the received result as it is or additionally. To that end, a cloud computing, distributed computing, or client-server computing technique may be used, for example.

<FIG> illustrates a configuration of an electronic device, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may include all or part of the configuration of the electronic device <NUM> shown in <FIG>. The electronic device <NUM> may include one or more application processors (APs) <NUM>, a communication module <NUM>, a subscriber identification module (SIM) <NUM>, a memory <NUM>, a sensor module <NUM>, an input module <NUM>, a display <NUM>, an interface <NUM>, an audio module <NUM>, a camera module <NUM>, a power management module <NUM>, a battery <NUM>, an indicator <NUM>, and a motor <NUM>.

The processor <NUM> may control multiple hardware and software components connected to the processor <NUM> by running an operating system or application programs, and may process and compute various data. The processor <NUM> may be implemented in a system on chip (SoC). According to an embodiment of the present disclosure, the processor <NUM> may further include a graphic processing unit (GPU) and/or an image signal processor, and may include at least some of the components shown in <FIG>. The processor <NUM> may load a command or data received from a non-volatile memory on a volatile memory, process the command or data, and store various data in the non-volatile memory.

The communication module <NUM> may have the same or similar configuration to the communication module <NUM> of <FIG>. The communication module <NUM> may include a cellular module <NUM>, a Wi-Fi module <NUM>, a Bluetooth® module <NUM>, a GNSS module <NUM>, an NFC module <NUM>, and a radio frequency (RF) module <NUM>.

The cellular module <NUM> may provide voice call, video call, text, or Internet services through a communication network. The cellular module <NUM> may perform identification or authentication on the electronic device <NUM> in the communication network using the SIM card <NUM>. According to an embodiment of the present disclosure, the cellular module <NUM> may perform at least some of the functions providable by the processor <NUM>, and may include a communication processor (CP).

The Wi-Fi module <NUM>, the Bluetooth (BT) module <NUM>, the GNSS module <NUM>, or the NFC module <NUM> may include a process for processing data communicated through the module. At least two of the cellular module <NUM>, the Wi-Fi module <NUM>, the Bluetooth module <NUM>, the GNSS module <NUM>, and the NFC module <NUM> may be included in a single integrated circuit (IC) or an IC package.

The RF module <NUM> may communicate data, such as RF signals, and may include a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), and an antenna. According to an embodiment of the present disclosure, at least one of the cellular module <NUM>, the Wi-Fi module <NUM>, the Bluetooth module <NUM>, the GNSS module <NUM>, and the NFC module <NUM> may communicate RF signals through a separate RF module.

The subscriber identification module <NUM> may include a card including a subscriber identification module and/or an embedded SIM, and may contain unique identification information such as an integrated circuit card identifier (ICCID) or subscriber information such as an international mobile subscriber identity (IMSI).

The memory <NUM> may include an internal memory <NUM> and an external memory <NUM>. The internal memory <NUM> may include at least one of a volatile memory (e.g., a dynamic random access memory (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), etc.) or a non-volatile memory (e.g., a one time programmable read only memory (OTPROM), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., a NAND flash, or a NOR flash), a hard drive, or solid state drive (SSD).

The external memory <NUM> may include a flash drive, such as a compact flash (CF) memory, a secure digital (SD) memory, a micro-SD memory, a min-SD memory, an extreme digital (xD) memory, a multi-media card (MMC), and a memory stick™. The external memory <NUM> may be functionally and/or physically connected with the electronic device <NUM> via various interfaces.

For example, the sensor module <NUM> may measure a physical quantity or detect a motion state of the electronic device <NUM>, and may convert the measured or detected information into an electrical signal. The sensor module <NUM> may include a gesture sensor 2340A, a gyro sensor 2340B, an atmospheric pressure sensor 2340C, a magnetic sensor 2340D, an acceleration sensor 2340E, a grip sensor 2340F, a proximity sensor <NUM>, a color sensor <NUM> such as a red-green-blue (RGB) sensor, a bio sensor 2340I, a temperature/humidity sensor 2340J, an illumination sensor <NUM>, an ultra violet (UV) sensor <NUM>, and a touch sensor <NUM>. Additionally or alternatively, the sensing module <NUM> may include an e-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor, or a finger print sensor, and may further include a control circuit for controlling at least one or more of the sensors included in the sensing module. According to an embodiment of the present disclosure, the electronic device <NUM> may further include a processor configured to control the sensor module <NUM> as part of or separately from the processor <NUM>, and the electronic device <NUM> may control the sensor module <NUM> while the processor <NUM> is in a sleep mode.

The input unit <NUM> may include a touch panel <NUM>, a (digital) pen sensor <NUM>, a key <NUM>, and an ultrasonic input device <NUM>. The touch panel <NUM> may use at least one of capacitive, resistive, infrared, or ultrasonic methods, and may further include a control circuit and a tactile layer that provides a user with a tactile reaction.

The (digital) pen sensor <NUM> may include a part of a touch panel or a separate sheet for recognition. The key <NUM> may include a physical button, optical key or key pad. The ultrasonic input device <NUM> may sense an ultrasonic wave generated from an input tool through a microphone <NUM> to identify data corresponding to the sensed ultrasonic wave.

The display <NUM> may include a panel <NUM>, a hologram device <NUM>, and a projector <NUM>. The panel <NUM> may have the same or similar configuration to the display <NUM> of <FIG> and may be implemented to be flexible, transparent, or wearable. The panel <NUM> may also be incorporated with the touch panel <NUM> in a module. The hologram device <NUM> may project three dimensional (3D) images (holograms) in the air by using light interference. The projector <NUM> may display an image by projecting light onto a screen, which may be located inside or outside of the electronic device <NUM>. In accordance with an embodiment, the display <NUM> may further include a control circuit to control the panel <NUM>, the hologram device <NUM>, or the projector <NUM>.

The interface <NUM> may include e.g., a high definition multimedia interface (HDMI) <NUM>, a USB <NUM>, an optical interface <NUM>, or a D-subminiature (D-sub) <NUM>. The interface <NUM> may be included in the communication module <NUM> shown in <FIG>. Additionally or alternatively, the interface <NUM> may include a mobile high-definition link (MHL) interface, a secure digital (SD) card/ multimedia card (MMC) interface, or infrared data association (IrDA) standard interface.

The audio module <NUM> may convert a sound into an electric signal or vice versa, for example. At least a part of the audio module <NUM> may be included in e.g., the input/output interface <NUM> as shown in <FIG>. The audio module <NUM> may process sound information input or output through a speaker <NUM>, a receiver <NUM>, an earphone <NUM>, or the microphone <NUM>.

For example, the camera module <NUM> may record still images and videos, and may include one or more image sensors (e.g., front and back sensors), a lens, an Image signal processor (ISP), or a flash such as a light-emitting diode (LED) or xenon lamp.

The power manager module <NUM> may manage power of the electronic device <NUM>, for example, and may include a power management Integrated circuit (PMIC), a charger IC, or a battery gauge. The PMIC may have a wired and/or wireless recharging scheme. The wireless charging scheme may include a magnetic resonance scheme, a magnetic induction scheme, or an electromagnetic wave based scheme, and an additional circuit, such as a coil loop, a resonance circuit, or a rectifier, may be added for wireless charging. The battery gauge may measure an amount of remaining power of the battery <NUM>, a voltage, a current, or a temperature while the battery <NUM> is being charged. The battery <NUM> may include a rechargeable battery or a solar battery.

The indicator <NUM> may indicate a particular state of the electronic device <NUM> or a part of the electronic device, such as a booting, message, or recharging state. The motor <NUM> may convert an electric signal to a mechanical vibration and may generate a vibrational or haptic effect. A processing unit for supporting mobile TV, such as a GPU may be included in the electronic device <NUM>. The processing unit for supporting mobile TV may process media data conforming to a standard for digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo™.

Each of the aforementioned components of the electronic device may include one or more parts, and a name of the part may vary with a type of the electronic device.

The electronic device in accordance with embodiments of the present disclosure may include at lest one of the aforementioned components, omit some of the components, or include additional component(s). Some of the components may be combined into an entity, but the entity may perform the same functions as the components.

<FIG> illustrates an example program module structure, according to an embodiment of the present disclosure.

The program module <NUM> may include an operating system (OS) controlling resources related to the electronic device <NUM> and/or various applications <NUM> driven on the operating system.

The operating system may include Android, iOS, Windows, Symbian, Tizen, or Bada.

The program <NUM> may include a kernel <NUM>, middleware <NUM>, an application programming interface (API) <NUM>, and/or applications <NUM>. At least a part of the program module <NUM> may be preloaded on the electronic device or may be downloaded from an external electronic device.

The kernel <NUM> may include a system resource manager <NUM> and/or a device driver <NUM>. The system resource manager <NUM> may perform control, allocation, or recovery of system resources, and may include a process managing unit, a memory managing unit, or a file system managing unit. The device driver <NUM> may include a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, an audio driver, or an inter-process communication (IPC) driver.

The middleware <NUM> may provide various functions to the application <NUM> through the API <NUM> so that the application <NUM> may efficiently use limited system resources in the electronic device or provide functions jointly required by applications <NUM>. According to an embodiment of the present disclosure, the middleware <NUM> may include at least one of a runtime library <NUM>, an application manager <NUM>, a window manager <NUM>, a multimedia manager <NUM>, a resource manager <NUM>, a power manager <NUM>, a database manager <NUM>, a package manager <NUM>, a connectivity manager <NUM>, a notification manager <NUM>, a location manager <NUM>, a graphic manager <NUM>, and a security manager <NUM>.

The runtime library <NUM> may include a library module used by a compiler in order to add a new function through a programming language while the application <NUM> is being executed. The runtime library <NUM> may perform input/output management, memory management, or operation on arithmetic functions.

The application manager <NUM> may manage the life cycle of at least one of the applications <NUM>. The window manager <NUM> may manage GUI resources used on the screen. The multimedia manager <NUM> may obtain formats necessary to play various media files and use a codec appropriate for a format to perform encoding or decoding on media files. The resource manager <NUM> may manage resources, such as source code of at least one of the applications <NUM>, memory or storage space.

The power manager <NUM> may operate together with a basic input/output system (BIOS) to manage battery or power and provide power information necessary for operating the electronic device. The database manager <NUM> may generate, search, or vary a database to be used in at least one of the applications <NUM>. The package manager <NUM> may manage installation or update of an application that is distributed in the form of a package file.

The connectivity manager <NUM> may manage wireless connectivity, such as Wi-Fi or Bluetooth®. The notification manager <NUM> may display or notify an event, such as an incoming message, appointment, or proximity notification, of the user without interfering with the user. The location manager <NUM> may manage locational information on the electronic device. The graphic manager <NUM> may manage graphic effects to be offered to the user and their related user interface. The security manager <NUM> may provide various security functions necessary for system security or user authentication. According to an embodiment of the present disclosure, when the electronic device <NUM> has telephony capability, the middleware <NUM> may further include a telephony manager for managing voice call or video call functions of the electronic device.

The middleware <NUM> may include a middleware module forming a combination of various functions of the above-described components, may provide a specified module per type of the operating system in order to provide a differentiated function, and may dynamically omit some existing components or add new components.

The API <NUM> may be a set of API programming functions and may have different configurations depending on operating systems. For example, in the case of Android or iOS, one API set may be provided per platform, and in the case of Tizen, two or more API sets may be offered per platform.

The applications <NUM> may include one or more applications that may provide functions such as, such as a home <NUM>, a dialer <NUM>, a short message service (SMS)/multimedia messaging service (MMS) <NUM>, an instant message (IM) <NUM>, a browser <NUM>, a camera <NUM>, an alarm <NUM>, a contact <NUM>, a voice dial <NUM>, an email <NUM>, a calendar <NUM>, a media player <NUM>, an album <NUM>, a clock <NUM>, a heath-care (e.g., measuring the degree of a workout or blood sugar), or provision of environmental information such as air pressure, moisture, or temperature information.

According to an embodiment of the present disclosure, the applications <NUM> may include an information exchanging application supporting information exchange between the electronic device <NUM> and an external electronic device <NUM> or <NUM>. Examples of the information exchange application may include, but is not limited to, a notification relay application for transferring specific information to the external electronic device, or a device management application for managing the external electronic device.

For example, the notification relay application may include a function for relaying notification information generated from other applications of the electronic device (e.g., the SMS/MMS application, email application, health-care application, or environmental information application) to the external electronic device <NUM> or <NUM>. The notification relay application may receive notification information from the external electronic device and may provide the received notification information to the user.

The device management application may perform at least some functions of the external electronic device <NUM> or <NUM> communicating with the electronic device, such as turning on/off the external electronic device or some components of the external electronic device, or control of brightness of the display, and the device management application may install, delete, or update an application operating in the external electronic device or a call service or message service provided from the external electronic device.

According to an embodiment of the present disclosure, the applications <NUM> may include a health-care application of a mobile medical device designated according to an attribute of the external electronic device <NUM> and <NUM>, an application received from the external electronic device <NUM> and <NUM>, and a preloaded application or a third party application downloadable from a server. The names of the components of the program module <NUM> according to the illustrated embodiment may be varied depending on the type of operating system.

According to an embodiment of the present disclosure, at least a part of the program module <NUM> may be implemented in software, firmware, hardware, or in a combination of at least two thereof. At least a part of the programming module <NUM> may be executed by a processor <NUM>, and may include e.g., a module, program, routine, set of instructions, or process for performing one or more functions.

The term 'module' may refer to a unit including one of hardware, software, and firmware, or a combination of at least two thereof. The term 'module' may be interchangeably used with a unit, logic, logical block, component, or circuit. The module may be a minimum unit or part of an integrated component or of performing one or more functions. The module may be implemented mechanically or electronically. For example, the module may include at least one of application specific integrated circuit (ASIC) chips, field programmable gate Arrays (FPGAs), or programmable logic arrays (PLAs) that perform some operations, which have already been known or will be developed in the future.

According to an embodiment of the present disclosure, at least a part of the device or method may be implemented as instructions stored in a computer-readable storage medium such as a program module. The instructions, when executed by a processor, may enable the processor to perform a corresponding function. The computer-readable storage medium may be the memory <NUM>.

The computer-readable storage medium may include a hardware device, such as hard discs, floppy discs, and magnetic tapes (e.g., a magnetic tape), optical media such as compact disc ROMs (CD-ROMs) and digital versatile discs (DVDs), magneto-optical media such as floptical disks, ROMs, RAMs, or flash memories. Examples of the program instructions may include not only machine language codes but also high-level language codes which are executable by various computing means using an interpreter. The aforementioned hardware devices may be configured to operate as one or more software modules to execute embodiments of the present disclosure, and vice versa.

Modules or program modules in accordance with embodiments of the present disclosure may include at least one of the aforementioned components, omit some of them, or further include additional components.

Operations performed by modules, programming modules or other components in accordance with embodiments of the present disclosure may be performed sequentially, simultaneously, repeatedly, or heuristically. Furthermore, some of the operations may be performed in a different order, or omitted, or may include additional operation(s).

The embodiments disclosed herein are disclosed for description and understanding of the disclosed technology and do not limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be interpreted as including all changes or embodiments based on the present disclosure.

Claim 1:
An electronic device (<NUM>), comprising:
a display (<NUM>);
a sensor module (<NUM>) configured to sense a movement of the electronic device (<NUM>); and
a processor (<NUM>) configured to:
control the display (<NUM>) to display a stereoscopic image including a left-eye image and a right-eye image on the display (<NUM>);
control the display (<NUM>) to display a pointer object (<NUM>) on a first position of the stereoscopic image;
move the pointer object (<NUM>) from the first position in the stereoscopic image to a second position corresponding to the movement sensed by the sensor module (<NUM>);
determine whether the pointer object (<NUM>) remains at the second position for a predetermined time after the movement of the pointer object (<NUM>), the second position being a position between a third position and a fourth position, the third position being a position at which a first object (<NUM>) is positioned, the fourth position being a position at which a second object (<NUM>) is positioned;
based on determining that the pointer object (<NUM>) remains at the second position for the predetermined time, determine a movement direction in which the pointer object (<NUM>) has been moved before the pointer object (<NUM>) is positioned at the second position between the third position and the fourth position, the movement direction being a direction of the movement of the pointer object (<NUM>);
determine the second object (<NUM>) which is, from the second position, positioned in the determined movement direction of the pointer object (<NUM>) between the first object (<NUM>) and the second object (<NUM>); and
move the pointer object (<NUM>) into the fourth position of the determined second object (<NUM>).