Patent ID: 12260146

DETAILED DESCRIPTION

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, where similar reference characters denote corresponding features consistently throughout.

FIG.1is a block diagram illustrating an electronic device101in a network environment100according to various embodiments.

Referring toFIG.1, the electronic device101in the network environment100may communicate with an electronic device102via a first network198(e.g., a short-range wireless communication network), or at least one of an electronic device104or a server108via a second network199(e.g., a long-range wireless communication network). According to an embodiment, the electronic device101may communicate with the electronic device104via the server108. According to an embodiment, the electronic device101may include a processor120, memory130, an input module150, a sound output module155, a display module160, an audio module170, a sensor module176, an interface177, a connecting terminal178, a haptic module179, a camera module180, a power management module188, a battery189, a communication module190, a subscriber identification module (SIM)196, or an antenna module197. In some embodiments, at least one of the components (e.g., the connecting terminal178) may be omitted from the electronic device101, or one or more other components may be added in the electronic device101. In some embodiments, some of the components (e.g., the sensor module176, the camera module180, or the antenna module197) may be implemented as a single component (e.g., the display module160).

The processor120may execute, for example, software (e.g., a program140) to control at least one other component (e.g., a hardware or software component) of the electronic device101coupled with the processor120, and may perform various data processing or computation. According to one embodiment, as at least part of the data processing or computation, the processor120may store a command or data received from another component (e.g., the sensor module176or the communication module190) in volatile memory132, process the command or the data stored in the volatile memory132, and store resulting data in non-volatile memory134. According to an embodiment, the processor120may include a main processor121(e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor123(e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor121. For example, when the electronic device101includes the main processor121and the auxiliary processor123, the auxiliary processor123may be adapted to consume less power than the main processor121, or to be specific to a specified function. The auxiliary processor123may be implemented as separate from, or as part of the main processor121.

The auxiliary processor123may control at least some of functions or states related to at least one component (e.g., the display module160, the sensor module176, or the communication module190) among the components of the electronic device101, instead of the main processor121while the main processor121is in an inactive (e.g., sleep) state, or together with the main processor121while the main processor121is in an active state (e.g., executing an application). According to an embodiment, the auxiliary processor123(e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module180or the communication module190) functionally related to the auxiliary processor123. According to an embodiment, the auxiliary processor123(e.g., the neural processing unit) may include a hardware structure specified for artificial intelligence model processing. An artificial intelligence model may be generated by machine learning. Such learning may be performed, e.g., by the electronic device101where the artificial intelligence is performed or via a separate server (e.g., the server108). Learning algorithms may include, but are not limited to, e.g., supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include a plurality of artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-network or a combination of two or more thereof but is not limited thereto. The artificial intelligence model may, additionally or alternatively, include a software structure other than the hardware structure.

The memory130may store various data used by at least one component (e.g., the processor120or the sensor module176) of the electronic device101. The various data may include, for example, software (e.g., the program140) and input data or output data for a command related thereto. The memory130may include the volatile memory132or the non-volatile memory134.

The program140may be stored in the memory130as software, and may include, for example, an operating system (OS)142, middleware144, or an application146.

The input module150may receive a command or data to be used by another component (e.g., the processor120) of the electronic device101, from the outside (e.g., a user) of the electronic device101. The input module150may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

The sound output module155may output sound signals to the outside of the electronic device101. The sound output module155may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as playing multimedia or playing record. The receiver may be used for receiving incoming calls. According to an embodiment, the receiver may be implemented as separate from, or as part of the speaker.

The display module160may visually provide information to the outside (e.g., a user) of the electronic device101. The display module160may include, for example, a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. According to an embodiment, the display module160may include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.

The audio module170may convert a sound into an electrical signal and vice versa. According to an embodiment, the audio module170may obtain the sound via the input module150, or output the sound via the sound output module155or a headphone of an external electronic device (e.g., an electronic device102) directly (e.g., wiredly) or wirelessly coupled with the electronic device101.

The sensor module176may detect an operational state (e.g., power or temperature) of the electronic device101or an environmental state (e.g., a state of a user) external to the electronic device101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module176may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface177may support one or more specified protocols to be used for the electronic device101to be coupled with the external electronic device (e.g., the electronic device102) directly (e.g., wiredly) or wirelessly. According to an embodiment, the interface177may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

A connecting terminal178may include a connector via which the electronic device101may be physically connected with the external electronic device (e.g., the electronic device102). According to an embodiment, the connecting terminal178may include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module179may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or electrical stimulus which may be recognized by a user via his tactile sensation or kinesthetic sensation. According to an embodiment, the haptic module179may include, for example, a motor, a piezoelectric element, or an electric stimulator.

The camera module180may capture a still image or moving images. According to an embodiment, the camera module180may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module188may manage power supplied to the electronic device101. According to one embodiment, the power management module188may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

The battery189may supply power to at least one component of the electronic device101. According to an embodiment, the battery189may include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.

The communication module190may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device101and the external electronic device (e.g., the electronic device102, the electronic device104, or the server108) and performing communication via the established communication channel. The communication module190may include one or more communication processors that are operable independently from the processor120(e.g., the application processor (AP)) and supports a direct (e.g., wired) communication or a wireless communication. According to an embodiment, the communication module190may include a wireless communication module192(e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module194(e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device via the first network198(e.g., a short-range communication network, such as Bluetooth™, wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or the second network199(e.g., a long-range communication network, such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or wide area network (WAN)). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multi components (e.g., multi chips) separate from each other. The wireless communication module192may identify and authenticate the electronic device101in a communication network, such as the first network198or the second network199, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the subscriber identification module196.

The wireless communication module192may support a 5G network, after a 4G network, and next-generation communication technology, e.g., new radio (NR) access technology. The NR access technology may support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable and low-latency communications (URLLC). The wireless communication module192may support a high-frequency band (e.g., the mmWave band) to achieve, e.g., a high data transmission rate. The wireless communication module192may support various technologies for securing performance on a high-frequency band, such as, e.g., beamforming, massive multiple-input and multiple-output (massive MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module192may support various requirements specified in the electronic device101, an external electronic device (e.g., the electronic device104), or a network system (e.g., the second network199). According to an embodiment, the wireless communication module192may support a peak data rate (e.g., 20 Gbps or more) for implementing eMBB, loss coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of downlink (DL) and uplink (UL), or a round trip of 1 ms or less) for implementing URLLC.

The antenna module197may transmit or receive a signal or power to or from the outside (e.g., the external electronic device) of the electronic device101. According to an embodiment, the antenna module197may include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module197may include a plurality of antennas (e.g., array antennas). In such a case, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network198or the second network199, may be selected, for example, by the communication module190(e.g., the wireless communication module192) from the plurality of antennas. The signal or the power may then be transmitted or received between the communication module190and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module197.

According to various embodiments, the antenna module197may form a mmWave antenna module. According to an embodiment, the mmWave antenna module may include a printed circuit board, a RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high-frequency band.

At least some of the above-described components may be coupled mutually and communicate signals (e.g., commands or data) therebetween via an inter-peripheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).

According to an embodiment, commands or data may be transmitted or received between the electronic device101and the external electronic device104via the server108coupled with the second network199. Each of the electronic devices102or104may be a device of a same type as, or a different type, from the electronic device101. According to an embodiment, all or some of operations to be executed at the electronic device101may be executed at one or more of the external electronic devices102,104, or108. For example, if the electronic device101should perform a function or a service automatically, or in response to a request from a user or another device, the electronic device101, instead of, or in addition to, executing the function or the service, may request the one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and transfer an outcome of the performing to the electronic device101. The electronic device101may provide the outcome, with or without further processing of the outcome, as at least part of a reply to the request. To that end, a cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device101may provide ultra low-latency services using, e.g., distributed computing or mobile edge computing. In another embodiment, the external electronic device104may include an internet-of-things (IoT) device. The server108may be an intelligent server using machine learning and/or a neural network. According to an embodiment, the external electronic device104or the server108may be included in the second network199. The electronic device101may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology or IoT-related technology.

FIGS.2A,2B, and2Care diagrams illustrating a wearable device200(e.g., the electronic device101) according to an embodiment.

Referring toFIGS.2A,2B, and2C, the electronic device101may include a body202and a cover204. The body202may include at least one of a support structure206, at least one display device (e.g., a first display208), a cover mounting structure212, or a control module214. The cover204may also include at least one display device (e.g., a second display240). The cover204may include an electrical/physical structure connected to the body202to drive the second display240. According to an embodiment of the disclosure, the body202and the cover204may be integrally implemented. The support structure206may include a mechanical structure that may be used for a user to wear the electronic device100on the head. The at least one display (e.g., the first display208) may be provided at a position corresponding to each of the positions of the user's eyes. The at least one display (e.g., the first display208) may be implemented as a plurality of (e.g., two) displays or as a single flat panel display as illustrated inFIG.2C. The electronic device101may further include at least one lens corresponding to the at least one display (e.g., the first display208). The control module214may be provided on a side surface of the body202. The control module214may be used to obtain an input for controlling the electronic device101from the user. For example, the control module214may include at least one of a touch panel, a button, a wheel key, or a touch pad. The electronic device101may adjust the sound volume of content being output or control image reproduction, based on the input obtained through the control module214. To provide virtual reality, the electronic device101may separately provide a screen corresponding to the left eye of the user wearing the electronic device101and a screen corresponding to the right eye of the user, as illustrated inFIG.2C. The electronic device101may include a hole. A strap fixing the electronic device101to the user's head may be provided through the hole216.

FIG.3is a diagram illustrating a function or operation of displaying information related to a first execution screen through the second display240in the wearable device200(e.g., the electronic device101ofFIG.1) according to an embodiment.

Referring toFIG.3, in operation310, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation320, the wearable device200may determine a display type for information to be displayed on the second display240while displaying the first execution screen through the first display208. The wearable device200may determine the display type for the information to be displayed on the second display240based on a user input. For example, when obtaining a user input for displaying a current screen being displayed on the first display208through the second display240as it is from the user, the wearable device200may display the screen being displayed on the first display208through the second display240as it is. Alternatively, when obtaining a user input for displaying only summary information (e.g., the title of a video being displayed) of a current screen being displayed on the first display208through the second display240from the user, the wearable device200may display the summary information of the current screen being displayed on the first display208through the second display240. According to an embodiment of the disclosure, the user input for determining the display type to be displayed on the second display240may be obtained preliminarily (e.g., before displaying the first execution screen) or while displaying the first execution screen. The wearable device200may determine a display type for information to be displayed on the second display240based on the current location of the user. For example, when determining that the user is currently located in a public place (e.g., a department store, a company, or the like), the wearable device200may display the summary information or no information on the second display240. When determining that the user is located in a private place (e.g., the user's home), the wearable device200may display a screen corresponding to the screen being displayed on the first display208through the second display240. The wearable device200may determine the current location of the user through at least one sensor (e.g., an inertial measurement unit (IMU) sensor, a GPG sensor, or the like) included in the wearable device200, and determine whether the current location is a public place or a private place or a private place. When the wearable device200includes at least one camera having a sensor (e.g., a complementary metal oxide semiconductor (CMOS) sensor) exposed to the outside, the wearable device200may determine whether the current location is a public place or a private place, further based on an image captured by the at least one camera. For example, when a specified number of or more external objects (e.g., nearby people) are in an image captured by the at least one camera, the wearable device200may determine that the current location is a public place. Alternatively, the wearable device200may determine whether the current location is a public place or a private place based on the characteristics (e.g., the name of a specific company, the interior layout of a building, or the like) of a captured external object. For example, the wearable device200may determine whether the current location is a public place or a private place by comparing an image pre-stored in the wearable device200with a captured image. The wearable device200may determine whether the current location is a public place or a private place according to an input obtained preliminarily from the user. For example, when the user has designated a specific location (e.g., 129 Samseong-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do) as a public place (e.g., a company), and the wearable device200is located at the specific location (e.g., 129 Samseong-ro, Yeongtong-gu, Suwon-si, Gyeonggi-do), the wearable device200may determine the current location as a “public place”.

In operation330, the wearable device200may display information related to the first execution screen through the second display240based on the display type determined in operation320. For example, the wearable device200may display the screen being displayed on the first display208through the second display240as it is. Alternatively, the wearable device200may display the summary information (e.g., the title of a video being played) of the current being displayed on the first display208through the second display240.FIGS.4A and4Bare diagrams illustrating information related to a first execution screen displayed through the second display240in the wearable device200according to an embodiment. InFIG.4A, an embodiment in which a screen corresponding to the screen being displayed through the first display208is displayed through the second display240is illustratively illustrated. InFIG.4B, an embodiment in which the summary information (e.g., the title of a video being played) of the screen being displayed on the first display208is displayed through the second display240is illustratively illustrated.

FIG.5is a diagram illustrating a function or operation of displaying information related to a first execution screen through an external electronic device1610operably connected to the wearable device200according to an embodiment.FIG.6is a diagram illustrating information related to a first execution screen according to an embodiment.

Referring toFIG.5, in operation510, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation520, the wearable device200may determine a display type for information to be displayed on the second display240while displaying the first execution screen through the first display208. The wearable device200may determine the display type for the information to be displayed on the second display240based on a user input. The description of operation320may be equally applied to operation520.

In operation530, while displaying information related to the first execution screen through the second display240, the wearable device200may transmit the information related to the first execution screen to the external electronic device1610so that the external electronic device1610displays the information related to the first execution screen. The external electronic device1610may be operably connected to the wearable device200through short-range communication or the like. The wearable device200may transmit the information related to the first execution screen to the external electronic device1610to cause the external electronic device1610to display the information (e.g., the title of a video being played) related to the first execution screen as illustrated inFIG.6. The external electronic device1610may display the information related to the first execution screen based on the information obtained from the wearable device200.

FIGS.7and8are diagrams illustrating a function or operation of displaying a visual object810corresponding to an emotional expression of a user through the second display240in the wearable device200according to an embodiment.

Referring toFIG.7, in operation710, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The wearable device200may determine whether external objects (e.g., people) exist around the user wearing the wearable device200through at least one sensor (e.g., a proximity sensor and/or a motion recognition sensor (e.g., at least one CMOS sensor)). The wearable device200may determine whether external objects (e.g., people) exist around the user wearing the wearable device200based on data sensed by at least one proximity sensor disposed outside of the housing. Alternatively, the wearable device200may determine whether external objects (e.g., people) exist around the user wearing the wearable device200based on data sensed by at least one motion recognition sensor disposed outside of the housing. The first application may include various applications such as an Internet application and a video application.

In operation720, the wearable device200may obtain information about an emotional expression of the user, while displaying the first execution screen through the first display208. The wearable device200may include at least one camera for recognizing a facial expression of the user. The wearable device200may include at least one camera for recognizing a user gesture (e.g., a hand motion). According to an embodiment of the disclosure, when the wearable device200is worn by the user, the at least one camera for recognizing a facial expression of the user may be disposed to face the user's face in order to capture a face area of the user. According to an embodiment of the disclosure, the at least one camera for recognizing a user gesture (e.g., a hand motion) may be disposed to face an external environment of the wearable device200in order to capture a user gesture. The wearable device200may obtain a facial expression of the user and/or a user gesture through the at least one camera as information indicating an emotional expression of the user. The first execution screen may include a message application, and the user may transmit an emoticon representing a specific emotional expression to the other party through the message application. The wearable device200may obtain an emotion corresponding to the emoticon input by the user as an emotional expression of the user. The first execution screen may include at least one avatar set by the user. The wearable device200may control the first display208to represent an expression corresponding to a facial expression of the user obtained by the at least one camera by an avatar.

In operation730, the wearable device200may display the visual object810corresponding to the information about the emotional expression obtained in operation720through the second display240. When a smiling expression is obtained by the at least one camera, the wearable device200may display the visual object810(e.g., an avatar's face) having the smiling expression through the second display240. When the user transmits a smiley emoticon to the other party through the message application, the wearable device200may display the visual object810(e.g., an avatar's face) having the smiling expression through the second display240. When a “thumbs up” gesture is obtained by the at least one camera, the wearable device200may display an emoticon representing the “thumbs up” gesture through the second display240.

FIGS.9and10are diagrams illustrating a function or operation of displaying information about at least one item obtained by a user through the second display240in the wearable device200according to an embodiment.

Referring toFIG.9, in operation910, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation920, the wearable device200may obtain at least one item through the first application. For example, when the user purchases glasses through a game application, the wearable device200may store information about the glasses as at least one obtained item in the wearable device200.

In operation930, the wearable device200may display information1010about the obtained item through the second display240based on a specified display level. The specified display level may be set by the user or based on the current location of the wearable device200. For example, when a low display level is set by the user, the wearable device200may display an image of the glasses as the information1010about the obtained item through the second display240, as illustrated inFIG.10. For example, when a high display level is set by the user, the wearable device200may display no information through the second display240, even though the user has purchased the glasses through the game application. For example, when the user is currently located in a private place, the wearable device200may display the image of the glasses as the information1010about the obtained item through the second display240, as illustrated inFIG.10. For example, when the user is currently located in a public place, the wearable device200may display no information through the second display240, even though the user has purchased the glasses through the game application.

FIG.11Ais a diagram illustrating a function or operation of providing information about a predicted motion range of a user through a projection module in a wearable device according to an embodiment.FIG.11Bis a diagram illustrating a function or operation of providing information about a predicted motion direction of a user through a projection module in a wearable device according to an embodiment.FIG.12is a diagram illustrating an example of the function or operation illustrated inFIG.11Aaccording to an embodiment.

Referring toFIG.11A, in operation1110, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation1120, the wearable device200may provide information about a predicted motion range of the user, while displaying information about the first execution screen through the second display240. When the user is currently using an exercise (e.g., boxing) application, the wearable device200may control a projection module to represent information about a motion range1220corresponding to the type of the current exercise in an external world or real world, as illustrated inFIG.12. The projection module may be disposed outside the wearable device200so that the information about the motion range1220is represented in a specified color in the external world or the real world. The wearable device200may determine the motion range1220based on body data input by the user and/or data specified in the application. The motion range1220may be determined to have a circular shape around the wearable device200, and as shown inFIG.12, to include a specified area in front of the wearable device200. The wearable device200may display information (e.g., first information1210indicating a game in progress) related to the first execution screen through the second display240, while outputting the information about the motion range1220. According to another embodiment of the disclosure, the information on the motion range1220may be only processed as an area recognized by the wearable device200, without being output.

Referring toFIG.11B, in operation1130, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation1140, the wearable device200may provide information about a predicted motion direction of the user, while displaying information about the first execution screen through the second display240. When the user is currently using a first application (e.g., a navigation application), the wearable device200may control the projection module to represent information about a motion direction predicted based on a destination set by the user in an external world or real world. The projection module may be disposed outside the wearable device200so that the information (e.g., an arrow) about the motion direction is represented in a specified color and/or shape in the external world or the real world. When the wearable device200predicts that the user will move to the right within a specified time, the wearable device200may control the projection module to represent the information (e.g., the arrow) about the motion direction in a specified color and/or shape in the external world or the real world during the specified time. When the wearable device200predicts that the user will move to the right within the specified time, the wearable device200may display the information (e.g., the arrow) about the motion direction in the specified color and/or shape through the second display240during the specified time.

FIGS.13and14are diagrams illustrating a function or operation of outputting a warning message1430through the second display240when an external object approaches the wearable device200in the wearable device200according to an embodiment.

Referring toFIG.13, in operation1310, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation1320, the wearable device200may identify that an external object (e.g., an external user) approaches the wearable device200, while displaying the first execution screen. The wearable device200may identify that the external object approaches the wearable device200(e.g., the external object enters a safety area1420or it is expected that the external object will enter the safety area1420within a specified time) using the at least one proximity sensor provided in the wearable device200. The wearable device200may identify that the external object approaches the wearable device200further based on an image obtained by the at least one camera. The wearable device200may set the safety area1420around the wearable device200. The safety area1420may be determined to have a circular shape around the wearable device200, and as illustrated inFIG.14, to include a specified area in front of the wearable device200. The safety area1420may be determined based on a user input. Alternatively, the safety area1420may be determined by the wearable device200based on an application being executed. For example, when the application being executed is an exercise (e.g., running) application, the wearable device200may determine the safety area1420to include a specified area in front of the wearable device200. The safety area1420may be specified by a manufacturer or provider of an application. Information about the safety area1420may be represented in the external world or the real world through the projection module, as illustrated inFIG.14. Alternatively, the information about the safety area1420may not be displayed. The size, display position, and/or shape of the safety area1420may be changed and displayed according to a predicted motion of the user wearing the wearable device200. According to an embodiment of the disclosure, when predicting that a motion speed of a body part of the user wearing the wearable device200will increase from a current motion speed according to settings of the application (e.g., the running application) and/or a current physical condition of the user, the wearable device200may display the safety area1420in a size larger than a current size of the displayed safety area1420. According to an embodiment of the disclosure, when predicting that a motion range of a body part of the user wearing the wearable device200will be widened according to settings of an application (e.g., a game application) and/or the current physical condition of the user, the wearable device200may display the safety area1420in a size larger than the current size of the displayed safety area1420. According to an embodiment of the disclosure, when predicting that a motion direction of the user wearing the wearable device200will be changed according to the settings of the application (e.g., the running application and/or the game application) and/or the current physical condition of the user, the wearable device200may change the display position of the safety area1420according to the predicted motion direction and display the safety area1420at the changed display position.

In operation1330, the wearable device200may output the warning message1430through the second display240. As illustrated inFIG.14, the wearable device200may output the warning message1430indicating “beware of collision”.

FIGS.15and16are diagrams illustrating a function or operation of transmitting the warning message1430to the external electronic device1610by the wearable device200according to an embodiment.

Referring toFIG.15, in operation1510, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation1520, the wearable device200may identify that an external object (e.g., an external user) approaches the wearable device200, while displaying the first execution screen. The wearable device200may identify that the external object approaches the wearable device200using the at least one proximity sensor provided in the wearable device200. The wearable device200may identify that the external object approaches the wearable device200further based on an image obtained by the at least one camera. The wearable device200may set the safety area1420around the wearable device200. The safety area1420may be determined to have a circular shape around the wearable device200, and as illustrated inFIG.14, to include a specified area in front of the wearable device200.

In operation1530, the wearable device200may transmit information related to the warning message1430to the external electronic device1610so that the external electronic device1610displays the warning message1430, while displaying the warning message1430through the second display240. The external electronic device1610may be operably connected to the wearable device200through short-range communication or the like. The wearable device200may transmit the information related to the warning message1430to the external electronic device1610so that the external electronic device1610outputs the warning message1430, as illustrated inFIG.16. The external electronic device1610(e.g., a smart watch) may output the warning message1430based on the information obtained from the wearable device200. The external electronic device1610may output the warning message1430through a visual, auditory, and/or tactile method.

FIGS.17and18are diagrams illustrating a function or operation of transmitting information about the safety area1420to the external electronic device1610(e.g., augmented reality (AR) glasses1820) by the wearable device200according to embodiment, so that the information is output through the external electronic device1610.

Referring toFIG.17, in operation1710, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation1720, the wearable device200may identify that an external object (e.g., an external user) approaches the wearable device200, while displaying the first execution screen. The wearable device200may identify that the external object approaches the wearable device200using the at least one proximity sensor provided in the wearable device200. The wearable device200may identify that the external object approaches the wearable device200further based on an image obtained by the at least one camera. The wearable device200may set the safety area1420around the wearable device200. The safety area1420may be determined to have a circular shape around the wearable device200, and as illustrated inFIG.14, to include a specified area in front of the wearable device200.

In operation1730, the wearable device200may transmit information about a first area1810to the external electronic device1610, so that the information is output through the external electronic device1610. As shown inFIG.18, the first area1810may comprise at least a portion of an environment external to the wearable device. The external electronic device1610may include the AR glasses1820. The wearable device200may transmit the information about the first area1810to the external electronic device1610, so that the information about the first area1810(e.g., the safety area1420) is viewed as AR to an external user. The external electronic device1610may provide the information about the first area1810(e.g., the safety area1420) as AR to the external user. When the external user enters the first area1810(e.g., the safety area1420) or when it is expected that the user will enter the first area1810, the wearable device200may output the warning message1420through the external electronic device1610.

FIG.19is a diagram illustrating the wearable device200according to another embodiment. Referring toFIG.19, the wearable device may be operably connected to a main device1910. In this case, various embodiments of the disclosure may be implemented or performed through the main device1910. The wearable device200according to another embodiment of the disclosure may include a protective cover1920including a second display. The protective cover1920according to another embodiment of the disclosure may be implemented to be detachable from the body of the wearable device200.

FIG.20is a diagram illustrating a function or operation of outputting a warning message through the first display208and the second display240by the wearable device according to embodiment, when an external object (e.g., an external user) approaches the wearable device200.

Referring toFIG.20, in operation2010, the wearable device200may display a first execution screen of a first application through the first display208, while the wearable device200is worn by the user. As illustrated inFIG.2C, the wearable device200may provide a first execution screen for providing virtual reality through the first display208. The wearable device200may include at least one proximity sensor for determining whether the user wears the wearable device200. The wearable device200may determine whether the user wears the wearable device200based on data sensed through the at least one proximity sensor. When determining that the user wears the device, the wearable device200may display a specified screen (e.g., a preset home screen) through the first display208. The first application may include various applications such as an Internet application and a video application.

In operation2020, the wearable device200may identify that an external object (e.g., an external user) approaches the wearable device200, while displaying the first execution screen. The wearable device200may identify that the external object approaches the wearable device200(e.g., the external object enters the safety area1420or it is expected that the external object will enter the safety area1420within a specified time) using the at least one proximity sensor provided in the wearable device200. The wearable device200may identify that the external object approaches the wearable device200further based on an image obtained by the at least one camera. The wearable device200may set the safety area1420around the wearable device200. The safety area1420may be determined to have a circular shape around the wearable device200, and as illustrated inFIG.14, to include a specified area in front of the wearable device200. The safety area1420may be determined based on a user input. Alternatively, the safety area1420may be determined by the wearable device200based on an application being executed. For example, when the application being executed is an exercise (e.g., running) application, the wearable device200may determine the safety area1420to include a specified area in front of the wearable device200. The safety area1420may be specified by a manufacturer or provider of an application. Information about the safety area1420may be represented in the external world or the real world through the projection module, as illustrated inFIG.14. Alternatively, the information about the safety area1420may not be displayed.

In operation2030, the wearable device200may output the warning message1430through the first display208and the second display240. The wearable device200may output the warning message1430indicating “beware of collision” through the first display208and the second display240. According to an embodiment of the disclosure, the warning message1430displayed through the first display208may be output in the form of a pop-up window on the first execution screen of the first application. According to an embodiment of the disclosure, only the warning message1430may be displayed through the first display208without displaying the first execution screen of the first application.

When the wearable device200identifies that the external object enters the safety area1420, it may output the warning message1430through the first display208and the second display240. The wearable device200may output the warning message1430“beware of collision” through the second display240. The wearable device200may provide a notification indicating that an external object has entered the safety area1420through the first display208in the form of a pop-up window. The wearable device200may provide information about the external object that has entered the safety area1420through the first display208in a video see through (VST) method. The wearable device200may provide the information about the external object which has entered the safety area1420through the second display240in the VST method, while providing the notification indicating that the external object has entered the safety area1420through the first display208in the form of a pop-up window. The wearable device200may output the warning message1430through the first display208without outputting the warning message1430through the second display240. The wearable device200may output the warning message1430through the second display240without outputting the warning message1430through the first display208. The wearable device200may output the warning message1430through the first display208and the second display240.

The electronic device according to various embodiments of the disclosure may be one of various types of electronic devices. The electronic devices may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to an embodiment of the disclosure, the electronic devices are not limited to those described above.

It should be appreciated that an embodiment of the disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It is to be understood that a singular form of a noun corresponding to an item may include one or more of the things, unless the relevant context clearly indicates otherwise. As used herein, each of such phrases as “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B, or C”, “at least one of A, B, and C”, and “at least one of A, B, or C”, may include any one of, or all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as “1st” and “2nd,” or “first” and “second” may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspect (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term “operatively” or “communicatively”, as “coupled with”, “coupled to”, “connected with”, or “connected to” another element (e.g., a second element), it means that the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.

As used in connection with an embodiment of the disclosure, the term “module” may include a unit implemented in hardware, software, or firmware, and may interchangeably be used with other terms, for example, logic, logic block, part, or circuitry. A module may be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, the module may be implemented in a form of an application-specific integrated circuit (ASIC).

An embodiment of the disclosure as set forth herein may be implemented as software (e.g., the program140) including one or more instructions that are stored in a storage medium (e.g., internal memory136or external memory138) that is readable by a machine (e.g., the electronic device101). For example, a processor (e.g., the processor120) of the machine (e.g., the electronic device101) may invoke at least one of the one or more instructions stored in the storage medium, and execute it, with or without using one or more other components under the control of the processor. This allows the machine to be operated to perform at least one function according to the at least one instruction invoked. The one or more instructions may include a code generated by a complier or a code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Wherein, the term “non-transitory” simply means that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments of the disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., PlayStore™), or between two user devices (e.g., smart phones) directly. If distributed online, at least part of the computer program product may be temporarily generated or at least temporarily stored in the machine-readable storage medium, such as memory of the manufacturer's server, a server of the application store, or a relay server.

According to an embodiment of the disclosure, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to an embodiment of the disclosure, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, a plurality of components (e.g., modules or programs) may be integrated into a single component. In such a case, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to an embodiment of the disclosure, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.

While example embodiments of the disclosure have been shown and described, the disclosure is not limited to the aforementioned specific embodiments, and it is apparent that various modifications can be made by those having ordinary skill in the technical field to which the disclosure belongs, without departing from the gist of the disclosure as claimed by the appended claims and their equivalents. Also, it is intended that such modifications are not to be interpreted independently from the technical idea or prospect of the disclosure.