Patent Description:
The disclosure relates to an electronic device comprising an antenna device.

With the development of display-related technologies, flexible display devices are being researched and developed at a use stage, such as being folded, rolled into a roll shape, or stretchable in at least one direction. Since these displays may be deformed into various shapes, they may satisfy both a demand for a larger display in the use stage and a demand for a smaller display for portability.

Furthermore, research and product development on services providing augmented reality (AR) have been actively conducted. In particular, AR is being used more actively as devices including a photographing means, a high-performance computing means, and a communication means, such as a smartphone, is developed. An AR service may be a variety of services that may maximize user convenience by displaying various side information on an image captured through a photographing means or the like.

In order to provide augmented reality (AR), it is necessary to be able to estimate, in real time, coordinate values of a position and a posture of an anchor at a camera's viewpoint that changes according to the movement of a user in a three-dimensional (3D) space. However, in a flexible display device, as the size of a display screen changes, coordinate values of the position and posture of the anchor at the camera's viewpoint may change, and as a result, AR content may be displayed at an incorrect position.

<CIT> discloses a server and system for implementing an augmented reality image based on positioning information. As the server for implementing an augmented reality image, the server according to various embodiments of the present invention includes: a communication module which connects a tag device or a reference device to the server; an information collecting unit which collects relative position information of the tag device using a position of the reference device, which is separated from the tag device by a preset distance, as a reference point and information on a view direction which the tag device faces; and a virtual object determining unit which determines a position of a virtual object to be outputted on the augmented reality image based on the position and view direction information of the tag device.

<CIT> discloses a rollable mobile terminal having a rollable display, the rollable mobile terminal comprising: a touch screen formed to be rollable; a first body connected to one end of the touch screen; a second body connected to the other end opposite to the one end of the touch screen; a guide unit which is arranged at the first body and/or the second body, and is formed to wrap around the touch screen so as to accommodate thereof; and a control unit for setting at least a part of the touch screen, which is exposed to the outside of the guide unit by a movement, as a display region when the first body and/or the second body are moved by an external force, and outputting screen information to the display region, wherein the control unit outputs different pieces of the screen information to the display region on the basis of the body, which is moved by the external force, between the first body and the second body.

Provided is an electronic device in which coordinate values of a position and posture of an anchor at a camera's viewpoint are estimated in real time to determine a position where AR content is to be displayed according to a size of a display screen.

According to an aspect of the disclosure, an electronic device includes: a first housing; a second housing, wherein at least one of the first housing and the second housing is configured to be movable relative to the other one of the first housing and the second housing; a display including a screen which is expandable or retractable, wherein a size of a part of the screen visually exposed to an outside changes as at least one of the first housing and the second housing is moved; an antenna disposed in a partial area of the first housing; a camera disposed in a partial area of the second housing; a memory storing instructions; and at least one processor configured to execute the instructions to: obtain information on a first position between the antenna and an anchor; obtain information on a position change between the antenna and the camera; and estimate information on a second position between the camera and the anchor based on the information on the first position and the information on the position change.

The memory may include: a plurality of lookup tables storing phase offset values corresponding to distance information between the antenna and the anchor, and information on a distance change between the antenna and the camera, and the at least one processor may be further configured to execute the instructions to determine a phase offset value from the plurality of lookup tables based on the information on the first position and the information on the position change.

The at least one processor may be further configured to execute the instructions to: determine a target lookup table corresponding to the information on the first position from among the plurality of lookup tables; and determine the phase offset value from the target lookup table based on the information on the position change.

The electronic device may further include a sensor configured to detect the size of the part of the screen visually exposed to the outside.

The memory may be configured to store information on an initial position between the antenna and the camera in a state in which the second housing does not move, and the at least one processor may be further configured to execute the instructions to obtain the information on the position change based on the information on the initial position and the size of the part of the screen visually exposed to the outside.

The at least one processor may be further configured to execute the instructions to obtain the information on a distance change between the antenna and the camera based on the information on the initial position and the size of the part of the screen visually exposed to the outside.

The at least one processor may be further configured to execute the instructions to obtain information on a phase change between the antenna and the camera based on the information on the initial position and the size of the part of the screen visually exposed to the outside.

The antenna may be configured to collect position information data for obtaining the information on the first position by communicating with an antenna mounted on the anchor, and the at least one processor may be further configured to execute the instructions to obtain distance information and phase information between the antenna and the anchor based on the position information data.

The antenna may include: an ultra-wideband (UWB) antenna, and the at least one processor may be further configured to execute the instructions to obtain the phase information between the antenna and the anchor based on a phase difference of a signal received from a plurality of patch antennas included in the UWB antenna to the antenna mounted on the anchor.

The at least one processor may be further configured to execute the instructions to obtain direction information between the camera and the anchor based on the distance information and the phase information between the antenna and the anchor, and distance information between the antenna and the camera.

The at least one processor may be further configured to execute the instructions to obtain distance information between the camera and the anchor based on the distance information and the phase information between the antenna and the anchor, and the distance information between the antenna and the camera.

The electronic device may further include an inertial measurement unit (IMU) sensor for measuring direction information on a direction the electronic device is facing and tilt information of the electronic device, and the at least one processor may be further configured to execute the instructions to receive additional information determined based on the information on the second position, the direction information, and the tilt information, and render augmented reality content based on the additional information.

According to an aspect of the disclosure, a method of providing augmented reality content by an electronic device including a display including a screen that is expandable or retractable, the method including: detecting a change in a size of the screen that is visually exposed to an outside; obtaining information on a first position between an antenna of the electronic device and an anchor; based on the change in the size of the screen, obtaining information on a position change between the antenna and a camera of the electronic device; estimating information on a second position between the camera and the anchor based on the information on the first position and the information on the position change; obtaining direction information and tilt information of the electronic device; receiving additional information determined based on the information on the second position and the direction information and the tilt information of the electronic device; and rendering the augmented reality content based on the additional information, wherein a position of the camera changes as the size of the screen changes.

The estimating of the information on the second position may include: determining a phase offset value from a plurality of lookup tables based on the information on the first position and the information on the position change; and estimating the information on the second position by compensating the phase offset value for the information on the first position, and the plurality of lookup tables may store phase offset values corresponding to distance information between the antenna and the anchor and information on a distance change between the antenna and the camera.

The determining of the phase offset value may include: determining a target lookup table corresponding to the information on the first position from among the plurality of lookup tables; and determining the phase offset value from the target lookup table based on the information on the position change, and the estimating of the information on the second position may include obtaining at least one of direction information and distance information between the camera and the anchor, based on the distance information and phase information between the antenna and the anchor, and distance information between the antenna and the camera.

According to one or more embodiments, coordinate values of a position and posture of an anchor at a camera's viewpoint may be estimated in real time to determine a position where AR content is to be displayed according to a size of a display screen in a flexible display device.

In addition, various effects directly or indirectly ascertained through the disclosure may be provided.

When describing the embodiments with reference to the accompanying drawings, like reference numerals refer to like elements and a repeated description related thereto will be omitted.

<FIG> is a block diagram illustrating an electronic device <NUM> in a network environment <NUM>, according to one or more embodiments. Referring to <FIG>, the electronic device <NUM> in the network environment <NUM> may communicate with an electronic device <NUM> via a first network <NUM> (e.g., a short-range wireless communication network), or communicate with at least one of an electronic device <NUM> or a server <NUM> via a second network <NUM> (e.g., a long-range wireless communication network). According to an embodiment, the electronic device <NUM> may include a processor <NUM>, a memory <NUM>, an input module <NUM>, a sound output module <NUM>, a display module or display <NUM>, an audio module <NUM>, a sensor module or sensor176, an interface <NUM>, a connecting terminal <NUM>, a haptic module <NUM>, a camera module or camera <NUM>, a power management module <NUM>, a battery <NUM>, a communication module <NUM>, a subscriber identification module (SIM) <NUM>, or an antenna module <NUM>. In some embodiments, at least one (e.g., the connecting terminal <NUM>) of the above components may be omitted from the electronic device <NUM>, or one or more other components may be added in the electronic device <NUM>. In some embodiments, some (e.g., the sensor module <NUM>, the camera module <NUM>, or the antenna module <NUM>) of the components may be integrated as a single component (e.g., the display module <NUM>).

The processor <NUM> may execute, for example, software (e.g., a program <NUM>) to control at least one other component (e.g., a hardware or software component) of the electronic device <NUM> connected to the processor <NUM>, and may perform various data processing or computation. According to an embodiment, as at least a part of data processing or computation, the processor <NUM> may store a command or data received from another component (e.g., the sensor module <NUM> or the communication module <NUM>) in a volatile memory <NUM>, process the command or the data stored in the volatile memory <NUM>, and store resulting data in a non-volatile memory <NUM>. According to an embodiment, the processor <NUM> may include a main processor <NUM> (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor <NUM> (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with the main processor <NUM>. For example, when the electronic device <NUM> includes the main processor <NUM> and the auxiliary processor <NUM>, the auxiliary processor <NUM> may be adapted to consume less power than the main processor <NUM> or to be specific to a specified function.

The auxiliary processor <NUM> may control at least some of functions or states related to at least one (e.g., the display module <NUM>, the sensor module <NUM>, or the communication module <NUM>) of the components of the electronic device <NUM>, instead of the main processor <NUM> while the main processor <NUM> is in an inactive (e.g., sleep) state, or together with the main processor <NUM> while the main processor <NUM> is an active state (e.g., executing an application). According to an embodiment, the auxiliary processor <NUM> (e.g., an ISP or a CP) may be implemented as part of another component (e.g., the camera module <NUM> or the communication module <NUM>) functionally related to the auxiliary processor <NUM>. According to an embodiment, the auxiliary processor <NUM> (e.g., an NPU) may include a hardware structure specified for artificial intelligence model processing. An artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, by the electronic device <NUM>, in which an artificial intelligence model is executed, or performed via a separate server (e.g., the server <NUM>). Learning algorithms may include, but are not limited to, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. An artificial neural network may include, for example, a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more thereof, but is not limited thereto. The artificial intelligence model may additionally or alternatively include a software structure other than the hardware structure.

The memory <NUM> may store various pieces of data used by at least one component (e.g., the processor <NUM> or the sensor module <NUM>) of the electronic device <NUM>. The various pieces of data may include, for example, software (e.g., the program <NUM>) and input data or output data for a command related thereto.

The program <NUM> may be stored as software in the memory <NUM>, and may include, for example, an operating system (OS) <NUM>, middleware <NUM>, or an application <NUM>.

The sound output module <NUM> may output a sound signal to the outside of the electronic device <NUM>. The speaker may be used for general purposes, such as playing multimedia or playing a record. The receiver may be used to receive an incoming call.

The display module <NUM> may include, for example, a control circuit for controlling a display, a hologram device, or a projector and control circuitry to control a corresponding one of the display, hologram device, and projector. According to an embodiment, the display module <NUM> may include a touch sensor adapted to sense a touch, or a pressure sensor adapted to measure an intensity of a force incurred by the touch. According to an embodiment, the display module <NUM> may include a screen of which the size visually exposed to the outside of the display module <NUM> changes. For example, the display module <NUM> may be an expandable display, such as a foldable display, a rollable display, and a slideable display. For example, the expandable display may be implemented through a flexible display.

According to an embodiment, the audio module <NUM> may obtain the sound via the input module <NUM> or output the sound via the sound output module <NUM> or an external electronic device (e.g., the electronic device <NUM> such as a speaker or headphones) directly or wirelessly connected to the electronic device <NUM>.

The sensor module <NUM> may detect an operational state (e.g., power or temperature) of the electronic device <NUM> or an environmental state (e.g., a state of a user) external to the electronic device <NUM>, and generate an electrical signal or data value corresponding to the detected state.

The interface <NUM> may support one or more specified protocols to be used for the electronic device <NUM> to be coupled with the external electronic device (e.g., the electronic device <NUM>) directly (e.g., by wire) or wirelessly. According to an embodiment, the interface <NUM> may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

The connecting terminal <NUM> may include a connector via which the electronic device <NUM> may be physically connected to the external electronic device (e.g., the electronic device <NUM>).

The haptic module <NUM> may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or an electrical stimulus which may be recognized by a user via their tactile sensation or kinesthetic sensation.

The camera module <NUM> may capture a still image and moving images. According to an embodiment, the camera module <NUM> may include one or more lenses, image sensors, ISPs, or flashes.

The communication module <NUM> may include one or more CPs that are operable independently of the processor <NUM> (e.g., an AP) and that support a direct (e.g., wired) communication or a wireless communication. According to an embodiment, the communication module <NUM> may include a wireless communication module <NUM> (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module <NUM> (e.g., a local area network (LAN) communication module, or a power line communication (PLC) module). A corresponding one of these communication modules may communicate with the external electronic device <NUM> via the first network <NUM> (e.g., a short-range communication network, such as Bluetooth™, wireless-fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or the second network <NUM> (e.g., a long-range communication network, such as a legacy cellular network, a <NUM> network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components (e.g., multiple chips) separate from each other. The wireless communication module <NUM> may identify and authenticate the electronic device <NUM> in a communication network, such as the first network <NUM> or the second network <NUM>, using subscriber information (e.g., international mobile subscriber identity (IMSI)) stored in the SIM <NUM>.

The wireless communication module <NUM> may support a <NUM> network after a <NUM> network, and next-generation communication technology, for example, new radio (NR) access technology. The wireless communication module <NUM> may support a high-frequency band (e.g., a mmWave band) to achieve, for example, a high data transmission rate. The wireless communication module <NUM> may support various technologies for securing performance on a high-frequency band, such as, for example, beamforming, massive multiple-input and multiple-output (massive MIMO), full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large-scale antenna. According to an embodiment, the wireless communication module <NUM> may support a peak data rate (e.g., <NUM> Gbps or more) for implementing eMBB, loss coverage (e.g., <NUM> dB or less) for implementing mMTC, or U-plane latency (e.g., <NUM> or less for each of downlink (DL) and uplink (UL), or a round trip of <NUM> or less) for implementing URLLC.

According to an embodiment, the antenna module <NUM> may include an antenna including a radiating element including a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). In such a case, at least one antenna appropriate for a communication scheme used in a communication network, such as the first network <NUM> or the second network <NUM>, may be selected by, for example, the communication module <NUM> from the plurality of antennas. The signal or power may be transmitted or received between the communication module <NUM> and the external electronic device via the at least one selected antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module <NUM>.

According to one or more embodiments, the antenna module <NUM> may form a mmWave antenna module. According to an embodiment, the mmWave antenna module may include a PCB, an RFIC disposed on a first surface (e.g., the bottom surface) of the PCB or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the PCB, or adj acent to the second surface and capable of transmitting or receiving signals in the designated high-frequency band.

Each of the external electronic devices <NUM> and <NUM> may be a device of the same type as or a different type from the electronic device <NUM>. According to an embodiment, all or some of operations to be executed at the electronic device <NUM> may be executed at one or more external electronic devices (e.g., the external electronic devices <NUM> and <NUM>, or the server <NUM>). For example, if the electronic device <NUM> needs to perform a function or a service automatically, or in response to a request from a user or another device, the electronic device <NUM>, instead of, or in addition to, executing the function or the service, may request one or more external electronic devices to perform at least part of the function or the service. The one or more external electronic devices receiving the request may perform the at least part of the function or the service requested, or an additional function or an additional service related to the request, and may transfer an outcome of the performing to the electronic device <NUM>. The electronic device <NUM> may provide ultra low-latency services using, e.g., distributed computing or MEC. In an embodiment, the external electronic device (e.g., the electronic device <NUM>) may include an Internet-of-Things (IoT) device. The electronic device <NUM> may be applied to intelligent services (e.g., a smart home, a smart city, a smart car, or healthcare) based on <NUM> communication technology or IoT-related technology.

In an embodiment, the electronic device <NUM> may be movable and may perform wireless data communication with the external electronic device <NUM> or <NUM> in order to obtain position information of the external electronic device <NUM> or <NUM> installed (or fixed) adjacent to a predetermined structure. In an embodiment, the electronic device <NUM> may periodically receive data in a designated format related to a designated communication method from the external electronic device <NUM> or <NUM> or periodically verify whether a signal in a designated format is received. For example, the designated communication method may correspond to an ultra-wideband (UWB) communication method.

The electronic device <NUM> according to an embodiment may function as a tag for UWB communication. The electronic device <NUM> may correspond to a device for determining position information of the external electronic device <NUM> or <NUM> based on a signal (e.g., a signal related to UWB communication) of a designated format received from the external electronic device <NUM> or <NUM> connected to the electronic device <NUM>.

According to an embodiment, the external electronic device <NUM> or <NUM> may function as an anchor for UWB communication. The external electronic device <NUM> or <NUM> may correspond to a device for transmitting a signal (e.g., a signal related to UWB communication) designated to the electronic device <NUM> so that the electronic device <NUM> may determine position information of the external electronic device <NUM> or <NUM>. Hereinafter, the external electronic device <NUM> or <NUM> may be referred to as an anchor.

<FIG> is a block diagram <NUM> illustrating a program <NUM>, according to one or more embodiments. According to an embodiment, the program <NUM> may include an OS <NUM> to control one or more resources of the electronic device <NUM>, middleware <NUM>, or an application <NUM> executable in the OS <NUM>. The OS <NUM> may include, for example, Android™, iOS™, Windows™, Symbian™, Tizen™, or Bada™. At least part of the program <NUM>, for example, may be pre-loaded on the electronic device <NUM> during manufacturing or may be downloaded from or updated by an external electronic device (e.g., the electronic device <NUM> or <NUM>, or the server <NUM>) during use by a user.

The OS <NUM> may control the management (e.g., allocation or deallocation) of one or more system resources (e.g., a process, a memory, or a power source) of the electronic device <NUM>. The OS <NUM> may additionally or alternatively include one or more driver programs to drive other hardware devices of the electronic device <NUM>, for example, the input module <NUM>, the sound output module <NUM>, the display module <NUM>, the audio module <NUM>, the sensor module <NUM>, the interface <NUM>, the haptic module <NUM>, the camera module <NUM>, the power management module <NUM>, the battery <NUM>, the communication module <NUM>, the SIM <NUM>, or the antenna module <NUM>.

The middleware <NUM> may provide various functions to the application <NUM> such that a function or information provided from one or more resources of the electronic device <NUM> may be used by the application <NUM>. The middleware <NUM> may include, for example, an application manager <NUM>, a window manager <NUM>, a multimedia manager <NUM>, a resource manager <NUM>, a power manager <NUM>, a database manager <NUM>, a package manager <NUM>, a connectivity manager <NUM>, a notification manager <NUM>, a location manager <NUM>, a graphic manager <NUM>, a security manager <NUM>, a telephony manager <NUM>, or a voice recognition manager <NUM>.

The application manager <NUM> may, for example, manage the life cycle of the application <NUM>. The window manager <NUM>, for example, may manage one or more graphical user interface (GUI) resources that are used on a screen. The multimedia manager <NUM>, for example, may identify one or more formats to be used to play media files, and may encode or decode a corresponding one of the media files using a codec appropriate for a corresponding format selected from the one or more formats. The resource manager <NUM>, for example, may manage the source code of the application <NUM> or a memory space of the memory <NUM>. The power manager <NUM>, for example, may manage the capacity, temperature, or power of the battery <NUM>, and may determine or provide related information to be used for the operation of the electronic device <NUM> based on at least in part on corresponding information of the capacity, temperature, or power of the battery <NUM>. According to an embodiment, the power manager <NUM> may interwork with a basic input/output system (BIOS) of the electronic device <NUM>.

The database manager <NUM>, for example, may generate, search, or change a database to be used by the application <NUM>. The package manager <NUM>, for example, may manage the installation or update of an application that is distributed in the form of a package file. The connectivity manager <NUM>, for example, may manage a wireless connection or a direct connection between the electronic device <NUM> and the external electronic device. The notification manager <NUM>, for example, may provide a function to notify a user of an occurrence of a specified event (e.g., an incoming call, a message, or an alert). The location manager <NUM>, for example, may manage position information on the electronic device <NUM>. The graphic manager <NUM>, for example, may manage one or more graphic effects to be offered to a user or a user interface related to the one or more graphic effects.

The security manager <NUM>, for example, may provide system security or user authentication. The telephony manager <NUM>, for example, may manage a voice call function or a video call function provided by the electronic device <NUM>. The voice recognition manager <NUM>, for example, may transmit the user's voice data to the server <NUM>, and may receive, from the server <NUM>, a command corresponding to a function to be executed on the electronic device <NUM> based on at least in part on the voice data, or text data converted based on at least in part on the voice data. According to an embodiment, the middleware <NUM> may dynamically delete some existing components or add new components. According to an embodiment, at least part of the middleware <NUM> may be included as a part of the OS <NUM> or implemented as another software separate from the OS <NUM>.

The application <NUM> may include, for example, a home <NUM>, dialer <NUM>, short message service (SMS)/multimedia messaging service (MMS) <NUM>, instant message (IM) <NUM>, browser <NUM>, camera <NUM>, alarm <NUM>, contact <NUM>, voice recognition <NUM>, email <NUM>, calendar <NUM>, media player <NUM>, album <NUM>, watch <NUM>, health <NUM> (e.g., for measuring the degree of workout or biometric information, such as blood sugar), environmental information <NUM> (e.g., for measuring air pressure, humidity, or temperature information), or augmented reality applications. According to an embodiment, the application <NUM> may further include an information exchange application that is capable of supporting information exchange between the electronic device <NUM> and the external electronic device. The information exchange application, for example, may include a notification relay application adapted to transfer designated information (e.g., a call, message, or alert) to the external electronic device or a device management application adapted to manage the external electronic device. The notification relay application may transfer notification information corresponding to an occurrence of a specified event (e.g., receipt of an email) at another application (e.g., the email application <NUM>) of the electronic device <NUM> to the external electronic device. Additionally or alternatively, the notification relay application may receive notification information from the external electronic device and provide the notification information to a user of the electronic device <NUM>.

The device management application may control the power (e.g., turn-on or turn-off) or the function (e.g., adjustment of brightness, resolution, or focus) of an external electronic device that communicates with the electronic device <NUM> or a portion of components thereof (e.g., a display module or a camera module of the external electronic device). The device management application may additionally or alternatively support the installation, deletion, or update of an application that operates in an external electronic device.

The electronic devices may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. According to an embodiment of the disclosure, the electronic device is not limited to those described above.

In connection with the description of the drawings, like reference numerals may be used for similar or related components. As used herein, each of such phrases as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B, or C", may include any one of, or all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as "<NUM>st" and "<NUM>nd," or "first" and "second" may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspects (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term "operatively" or "communicatively", as "coupled with," "coupled to," "connected with," or "connected to" another element (e.g., a second element), it means that the element may be coupled with the other element directly (e.g., by wire), wirelessly, or via a third element.

Various embodiments as set forth herein may be implemented as software (e.g., the program <NUM>) including one or more instructions that are stored in a storage medium (e.g., an internal memory <NUM> or an external memory <NUM>) that is readable by a machine (e.g., the electronic device <NUM> of <FIG>). For example, a processor (e.g., the processor <NUM>) of the machine (e.g., the electronic device <NUM>) may invoke at least one of the one or more instructions stored in the storage medium and execute it. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Here, the term "non-transitory" simply means that the storage medium is a tangible device, and does not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

According to an embodiment, a method according to various embodiments disclosed herein may be included and provided in a computer program product. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or be distributed (e.g., downloaded or uploaded) online via an application store (e.g., PlayStore™), or between two user devices (e.g., smartphones) directly.

According to embodiments, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to embodiments, one or more of the above-described components or operations may be omitted, or one or more other components or operations may be added. In such a case, according to embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to embodiments, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.

<FIG> is a block diagram of an electronic device, according to various embodiments.

Referring to <FIG>, an electronic device <NUM> may include a processor <NUM>, a memory <NUM>, a communication interface <NUM>, an antenna module <NUM>, a camera module <NUM>, and a display module <NUM>. The electronic device <NUM> according to an embodiment may correspond to the electronic device <NUM> disclosed in <FIG>, and for clarity of description, a repeated description related thereto may be simplified or omitted.

In an embodiment, the processor <NUM> may control the overall operations of the electronic device <NUM> to perform various embodiments of the disclosure. For example, the processor <NUM> may correspond to the processor <NUM> disclosed in <FIG>. The processor <NUM> may control at least one hardware module included in the electronic device <NUM> to perform at least one operation in a designated order. For example, the processor <NUM> may calculate position information between the antenna module <NUM> and an external electronic device (e.g., the external electronic device <NUM> or <NUM> of <FIG>) (hereinafter, may be referred to as an anchor) and position change information between the antenna module <NUM> and the camera module <NUM>, and estimate position information between the camera module <NUM> and the anchor. A more detailed operation of the processor <NUM> will be further described with reference to the drawings below.

In an embodiment, as shown in <FIG>, the processor <NUM> may be electrically connected to the communication interface <NUM>. For example, the processor <NUM> may be a main processor (e.g., an application processor).

In an embodiment, some operations for performing various embodiments of the disclosure may be performed by another processor included in the communication interface <NUM> instead of the processor <NUM>. For example, the communication interface <NUM> may include an auxiliary processor (e.g., a communication processor), and a sequence number counting operation may be performed by the auxiliary processor included in the communication interface <NUM>.

In an embodiment, the memory <NUM> may correspond to the memory <NUM> disclosed in <FIG>. In an embodiment, the memory <NUM> may store an instruction (or a set of instructions, or an application) for performing various embodiments. For example, the memory <NUM> may store an instruction that allows the processor <NUM> or a processor included in the communication interface <NUM> to count a sequence number corresponding to a superframe included in a designated time period during execution.

In an embodiment, the memory <NUM> may store a plurality of lookup tables displaying phase offset values corresponding to distance information between the antenna module <NUM> and the anchor and distance change information between the antenna module <NUM> and the camera module <NUM>.

In an embodiment, the plurality of lookup tables may include at least one <NUM> dimension lookup table. For example, the memory <NUM> may store at least one three-dimensional (3D) lookup table displaying the phase offset values using a 3D array expressed based on distance information between the antenna module <NUM> and the anchor and distance change information between the antenna module <NUM> and the camera module <NUM>.

In an embodiment, the memory <NUM> may include a function displaying a phase offset value corresponding to the distance information between the antenna module <NUM> and the anchor and the distance change information between the antenna module <NUM> and the camera module <NUM>. For example, the phase offset value may be calculated based on the distance information between the antenna module <NUM> and the anchor and the distance change information between the antenna module <NUM> and the camera module <NUM>.

In an embodiment, the communication interface <NUM> may exchange signals (or data) with the anchor in a designated communication method through the antenna module <NUM> under the control of the processor <NUM>. In an embodiment, the communication interface <NUM> may correspond to the communication module <NUM> or the wireless communication module <NUM> disclosed in <FIG>, and the designated communication method may be a UWB communication method.

In an embodiment, the antenna module <NUM> may correspond to the antenna module <NUM> disclosed in <FIG>.

In an embodiment, the camera module <NUM> may correspond to the camera module <NUM> disclosed in <FIG>.

In an embodiment, the display module <NUM> may be stretched in at least one or more directions. The display module <NUM> may include a flexible substrate and an image display unit. The flexible substrate may be made of a polydimethylsiloxane (PDMS) material having good elasticity and may expand according to a pulling force. The image display unit may be formed on the flexible substrate and may be expanded along with the expansion of the flexible substrate. The image display unit may display an image.

In an embodiment, the electronic device <NUM> may further include the sensor module <NUM>.

In an embodiment, the sensor module <NUM> may detect an intensity and direction of force applied to the display module <NUM>.

In an embodiment, the sensor module <NUM> may include one or more pressure sensors. The one or more pressure sensors may be disposed in the display module <NUM>. When the sensor module <NUM> includes one or more pressure sensors, each pressure sensor may detect a change in capacitance or a change in resistance between both ends of an area to which pressure (force) is applied. The pressure sensor may transfer one or more of a capacitance change signal representing a change in detected capacitance or a resistance change signal representing a change in resistance to the processor <NUM>. The capacitance change signal or the resistance change signal may include information on one or more of an intensity and a direction of force applied to the pressure sensor.

The processor <NUM> may obtain at least one of a direction and an intensity of force applied to the display module <NUM> by using the capacitance change signal or resistance change signal received from the pressure sensor.

In another embodiment, the sensor module <NUM> may include a plurality of acceleration sensors. When the display module <NUM> has a rectangular shape, each acceleration sensor may be disposed adjacent to each vertex of the rectangle. When the display module <NUM> includes a flexible substrate and an image display unit, the plurality of acceleration sensors may be disposed at the bottom of the flexible substrate and the image display unit may be disposed at the top of the flexible substrate, but this is only an example, and the plurality of acceleration sensors may be accommodated in the image display unit.

In an embodiment, the acceleration sensor is a sensor that detects an intensity of acceleration or impact when an object moves. When the acceleration sensor is used, a movement state of the display module <NUM> may be detected in detail. The acceleration sensor may sense the acceleration of the display module <NUM> in directions of three axes (x-axis, y-axis, and z-axis) that are perpendicular to each other. The processor <NUM> may obtain a movement speed using the acceleration in the directions of the three axes measured by the acceleration sensor. The processor <NUM> may obtain an expanded distance of the display module <NUM> in the directions of the three axes by using the obtained movement speed. The processor <NUM> may obtain the direction and intensity of the force applied to the display module <NUM> using the movement speed and moving distance obtained using the acceleration sensor. The processor <NUM> may expand the display module <NUM> according to the direction and intensity of the obtained force. Furthermore, by using the acceleration sensor, a direction the electronic device <NUM> is facing and a degree of inclination of the electronic device <NUM> may be measured.

In another embodiment, the sensor module <NUM> may include a plurality of hall sensors. The plurality of hall sensors may be disposed inside the display module <NUM> or on the display module <NUM>. When the sensor module <NUM> includes a plurality of hall sensors, the processor <NUM> may measure a degree of expansion or contraction of the display module <NUM> through voltage sensed by the hall sensor according to the force applied to the display module <NUM>.

<FIG> are diagrams illustrating a configuration of a rollable display device that is an example of an electronic device (e.g., the electronic device <NUM> of <FIG>), according to one or more embodiments. For clarity of description, a repeated description related to content described above may be simplified or omitted.

<FIG> is a rear perspective view of the rollable display device in a first state (e.g., a closed state) in which a display module or display <NUM> is accommodated in a body portion, and <FIG> is a rear perspective view of the rollable display device in a second state (e.g., an open state). The display module <NUM> according to an embodiment may correspond to the display module <NUM> disclosed in <FIG>.

Referring to <FIG>, a rollable display device <NUM> according to an embodiment includes a first housing <NUM> and a second housing <NUM>. The first housing <NUM> and the second housing <NUM> may be spaced apart from each other based on tension applied in a first direction (x-axis). In an embodiment, one surface of the first housing <NUM> and one surface of the second housing <NUM> may be disposed to contact each other in a closed state.

As shown in <FIG>, in the closed state, the display module <NUM> may be accommodated inside at least one of the first housing <NUM> and the second housing <NUM> and may not be exposed. This is to reduce damage to the display module <NUM> caused by the external environment.

In an embodiment, the rollable display device <NUM> may include an antenna module or antenna <NUM> and a camera module or camera <NUM>. The antenna module <NUM> and the camera module <NUM> may respectively correspond to the antenna module <NUM> and the camera module <NUM> disclosed in <FIG>. The antenna module <NUM> may be disposed in a partial area inside the first housing <NUM>, and the camera module <NUM> may be disposed in a partial area on a rear surface of the second housing <NUM>. However, these components are not limited to this arrangement. The components may be excluded or disposed on other surfaces, as necessary. For example, the camera module <NUM> may be provided on a side of the second housing <NUM> instead of the rear.

Referring to <FIG>, one end of the display module <NUM> may be fixed to the first housing <NUM>, and the other end of the display module <NUM> may be fixed to the second housing <NUM>. A user may hold the first and second housings <NUM> and <NUM> by hand and pull them to expose the display module <NUM> rolled up and accommodated inside the first and second housings <NUM> and <NUM>.

The rollable display device <NUM> according to an embodiment may include a deformation detection means capable of detecting deformation of the display module <NUM>. The deformation detection means may be included in a sensor module (e.g., the sensor module <NUM> of <FIG>).

A sensor module or sensor (e.g., the sensor module <NUM> of <FIG>) according to an embodiment may be provided in the display module <NUM> and may detect information related to deformation of the display module <NUM>. Here, the information related to deformation may be a direction, a degree, a position in which the display module <NUM> is deformed, a time for which the display module <NUM> is deformed, and/or an acceleration at which the deformed display module <NUM> is restored. In addition, the information related to deformation may be various types of information that may be detected due to the bending of the display module <NUM>.

In addition, a processor (e.g., the processor <NUM> of <FIG>) may calculate an unwinding length of the display module <NUM> based on the information related to deformation of the display module <NUM> detected by the deformation detection means.

In an embodiment, as at least one of the first housing <NUM> and the second housing <NUM> moves and a size of the display module <NUM> visually exposed to the outside changes, position information between the antenna module <NUM> disposed in the first housing <NUM> and the camera module <NUM> disposed in the second housing <NUM> may change. The position information between the antenna module <NUM> and the camera module <NUM> may include distance information and phase information between the antenna module <NUM> and the camera module <NUM>. Hereinafter, position information between "A" and "B" may be understood as including distance information and phase information between "A" and "B", and the distance information and phase information may be a distance and direction between the coordinates of "A" and the coordinates of "B" each existing in a 3D space.

<FIG> are diagrams illustrating a configuration of a slideable display device <NUM> that is another example of an electronic device (e.g., the electronic device <NUM> of <FIG>), according to one or more embodiments. For clarity of description, a repeated description related to content described above may be simplified or omitted.

Whereas in a closed state of the slideable display device <NUM> according to an example, a display module or display <NUM> is accommodated in at least one of first and second housings <NUM> and <NUM> and is not exposed, in a closed state of the slideable display device <NUM> according to another example, a predetermined area of the display module <NUM> may be exposed without being accommodated in the first and second housings <NUM> and <NUM>. In this example, a user may verify information related to an event occurring in the electronic device even in the closed state through the predetermined area.

<FIG> is a rear perspective view of the slideable display device <NUM> in a first state (e.g., a closed state) in which the display module <NUM> is accommodated in a body portion, and <FIG> is a rear perspective view of the slideable display device <NUM> in a second state (e.g., an open state). The display module <NUM> according to an embodiment may correspond to the display module <NUM> disclosed in <FIG>.

Referring to <FIG>, the slideable display device <NUM> according to an embodiment includes the first housing <NUM> and the second housing <NUM>. The first housing <NUM> and the second housing <NUM> may be spaced apart from each other based on tension applied in a first direction (x-axis). In an embodiment, an area corresponding to a first width W1 may be a fixed area where the display module <NUM> is always visually exposed.

In an embodiment, the slideable display device <NUM> may include an antenna module or antenna <NUM> and a camera module or camera <NUM>. The antenna module <NUM> and the camera module <NUM> may respectively correspond to the antenna module <NUM> and the camera module <NUM> disclosed in <FIG>. The antenna module <NUM> may be disposed in a partial area inside the first housing <NUM>, and the camera module <NUM> may be disposed in a partial area on a rear surface of the second housing <NUM>. However, these components are not limited to this arrangement. The components may be excluded or disposed on other surfaces, as necessary. For example, the camera module <NUM> may be provided on a side of the second housing <NUM> instead of the rear.

Referring to <FIG>, the first housing <NUM> may be fixed, and the second housing <NUM> may be movable relative to the first housing <NUM> in a sliding manner. For example, the second housing <NUM> may be formed to be slideable in the first direction (x-axis) of the first housing <NUM>. In an embodiment, the second housing <NUM> may move in one direction of the first housing <NUM> by a second width W2. In an embodiment, an area corresponding to the second width W2 may be a variable area in which a size of the variable area is adjusted according to a movement of the second housing <NUM>. As shown in <FIG>, when the second housing <NUM> moves in a +x-axis direction, the variable area may be expanded, and when the second housing <NUM> moves in a -x-axis direction, the variable area may be contracted.

In an embodiment, the display module <NUM> may be flexible and a width of a visually exposed area may be adjusted based on the movement of the second housing <NUM>. For example, when the second housing <NUM> is in an initial state overlapping the first housing <NUM>, at least a portion of the display module <NUM> may be visually exposed to have the first width W1. As another example, when the second housing <NUM> moves in a sliding manner and is in an expanded state spaced apart from the first housing <NUM>, another portion of the display module <NUM> may be further extended by a maximum of the second width W2 and exposed to be visually further expanded.

The slideable display device <NUM> according to an embodiment may include a deformation detection means capable of detecting deformation of the display module <NUM>. The deformation detection means may be included in a sensor module (e.g., the sensor module <NUM> of <FIG>).

The sensor module according to an embodiment may be provided in the display module <NUM> and may detect information related to deformation of the display module <NUM>. Here, the information related to deformation may be a direction, a degree, a position in which the display module <NUM> is deformed, a time for which the display module <NUM> is deformed, and/or an acceleration at which the deformed display module <NUM> is restored. In addition, the information related to deformation may be various types of information that may be detected due to the bending of the display module <NUM>.

In addition, a processor (e.g., the processor <NUM> of <FIG>) may calculate an unwinding length of a screen of the display module <NUM> based on the information related to deformation of the display module <NUM> detected by the deformation detection means.

In an embodiment, as at least one of the first housing <NUM> and the second housing <NUM> moves and a size of the screen of the display module <NUM> visually exposed to the outside changes, position information between the antenna module <NUM> disposed in the first housing <NUM> and the camera module <NUM> disposed in the second housing <NUM> may change.

<FIG> are conceptual views of screens for augmented reality services, according to one or more embodiments. For clarity of description, a repeated description related to content described above may be simplified or omitted.

In an embodiment, in order to provide an augmented reality (AR) service, an electronic device (e.g., the electronic device <NUM> of <FIG>) may transmit a captured image and/or position-related information to a server using a communication interface (e.g., the communication interface <NUM> of <FIG>). The position-related information may include at least one of real-time position information of an electronic device (e.g., the electronic device <NUM> of <FIG>), direction information of the electronic device (e.g., the electronic device <NUM> of <FIG>), or tilt information of the electronic device. The real-time position information of an electronic device (e.g., the electronic device <NUM> of <FIG>) may be obtained through a global positioning system (GPS) sensor, and the direction information and tilt information of the electronic device (e.g., the electronic device <NUM> of <FIG>) may be obtained through an inertial measurement unit (IMU).

In an embodiment, a server may read and transmit various types of additional information to an electronic device (e.g., the electronic device <NUM> of <FIG>) using a stored AR service database, and the electronic device (e.g., the electronic device <NUM> of <FIG>) may render an image and the additional information together to display a screen for an AR service. Alternatively, the server may render an input image and additional information together and transmit the same to the electronic device (e.g., the electronic device <NUM> of <FIG>), and the electronic device (e.g., the electronic device <NUM> of FIG. ) may display a screen for the rendered AR service that is transmitted.

In another embodiment, the electronic device (e.g., the electronic device <NUM> of <FIG>) may transmit a captured image and/or position-related information to an anchor rather than a server, and receive an image and additional information input from the anchor. In addition, the electronic device (e.g., the electronic device <NUM> of <FIG>) may render the image and additional information together to display a screen for an AR service.

Referring to <FIG>, a screen <NUM>-<NUM> for an AR service in a first state (e.g., a closed state) may be an image in a form in which various types of additional information <NUM>, <NUM> and <NUM> are displayed together with an image input from a camera module (e.g., the camera module <NUM> of <FIG>) of an electronic device (e.g., the electronic device <NUM> of <FIG>)(e.g., the electronic device <NUM> of <FIG>)(e.g., the electronic device <NUM> of <FIG>). The various types of additional information may be direction information <NUM> for a destination and additional information <NUM> and <NUM> for buildings nearby.

In the first state (e.g., the closed state) of the screen <NUM>-<NUM> for the AR service, it may be displayed that there is a road in the center, and the additional information <NUM> indicating that the destination is on the right side may be displayed together. On the other hand, on the left side of the screen <NUM>-<NUM> for the AR service in the first state (e.g., the closed state), a nearby building called "Pizza" is captured and displayed, and the additional information <NUM> on the nearby building is displayed together. In addition, on the left side of the screen <NUM>-<NUM> for the AR service in the first state (e.g., the closed state), a nearby building called "Pharmacy" is captured and displayed, and the additional information <NUM> on the nearby building is displayed together. The additional information <NUM> and <NUM> on the nearby buildings may include, for example, name information, contact information, or evaluation information of the nearby buildings.

In an expandable display module (e.g., the display module <NUM> of <FIG>) according to an embodiment, since position information of the anchor from a viewpoint of the camera module (e.g., the camera module <NUM> of <FIG>) changes in real time as a size of the display screen changes, additional position-related information may be required to provide AR content.

More specifically, in a second state (e.g., an open state), position information of the anchor from a viewpoint of the camera module (e.g., the camera module <NUM> of <FIG>) may change in real time as a size of the display screen changes. In order to render AR content at an accurate position, it is necessary to estimate the position information of the anchor in real time from the viewpoint of the camera module (e.g., the camera module <NUM> of <FIG>). A detailed method of determining position information of an anchor from a viewpoint of a camera module (e.g., the camera module <NUM> of <FIG>) will be described below with reference to <FIG>.

Referring to <FIG>, a screen <NUM>-<NUM> for an AR service in the second state (e.g., the open state) may further include additional information <NUM> and <NUM> newly displayed as the screen is expanded as well as the additional information <NUM>, <NUM>, and <NUM> displayed in the first state (e.g., the closed state).

The screen <NUM>-<NUM> for the AR service in the second state (e.g., the open state) may also display the additional information <NUM> indicating a position of a destination. On the other hand, on the right side of the screen <NUM>-<NUM> for the AR service in the second state (e.g., the open state), a nearby building called "cosmetic" is captured and displayed, and the additional information <NUM> on the nearby building is displayed together. Similarly, the additional information <NUM> on the nearby building may include, for example, name information, contact information, or evaluation information of the nearby buildings.

<FIG> is a diagram illustrating a method of estimating position information of an anchor from a viewpoint of a camera module, according to one or more embodiments. An electronic device <NUM> according to an embodiment may correspond to the electronic device <NUM> of <FIG>, a camera module <NUM> may correspond to the camera module <NUM> of <FIG>, and an antenna module <NUM> may correspond to the antenna module <NUM> of <FIG>. For clarity of description, a repeated description related to content described above may be simplified or omitted.

In order to display AR content on a screen, it is necessary to estimate position information of an anchor <NUM> (e.g., the external electronic device <NUM> or <NUM> of <FIG>) from a viewpoint of the camera module <NUM>.

In an electronic device in which a size of a display screen does not change, the position information of the anchor from a viewpoint of an antenna may be obtained through communication between an antenna of the electronic device and an antenna of the anchor, and the obtained position information may be used as it is, as the position information of the anchor from the viewpoint of the camera module (e.g., when the camera module and the antenna module are positioned within a predetermined range), or may be corrected to a fixed value and used.

However, in the electronic device <NUM> according to an embodiment, since a position between the antenna module <NUM> and the camera module <NUM> changes as a size of the display screen changes, coordinate values of a position and posture of the anchor <NUM> from a viewpoint of the camera module <NUM> may change. Therefore, when position information <NUM> of the anchor obtained through communication with the anchor <NUM> is used as it is or corrected to a fixed value and rendered, the AR content may be displayed at an incorrect position. To prevent this, the electronic device <NUM> according to an embodiment may estimate position information <NUM> and <NUM> of the anchor <NUM> from a viewpoint of the camera module <NUM> in real time.

In an embodiment, the position information <NUM> and <NUM> of the anchor <NUM> from a viewpoint of the camera module <NUM> may be determined using the position information <NUM> of the anchor <NUM> from a viewpoint of the antenna module <NUM>. The antenna module <NUM> of the electronic device <NUM> may collect position information data through communication (e.g., UWB communication) in a designated format with an antenna module <NUM> mounted on the anchor <NUM>. A processor (e.g., the processor <NUM> of <FIG>) of the electronic device <NUM> may calculate distance information and phase information between the antenna module <NUM> and the anchor <NUM> based on the collected position information data.

For example, the processor (e.g., the processor <NUM> of <FIG>) of the electronic device <NUM> may calculate a distance between the antenna module <NUM> and the anchor <NUM> by calculating a time of flight (ToF) between the antenna module <NUM> and the anchor <NUM>, based on the position information data obtained through UWB communication with the antenna module <NUM> mounted on the anchor <NUM>. In addition, the antenna module <NUM> of the electronic device <NUM> may include a UWB antenna module, and the processor (e.g., the processor <NUM> of <FIG>) may calculate an angle of arrival (AoA) between the antenna module <NUM> and the anchor <NUM>, based on a phase difference between signals received from a plurality of patch antenna modules included in the UWB antenna module <NUM> to the antenna module <NUM> mounted on the anchor <NUM>.

In an embodiment, the electronic device <NUM> may estimate the position information <NUM> and <NUM> between the camera module <NUM> and the anchor <NUM> using the position information <NUM> of the anchor <NUM> from a viewpoint of the antenna module <NUM>. For example, in the first state (e.g., the closed state), the electronic device <NUM> may estimate the position information <NUM> between the camera module <NUM> and the anchor <NUM> using the position information <NUM> of the anchor <NUM> from a viewpoint of the antenna module <NUM>. In addition, in the second state (e.g., the open state), the electronic device <NUM> may estimate the position information <NUM> between the camera module <NUM> and the anchor <NUM> using the position information <NUM> of the anchor <NUM> from a viewpoint of the antenna module <NUM>. A detailed method of estimating the position information <NUM> between the camera module <NUM> and the anchor <NUM> using the position information <NUM> of the anchor <NUM> from a viewpoint of the antenna module <NUM> will be described below with reference to <FIG>. In addition, the position information of the anchor <NUM> from a viewpoint of the antenna module <NUM> may be referred to as first position information between the antenna module <NUM> and the anchor <NUM>, and the position information of the anchor <NUM> from a viewpoint of the camera module <NUM> may be referred to as second position information between the camera module <NUM> and the anchor <NUM>.

<FIG> are flowcharts illustrating a method of estimating second position information, according to one or more embodiments.

Referring to <FIG>, operations <NUM> to <NUM> according to an embodiment may be performed by the electronic device (e.g., the electronic device <NUM> of <FIG>) described above with reference to <FIG>. Operations of <FIG> may be performed in the shown order and manner. However, the order of some operations may change, or some of the operations may be omitted, without departing from the spirit and scope of the shown example. The operations shown in <FIG> may be performed in parallel or simultaneously.

In operation <NUM>, an electronic device (e.g., the electronic device <NUM> of <FIG>) may calculate first position information (e.g., the position information <NUM> of the anchor from a viewpoint of the antenna module of <FIG>) between an antenna module and an anchor.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) may calculate position change information between the antenna module and a camera. A detailed method of calculating the position change information between the antenna module and the camera will be described below with reference to <FIG>.

Referring to <FIG>, operations <NUM> and <NUM> according to an embodiment may be performed by the electronic device (e.g., the electronic device <NUM> of <FIG>) described above with reference to <FIG>. Operations of <FIG> may be performed in the shown order and manner. However, the order of some operations may change, or some of the operations may be omitted, without departing from the scope of the shown example. The operations shown in <FIG> may be performed in parallel or simultaneously.

In operation <NUM>, a memory (e.g., the memory <NUM> of <FIG>) of an electronic device <NUM> may store initial position information <NUM>-<NUM> and/or <NUM>-<NUM> between an antenna module <NUM> and a camera module in a state in which a second housing (e.g., the second housing <NUM> of <FIG>) does not move.

In operation <NUM>, a processor (e.g., the processor <NUM> of <FIG>) of the electronic device <NUM> may calculate position change information <NUM>-<NUM> and <NUM>-<NUM> based on the initial position information <NUM>-<NUM> and/or <NUM>-<NUM> and a size of a screen of a display module (e.g., the display module <NUM> of <FIG>) that is visually exposed to the outside.

Referring to <FIG>, the camera module may include a plurality of cameras <NUM> and <NUM>. The first camera <NUM> may be positioned along the same line as the antenna module <NUM> in a first direction (x-axis), and the second camera <NUM> may be positioned along the same line as the first camera <NUM> in a second direction (y-axis).

In an embodiment, the display module (e.g., the display module <NUM> of <FIG>) may include a sensor module, and the sensor module may detect information related to deformation of the display module (e.g., the display module <NUM> of <FIG>). Here, the information related to deformation may be a direction, a degree, a position in which the display module (e.g., the display module <NUM> of <FIG>) is deformed, a time for which the display module <NUM> is deformed, an acceleration at which the deformed display module <NUM> is restored, and the like. In addition, the information related to deformation may be various types of information that may be detected due to the bending of the display module <NUM>.

In an embodiment, the processor (e.g., the processor <NUM> of <FIG>) of the electronic device <NUM> may calculate the position change information <NUM>-<NUM> between the antenna module <NUM> and the first camera <NUM> based on the initial position information <NUM>-<NUM> and a size of the screen visually exposed to the outside. More specifically, distance information between the antenna module <NUM> and the first camera <NUM> may be calculated by combining the initial position information <NUM>-<NUM> stored in the memory and the position change information of the first camera <NUM>. Since the antenna module <NUM> and the first camera <NUM> are positioned along the same line in the first direction (x-axis), phase information between the antenna module <NUM> and the first camera <NUM> in the first direction (x-axis) may not change and only the distance information may change. For example, the position change information <NUM>-<NUM> between the antenna module <NUM> and the first camera <NUM> may include the distance information between the antenna module <NUM> and the first camera <NUM>.

In an embodiment, the processor (e.g., the processor <NUM> of <FIG>) of the electronic device <NUM> may calculate the position change information <NUM>-<NUM> between the antenna module <NUM> and the second camera <NUM> based on the initial position information <NUM>-<NUM> and a size of the screen visually exposed to the outside. More specifically, the distance information between the antenna module <NUM> and the second camera <NUM> may be calculated by combining the initial position information <NUM>-<NUM> stored in the memory and the position change information of the second camera <NUM>. Based on the first direction (x-axis), the phase information as well as the distance information between the antenna module <NUM> and the second camera <NUM> may change.

Referring back to <FIG>, in operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) may estimate second position information between the camera module and the anchor based on the first position information and the position change information. A detailed method of estimating the second position information will be described below with reference to <FIG> and <FIG>.

<FIG> is a diagram illustrating a method of estimating second position information through phase offset value compensation, according to one or more embodiments.

Referring to <FIG>, operations <NUM> to <NUM> according to an embodiment may be performed by an electronic device (e.g., the electronic device <NUM> of <FIG>) described above with reference to <FIG>. Operations of <FIG> may be performed in the shown order and manner. However, the order of some operations may change, or some of the operations may be omitted, without departing from the scope of the shown example. The operations shown in <FIG> may be performed in parallel or simultaneously.

In operation <NUM>, an electronic device (e.g., the electronic device <NUM> of <FIG>) may execute an AR application (e.g., the application <NUM> of <FIG>).

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) may detect a change in a screen size of a display module.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) may determine a phase offset value using a lookup table. A memory (e.g., the memory <NUM> of <FIG>) according to an embodiment may store a plurality of lookup tables displaying phase offset values corresponding to distance information between an antenna module (e.g., the antenna module <NUM> of <FIG>) and an anchor and distance change information between the antenna module (e.g., the antenna module <NUM> of <FIG>) and a camera module (e.g., the camera module <NUM> of <FIG>).

In an embodiment, the lookup tables may be provided according to first position information (e.g., position information of an anchor from a viewpoint of an antenna module), and each lookup table may indicate phase offset values corresponding to distance change information. For example, Table <NUM> below shows an example of a lookup table when a distance between the antenna module and the anchor is <NUM> and an AoA is θ.

In an embodiment, a processor (e.g., the processor <NUM> of <FIG>) may determine a target lookup table corresponding to the first position information from among the plurality of lookup tables, and determine a phase offset value from the target lookup table based on the position change information. For example, when the distance between the antenna module and the anchor is <NUM> the AoA is θ, and the distance change information is <NUM>, the processor (e.g., the processor <NUM> of <FIG>) may determine the lookup table of Table <NUM> to be the target lookup table, and determine the phase offset value to be <NUM>°.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) may correct phase information between the camera module and the anchor according to a change in a screen size. In the above-described example, the processor (e.g., the processor <NUM> of <FIG>) may estimate the phase information between the camera module and the anchor by compensating the phase offset value by <NUM>° for the phase information between the antenna module and the anchor.

<FIG> is a diagram illustrating a method of estimating second position information through vector calculation, according to one or more embodiments.

Referring to <FIG>, an electronic device <NUM> according to an embodiment may estimate position information <NUM> between a camera module <NUM> and an anchor based on position information <NUM> between an antenna module <NUM> and an anchor <NUM> and distance information <NUM>-<NUM> between the antenna module <NUM> and a camera module <NUM>.

In an embodiment, position information between A and B may be expressed in a vector form (d∠θ<NUM>) using distance information (d) and phase information (θ) between A and B. For example, the position information <NUM> Vua between the antenna module <NUM> and the anchor <NUM> may be expressed as d∠θ<NUM>, and position information Vuc between the antenna module <NUM> and the camera module <NUM> may be expressed as x∠<NUM> = x. In this example, the position information <NUM> between the camera module <NUM> and the anchor may be expressed as Vca = Vua - Vuc = y∠θ<NUM>.

The electronic device <NUM> according to an embodiment may calculate the position information <NUM> Vua = d∠θ<NUM> between the antenna module <NUM> and the anchor <NUM> using the method described with reference to <FIG>.

The electronic device <NUM> according to an embodiment may calculate the position information Vuc = x∠<NUM> = x between the antenna module <NUM> and the camera module <NUM> using the method described with reference to <FIG>. In <FIG>, for ease of description, the phase information between the antenna module <NUM> and the camera module <NUM> is described based on <NUM>°, but the phase information between the antenna module <NUM> and the camera module <NUM> is not limited to the example described above and may have an arbitrary value.

The electronic device <NUM> according to an embodiment may calculate both <MAT> and Vuc, so the position information <NUM> Vca between the camera module <NUM> and the anchor may be calculated by the calculation of Vua - Vuc, and distance information (y) and phase information (θ<NUM>) between the camera module <NUM> and the anchor may be obtained from the calculation result y∠θ<NUM>.

<FIG> is a flowchart illustrating a method of providing AR content, according to one or more embodiments.

In operation <NUM>, an electronic device (e.g., the electronic device <NUM> of <FIG>) detects a change in a screen size of a display module including an expandable or retractable screen.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) calculates first position information between an antenna module and an anchor.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) calculates position change information between the antenna module and a camera module in response to the change in the screen size.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) estimates second position information between the camera and the anchor based on the first position information and position change information.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) obtains direction information and tilt information of the electronic device.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) receives additional information determined based on the second position information, the direction information, and the tilt information of the electronic device.

In operation <NUM>, the electronic device (e.g., the electronic device <NUM> of <FIG>) renders AR content based on the additional information.

Claim 1:
An electronic device (<NUM>, <NUM>, <NUM>, <NUM>) for providing augmented reality content, the electronic device comprising:
a first housing (<NUM>, <NUM>);
a second housing (<NUM>, <NUM>), wherein at least one of the first housing and the second housing is configured to be movable relative to the other one of the first housing and the second housing;
a display (<NUM>, <NUM>) comprising a screen which is expandable or retractable, wherein a size of a part of the screen visually exposed to an outside changes as at least one of the first housing and the second housing is moved;
an antenna (<NUM>, <NUM>) disposed in a partial area of the first housing;
a camera (<NUM>, <NUM>) disposed in a partial area of the second housing;
a memory (<NUM>) storing instructions; and
at least one processor (<NUM>),
wherein the instructions are executable by the at least one processor to cause the electronic device to:
obtain information on a first position between the antenna and an anchor, wherein the anchor comprises an external electronic device (<NUM>, <NUM>) configured to perform communication with the electronic device;
obtain information on a position change between the antenna and the camera; and
estimate information on a second position between the camera and the anchor based on the information on the first position and the information on the position change.