Patent Description:
With the recent development of digital technologies, various types of electronic devices such as mobile communication terminals, smart phones, tablet personal computers (PCs), personal digital assistants (PDAs), notebooks, or wearable devices are being utilized. These electronic devices are reaching a stage of mobile convergence that encompasses the functions of other devices. In particular, the electronic device such as the smart phone can provide a call function, a function of sending and receiving messages such as a short message service (SMS), a multimedia message service (MMS), and an electronic mail, a photographing function, a broadcasting function, a video play function, a music play function, an Internet function, a messenger function, a game function, etc..

As the electronic device supports various functions, the amount of time a user faces the electronic device is gradually increasing. For example, to use numerous functions, the users can use the electronic device even while riding a vehicle or walking regardless of time and place.

As the amount of time the user faces the electronic device is increased, and in particular, the amount of time spent using the electronic device during movement is increased, and in order to reduce a user's eye fatigue caused by this, a technology for controlling a frame per seconds (FPS) of a display of the electronic device or delaying a screen output for a predetermined time is being applied.

<CIT> discloses an information processing method, an information processing apparatus and a user equipment. The method comprises: acquiring eye movement information related to that at least one eye of a user gazes a user equipment; and determining relative movement information of the user equipment relative to the head of the user at least according to a non-saccade eye movement part in the eye movement information. Relative movement between a user equipment and the head of a user can be determined according to a non-saccade eye movement part(s) of eye movement information related to the user gazes the user equipment, providing a basis for increasing the accuracy of compensation corresponding to the relative movement.

<CIT> discloses an apparatus for controlling the position of a display of a wearable device including a display module on which the display is movably mounted; and a motion compensation unit for controlling the position of the display according to the user's movement, so that a smooth image compensation effect can be obtained, the user can accurately check the content displayed on the display, and the user's gaze on the display is focused. It can be fixed in one place and can expand the usage environment of wearable devices by reducing the fatigue felt by users.

As the user's use of an electronic device is prolonged, user's eye fatigue can increase, and due to this, a user may suffer adverse effects such as reduced eyesight, dry eyes, congestion, and the like. Also, the eye fatigue is not limited to just the eyes, but can be related to brain activity and cause the decrease of concentration, the decrease of memory, and mental abnormalities.

For example, when the user uses the electronic device while riding in a vehicle or while walking, the user's body is shaken by an external force and due to this, a user's focus is shaken, which can cause dizziness in a short term, and can accumulate a fatigue level in the ciliary muscle in a mid to long term, thereby deteriorating the function of the eye and shorten the time of occurrence of presbyopia.

Various embodiments disclosed in the present document can provide a method and an electronic device for acquiring feature values related to the electronic device and an external electronic device, through communication with the external electronic device, and controlling a display, based on the acquired feature values.

The invention is set out in the independent claims <NUM> and <NUM>.

According to an aspect a control method of an electronic device according to an exemplary embodiment includes the operations of connecting with an external electronic device worn by a user by using wireless communication, determining whether the user is gazing at the electronic device by using at least one first sensor, acquiring a shaking pattern of the electronic device by using at least one second sensor in response to the user being gazing at the electronic device, acquiring a first feature value and a second feature value which are related to a change of position between the electronic device and the external electronic device, by using at least one third sensor when the acquired shaking pattern corresponds to a predetermined condition, acquiring an eye fatigue level of the user, based on the first feature value and the second feature value, and controlling a display of the electronic device, based on the acquired fatigue level.

According to another aspect an electronic device of according to an exemplary embodiment includes a display, a wireless communication circuit, and at least one processor electrically connected to the wireless communication circuit. The at least one processor may operatively connect with an external electronic device worn by a user by using the wireless communication circuit, determine whether the user is gazing at the display of the electronic device by using at least one first sensor, acquire a shaking pattern of the electronic device by using at least one second sensor in response to the user being gazing at the electronic device, acquire a first feature value and a second feature value which are related to a change of position between the electronic device and the external electronic device by using at least one third sensor when the acquired shaking pattern corresponds to a predetermined condition, acquire an eye fatigue level of the user, based on the first feature value and the second feature value, and control the display, based on the acquired fatigue level.

Various embodiments disclosed in the present document may identify a user's eye fatigue level, based on a difference of each axis movement distance change amount and a distance between an electronic device and an external electronic device, and change a display position of a User interface, UI, displayed on a display, based on the identified user's eye fatigue level.

Also, various embodiments may provide a UI for recommending a user to stop using an electronic device, based on a user's eye fatigue level.

Also, various embodiments may provide a UI capable of identifying a cumulative fatigue level, based on a difference of each axis movement distance change amount and a distance between an electronic device and an external electronic device, and receiving a user input at a specified time, based on the identified cumulative fatigue level.

Also, various embodiments may control at least some of a brightness of a display, a scanning rate, and a color, based on a user's eye fatigue level.

In addition to this, various effects identified directly or indirectly through the present document may be provided.

In connection with a description of the drawings, the same or similar reference numerals may be used for the same or similar elements.

Hereinafter, various embodiments disclosed in the present document will be described with reference to the accompanying drawings. However, this is not intended to limit the various embodiments of the present disclosure to a specific embodiment, but extends also to other embodiments falling within the scope of the appended claims.

<FIG> illustrates an electronic device and an external electronic device connected to the electronic device through wireless communication according to an exemplary embodiment.

Referring to <FIG>, according to an exemplary embodiment, a user may use an electronic device <NUM> and an external electronic device <NUM> connected to the electronic device <NUM> through wireless communication together. According to an exemplary embodiment, the user may use the electronic device <NUM> and the external electronic device <NUM> together while walking. According to another exemplary embodiment (not shown), the user may use the electronic device <NUM> and the external electronic device <NUM> together while riding a vehicle.

According to an exemplary embodiment, the electronic device <NUM> may be referred to as various types of devices including a display (e.g., a display <NUM> of <FIG>). The electronic device <NUM> may be referred to as, for example, a portable communication device (e.g., a smart phone), a portable multimedia device (e.g., a tablet PC), or a portable medical device, but is not limited thereto.

According to another exemplary embodiment, the electronic device <NUM> may be referred to as a wearable device worn on a user's body. For example, the electronic device <NUM> may be referred to as a smart watch worn on a user's wrist or a smart ring worn on a user's finger.

According to an exemplary embodiment, the external electronic device <NUM> may be referred to as a wearable device worn on a user's body. For example, the external electronic device <NUM> may be referred to as earbuds worn on user's ears. For another example, the external electronic device <NUM> may be referred to as a head mounted display (HMD) device worn on a user's head. However, the above-described description of the external electronic device <NUM> is merely exemplary, and the external electronic device <NUM> may be referred to as various types of wearable devices.

According to an exemplary embodiment, the electronic device <NUM> may be connected to the external electronic device <NUM> worn on the user's body through wireless communication. The electronic device <NUM> may be operatively connected to the external electronic device <NUM> worn on the user's body through the wireless communication.

According to an exemplary embodiment, the electronic device <NUM> may be connected to the external electronic device <NUM> through short-range communication. For example, the electronic device <NUM> may be connected to the external electronic device <NUM> through Bluetooth communication. For another example, the electronic device <NUM> may be connected to the external electronic device <NUM> through ultra-wide band (UWB) communication. However, a communication method in which the electronic device <NUM> is connected to the external electronic device <NUM> is not limited to the above example.

<FIG> is a flowchart illustrating an operation of acquiring a user's eye fatigue level, and controlling a display, based on the acquired fatigue level, by an electronic device according to an exemplary embodiment.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may acquire a first feature value and a second feature value which are related to a positional change between the electronic device <NUM> and an external electronic device <NUM>, and control a display, based on a user's eye fatigue level acquired based on the acquired first feature value and second feature value.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may connect with the external electronic device <NUM> by using wireless communication (e.g., Bluetooth communication or UWB communication). According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may connect with the external electronic device <NUM> worn by a user by using the wireless communication. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may connect to the external electronic device <NUM> worn on at least part (e.g., the ear) of the user's body by using the wireless communication.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether a user gazes at the electronic device <NUM> by using at least one first sensor. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the user gazes at a display of the electronic device <NUM> by using the at least one first sensor.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the display is in an activated state.

According to an exemplary embodiment, the at least one first sensor may include a grip sensor and a motion sensor. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the user is holding the electronic device <NUM> by using the grip sensor. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the display of the electronic device <NUM> faces a user's face by using the motion sensor. For example, in operation <NUM>, the electronic device <NUM> may determine whether the display of the electronic device <NUM> faces the user's face, by detecting a posture of the electronic device <NUM> by using the motion sensor.

According to an exemplary embodiment, in operation <NUM>, in response to the user being holding the electronic device <NUM>, and the display of the electronic device <NUM> facing the user's face, the electronic device <NUM> may detect a distance between the electronic device <NUM> and the external electronic device <NUM> by using a UWB antenna.

According to an exemplary embodiment, in operation <NUM>, in response to the user being holding the electronic device <NUM>, and the display of the electronic device <NUM> facing the user's face, the electronic device <NUM> may detect a user's eye area by using a camera. For example, the electronic device <NUM> may detect an area around left and/or right eye including pupils in the user's face as the eye area using the camera.

According to an exemplary embodiment, when the distance between the electronic device <NUM> and the external electronic device <NUM> is within a specified distance, and the user's eye area is detected, in operation <NUM>, the electronic device <NUM> may determine that the user gazes at the electronic device <NUM>.

According to an exemplary embodiment, in response to the user being gazing at the electronic device <NUM>, in operation <NUM>, the electronic device <NUM> may acquire a shaking pattern of the electronic device <NUM> by using at least one second sensor. According to an exemplary embodiment, the at least one second sensor may include an acceleration sensor or a gyro sensor. For example, in operation <NUM>, the electronic device <NUM> may acquire the shaking pattern by using the acceleration sensor or the gyro sensor.

According to an exemplary embodiment, the shaking pattern may refer to a movement distance change amount for at least one axis facing a preset direction within a space where the electronic device <NUM> exists. A detailed description of this will be made later.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the shaking pattern acquired using the at least one second sensor corresponds to a predetermined condition. For example, in operation <NUM>, the electronic device <NUM> may determine whether the shaking pattern acquired using the at least one second sensor corresponds to a shaking pattern of a situation where the user gets in a vehicle. For another example, in operation <NUM>, the electronic device <NUM> may determine whether the shaking pattern acquired using the at least one second sensor corresponds to a shaking pattern of a situation where the user is walking.

According to an exemplary embodiment, the shaking pattern may be referred to as a frequency component acquired using fast Fourier transform (FFT). According to another exemplary embodiment, the shaking pattern may be referred to as a pattern extracted from a single vector magnitude (SVM) signal.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a first feature value and a second feature value by using at least one third sensor. According to an exemplary embodiment, in response to the shaking pattern of the electronic device <NUM> acquired through operation <NUM> corresponding to the predetermined condition, in operation <NUM>, the electronic device <NUM> may acquire the first feature value and the second feature value by using the at least one third sensor.

According to an exemplary embodiment, the at least one third sensor may include a first inertial sensor. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a movement distance change amount for at least one axis (e.g., z-axis) indicating a preset direction (e.g., a direction perpendicular to the ground) in a space where the electronic device <NUM> is located, by using the first inertial sensor.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may receive, from the external electronic device <NUM>, a movement distance change amount of the external electronic device <NUM> for at least one axis indicating a preset direction, which is acquired through a second inertial sensor of the external electronic device <NUM>.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire the first feature value, based on the movement distance change amount of the electronic device <NUM> and the movement distance change amount of the external electronic device <NUM>. A detailed description of this will be made later.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire the second feature value by using the at least one third sensor. The at least one third sensor of an exemplary embodiment may include a UWB antenna. In operation <NUM>, the electronic device <NUM> may acquire a distance between the electronic device <NUM> and the external electronic device <NUM> as the second feature value, by using the UWB antenna.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire an eye fatigue level (F) of a user, based on the first feature value and the second feature value acquired through operation <NUM>. An operation in which the electronic device <NUM> of an exemplary embodiment acquires the eye fatigue level of the user, based on the first feature value and the second feature value in operation <NUM> may be referred to as equation below.

According to an exemplary embodiment, the eye fatigue level of the user may increase as the first feature value (M) is larger and the second feature value (D) is smaller. According to an exemplary embodiment, the eye fatigue level of the user may increase as a time (T) for which the user gazes at the display of the electronic device <NUM> increases.

The first feature value (M) of an exemplary embodiment may be referred to as a difference of a shaking degree between the electronic device <NUM> and the external electronic device <NUM>. According to an exemplary embodiment, the second feature value (D) may be referred to as the distance between the electronic device <NUM> and the external electronic device <NUM>. A detailed description of this will be made later.

According to an exemplary embodiment, the user's eye fatigue level (F) may be stored in a memory in the form of a look-up table including a value outputted by Equation <NUM>.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may control the display of the electronic device <NUM>, based on the fatigue level (F) acquired through operation <NUM>. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may control the display of the electronic device <NUM> in order to reduce the fatigue level (F), based on the fatigue level (F) acquired through operation <NUM>. For example, in operation <NUM>, the electronic device <NUM> may control the display of the electronic device <NUM> for a specified time so as to reduce the fatigue level (F). For another example, in operation <NUM>, the electronic device <NUM> may control the display of the electronic device <NUM> in real time so as to reduce the fatigue level (F). A detailed description of this will be made later.

<FIG> is a flowchart illustrating an operation of acquiring a first feature value and a second feature value by an electronic device according to an exemplary embodiment.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may acquire a first feature value, and acquire a second feature value, based on the first feature value.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may align an axis with the external electronic device <NUM>, and synchronize time information.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire data on at least one axis within a space where the external electronic device <NUM> is located from the external electronic device <NUM>. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may correct at least one axis within a space where the electronic device <NUM> is located, based on the data acquired from the external electronic device <NUM>. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may align the axis of the electronic device <NUM> with the axis of the external electronic device <NUM>, based on the axis data acquired from the external electronic device <NUM>. For example, the electronic device <NUM> may equally align the axes between the electronic device <NUM> and the external electronic device <NUM> through operation <NUM>. For example, the electronic device <NUM> may equally align the axes between the electronic device <NUM> and the external electronic devices <NUM>, by rotating and correcting each axis of an inertial sensor through a rotation matrix with a criterion of a position where the electronic device <NUM> is worn on the user's body.

According to another exemplary embodiment, in operation <NUM>, the electronic device <NUM> may correct at least one axis of the external electronic device <NUM>, based on data on at least one axis within a space where the electronic device <NUM> is located.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may receive, from the external electronic device <NUM>, time information related to a movement distance change amount for the at least one axis of the external electronic device <NUM>.

According to an exemplary embodiment, the electronic device <NUM> may correct the movement distance change amount of the external electronic device <NUM> received from the external electronic device <NUM>, based on the time information of the external electronic device <NUM> received in operation <NUM> and a movement distance change amount for at least one axis of the electronic device <NUM>.

An operation of synchronizing the time information of the electronic device <NUM> and the external electronic device <NUM> in operation <NUM> by the electronic device <NUM> of an exemplary embodiment may be referred to by Equation <NUM> below.

According to an exemplary embodiment, the electronic device <NUM> may synchronize the time information between the electronic device <NUM> and the external electronic device <NUM>, based on the time information of the external electronic device <NUM> received from the external electronic device <NUM> and the delay time (delaylatency) acquired based on the time information. For example, the compensation value (Δw ) dependent on the delay time (delaylatency) may be previously specified and stored in a memory. For another example, the compensation value (Δw ) dependent on the delay time (delaylatency) may be determined in real time by a modeled function.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a first feature value by using at least one third sensor.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a movement distance change amount for at least one axis (e.g., z-axis) indicating a preset direction (e.g., a direction perpendicular to the ground) within a space where the electronic device <NUM> is located, by using the at least one third sensor (or a first inertial sensor).

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a first feature value, based on the movement distance change amount of the electronic device <NUM> and the movement distance change amount of the external electronic device <NUM>. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire the first feature value, based on a difference between the movement distance change amount of the electronic device <NUM> and the movement distance change amount of the external electronic device <NUM>. For example, the first feature value may be referred to as a difference of a shaking degree between the electronic device <NUM> and the external electronic device <NUM>.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether a movement distance change amount for z-axis among the movement distance change amount of the electronic device <NUM> is greater than or equal to a first threshold value. For example, in operation <NUM>, the electronic device <NUM> may determine whether the electronic device <NUM> shakes in a direction perpendicular to the ground by a first threshold value or more.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a second feature value by using a UWB antenna. According to an exemplary embodiment, in response to the movement distance change amount for z-axis among the movement distance change amount of the electronic device <NUM> being greater than or equal to the first threshold value, in operation <NUM>, the electronic device <NUM> may acquire the second feature value by using the UWB antenna. According to an exemplary embodiment, in response to the movement distance change amount for z-axis among the movement distance change amount of the electronic device <NUM> being greater than or equal to the first threshold value, in operation <NUM>, the electronic device <NUM> may acquire the second feature value by driving the UWB antenna.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may measure a distance between the electronic device <NUM> and the external electronic device <NUM> by using the UWB antenna. For example, the second feature value may be referred to as the distance between the electronic device <NUM> and the external electronic device <NUM>.

<FIG> illustrates a movement distance change amount for each axis of an electronic device according to an exemplary embodiment. <FIG> illustrates a movement distance change amount of a direction perpendicular to the ground of the electronic device according to an exemplary embodiment. <FIG> illustrates a movement distance change amount for each axis of an external electronic device according to an exemplary embodiment. <FIG> illustrates a movement distance change amount of a direction perpendicular to the ground of the external electronic device according to an exemplary embodiment.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may have a larger movement distance change amount for at least one axis than the external electronic device <NUM>. <FIG> of an exemplary embodiment may be referred to as a movement distance change amount for each axis of the electronic device <NUM> and/or the external electronic device <NUM> for a specified time. At this time, the movement distance change amount for each axis may be referred to as an acceleration value. It is not limited thereto, and may refer to various parameters capable of indicating the change of a movement distance.

Referring to <FIG> and <FIG> of an exemplary embodiment, the electronic device <NUM> of an exemplary embodiment may have a larger movement distance change amount than the external electronic device <NUM>, with respect to each axis within a space in which the electronic device <NUM> and the external electronic device <NUM> exist.

Referring to <FIG> and <FIG> of an exemplary embodiment, the electronic device <NUM> of an exemplary embodiment may have a larger movement distance change amount than the external electronic device <NUM>, with respect to a z-axis or an axis indicating a direction perpendicular to the ground within the space in which the electronic device <NUM> and the external electronic device <NUM> exist.

According to an exemplary embodiment, the electronic device <NUM> may shake relatively more than the external electronic device <NUM> due to an external force in a vehicle riding or walking situation.

<FIG> is a flowchart illustrating an operation of controlling a display position of a first UI displayed on a display by an electronic device according to an exemplary embodiment.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may control the display position of the first user interface (UI) displayed on the display, when a first feature value is greater than or equal to a second threshold value.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the first feature value acquired through operation <NUM> is greater than or equal to the second threshold value. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether a difference of a shaking degree between the electronic device <NUM> and the external electronic device <NUM> acquired through operation <NUM> is greater than or equal to a predetermined second threshold value.

According to an exemplary embodiment, in operation <NUM>, in response to the first feature value being greater than or equal to the second threshold value, the electronic device <NUM> may control the display position of the first UI displayed on the display. According to an exemplary embodiment, in operation <NUM>, in response to the first feature value being greater than or equal to the second threshold value, the electronic device <NUM> may control the display position of the first UI displayed on the display in real time.

For example, when the electronic device <NUM> moves relatively greatly compared to the external electronic device <NUM> in a +z-axis direction, in operation <NUM>, the electronic device <NUM> may change a position of the first UI displayed on the display into a -z-axis direction. A detailed description of this will be made later.

For example, the first UI may be referred to as an e-book or a video playback interface, but is not limited thereto.

<FIG> illustrates an output control model for a UI of an electronic device according to an exemplary embodiment. <FIG> illustrates a construction of controlling a display position of a first UI displayed on a display by the electronic device according to an exemplary embodiment.

Referring to <FIG> together, the electronic device <NUM> (e.g., the electronic device <NUM> of <FIG>) of an exemplary embodiment may control the display position of the first UI <NUM> displayed on the display <NUM> through the output control model <NUM>.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may change the display position of the first UI <NUM>, based on a first feature value (m<NUM>(t) ), a second feature value (m<NUM>(t) ), and a current display position (y(t)) of the first UI <NUM>. According to an exemplary embodiment, the electronic device <NUM> may input the first feature value (m<NUM>(t) ), the second feature value (m<NUM>(t) ), and the current display position (y(t)) of the first UI <NUM> to the output control model <NUM>, and acquire an output position compensation value (u(t)). According to an exemplary embodiment, the electronic device <NUM> may change the current display position (y(t)) of the first UI <NUM>, by applying the acquired output position compensation value (u(t)) through the output control model <NUM>.

An operation of acquiring the output position compensation value (u(t)) through the output control model <NUM> of an exemplary embodiment may be referred by equation below.

In this case, Kp, Ki, Kd may be referred to as gain values for proportional, integral, and differential terms, respectively. The gain values for the respective proportional, integral, and differential terms may be stored in a memory.

According to an exemplary embodiment, the electronic device <NUM> may control the display position of the first UI <NUM> displayed on the display <NUM> through the output control model <NUM> wherein the focus of user's eyes does not shake. According to an exemplary embodiment, the electronic device <NUM> may control the display position of the first UI <NUM> displayed on the display <NUM> through the output control model <NUM>, in order to minimize the shaking of the focus of the user's eyes.

For example, when the electronic device <NUM> moves relatively greatly in an upper right direction compared to the external electronic device <NUM> (a), the position of the first UI <NUM> displayed on the display <NUM> may be changed in a lower left direction.

For another example, when the electronic device <NUM> moves relatively greatly in the lower left direction compared to the external electronic device <NUM> (b), the position of the first UI <NUM> displayed on the display <NUM> may be changed in the upper right direction.

<FIG> is a flowchart illustrating an operation of acquiring a cumulative fatigue level for a predetermined time and controlling at least some of a brightness of a display, a scanning rate, and a color, based on the acquired fatigue level, by an electronic device according to an exemplary embodiment.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may acquire a cumulative fatigue level accumulated for a specified first time, and control a display (e.g., the display <NUM> of <FIG>) for a specified second time, based on the cumulative fatigue level.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a cumulative fatigue level accumulated for a predetermined first time, based on the user's eye fatigue level acquired through operation <NUM>. For example, the predetermined first time may be referred to as <NUM> hours or <NUM> hours, but is not limited thereto.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the cumulative fatigue level acquired through operation <NUM> is greater than or equal to a third threshold value. For example, in operation <NUM>, the electronic device <NUM> may determine whether the cumulative fatigue level accumulated for <NUM> hours is greater than or equal to a predetermined third threshold.

According to an exemplary embodiment, in operation <NUM>, in response to the cumulative fatigue level being equal to or greater than the third threshold value, the electronic device <NUM> may control at least some of a brightness of the display, a scanning rate, and a color for a predetermined second time.

For example, in operation <NUM>, in response to the cumulative fatigue level being equal to or greater than the third threshold value, the electronic device <NUM> may reduce the brightness of the display for <NUM> hours. For another example, in operation <NUM>, in response to the cumulative fatigue level being equal to or greater than the third threshold value, the electronic device <NUM> may increase the scanning rate of the display for <NUM> hours. For further example, in operation <NUM>, in response to the cumulative fatigue level being equal to or greater than the third threshold value, the electronic device <NUM> may control the color of the display to a relatively warm color. According to another example (not shown), in operation <NUM>, in response to the cumulative fatigue level being equal to or greater than the third threshold value, the electronic device <NUM> may apply a blue light filter to a screen outputted through the display.

<FIG> is a flowchart illustrating an operation of deactivating an output control model and a UWB antenna when a shaking pattern of an electronic device does not correspond to a predetermined condition according to an exemplary embodiment.

Referring to <FIG>, when the shaking pattern of the electronic device <NUM> does not correspond to the predetermined condition, the electronic device <NUM> of an exemplary embodiment may deactivate the output control model <NUM> and the UWB antenna in order to reduce power consumption.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may input, to the output control model <NUM>, a first feature value and a second feature value acquired through operation <NUM>.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may control a display position of a first UI (e.g., the first UI <NUM> of <FIG>) displayed on a display (e.g., the display <NUM> of <FIG>), based on an output value (y(t)) of the output control model <NUM>. Operation <NUM> of an exemplary embodiment may be referred to as operation <NUM> of <FIG>.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may acquire a shaking pattern of the electronic device <NUM> by using at least one second sensor. According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may determine whether the shaking pattern acquired using the at least one second sensor corresponds to a predetermined condition. For example, in operation <NUM>, the electronic device <NUM> may determine whether the shaking pattern acquired using the at least one second sensor corresponds to a shaking pattern of a situation where a user gets in a vehicle. For another example, in operation <NUM>, the electronic device <NUM> may determine whether the shaking pattern acquired using the at least one second sensor corresponds to a shaking pattern of a situation where the user is walking. Operation <NUM> of an exemplary embodiment may be referred to as operation <NUM>.

According to an exemplary embodiment, in operation <NUM>, the electronic device <NUM> may deactivate the output control model <NUM> and the UWB antenna. According to an exemplary embodiment, in operation <NUM>, in response to the shaking pattern of the electronic device <NUM> not corresponding to the predetermined condition, the electronic device <NUM> may deactivate the output control model <NUM> and the UWB antenna. According to an exemplary embodiment, in operation <NUM>, in response to the shaking pattern of the electronic device <NUM> not corresponding to the predetermined condition, the electronic device <NUM> may deactivate the output control model <NUM> and the UWB antenna in order to reduce power consumption.

<FIG> illustrates a construction of displaying a second UI on a display as a display position of a first UI is changed according to an exemplary embodiment.

Referring to <FIG> and <FIG> together, when a distance between a current display position of the first UI <NUM> and a position to display the first UI <NUM> is equal to or greater than a predetermined threshold value, the electronic device <NUM> of an exemplary embodiment may display a second UI <NUM> different from the first UI <NUM> through the display <NUM>.

According to another exemplary embodiment, when a first feature value is greater than or equal to a predetermined threshold value, the electronic device <NUM> may display the second UI <NUM> different from the first UI <NUM> through the display <NUM>.

According to an exemplary embodiment, the second UI <NUM> may include guide information for reducing an eye fatigue level of a user. According to an exemplary embodiment, the second UI <NUM> may include a message of recommending the user to stop using the electronic device <NUM>. The second UI <NUM> may include a message of recommending the user to stop gazing at the electronic device <NUM>.

<FIG> illustrates a construction of displaying a third UI capable of receiving a user's input through a display, based on a cumulative fatigue level according to an exemplary embodiment.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may display a <NUM>-1st UI <NUM> capable of receiving a user's input through the display <NUM>, based on a cumulative fatigue level, for a specified time.

According to an exemplary embodiment, the electronic device <NUM> may acquire a cumulative fatigue level accumulated for a predetermined first time, based on a user's eye fatigue level.

According to an exemplary embodiment, when the acquired cumulative fatigue level exceeds a specified threshold value, the electronic device <NUM> may display the <NUM>-1st UI 1131capable of receiving the user's input through the display <NUM>. For example, when the cumulative fatigue level acquired by the electronic device <NUM> for <NUM> hours exceeds the specified threshold value, the electronic device <NUM> may display the <NUM>-1st UI <NUM> including information related to the cumulative fatigue level, through the display <NUM>.

According to an exemplary embodiment, the electronic device <NUM> may display, through the display <NUM>, a <NUM>-2nd UI <NUM> including guide information for reducing the user's eye fatigue level, based on the user's input to the <NUM>-1st UI <NUM>.

<FIG> illustrates a construction of displaying a fourth UI through a display at a specified time, based on a cumulative fatigue level according to an exemplary embodiment.

Referring to <FIG>, the electronic device <NUM> of an exemplary embodiment may display the fourth UI <NUM> capable of receiving a user's input through the display <NUM>, based on a cumulative fatigue level, for a specified time.

According to an exemplary embodiment, when the cumulative fatigue level exceeds a predetermined threshold value for a specified time, the electronic device <NUM> may display the fourth UI <NUM> capable of receiving the user's input through the display <NUM>. For example, when the cumulative fatigue level acquired by the electronic device <NUM> for <NUM> hours exceeds a specified threshold value, the electronic device <NUM> may display the fourth UI <NUM> including information related to the cumulative fatigue level through the display <NUM>.

According to an exemplary embodiment, when the cumulative fatigue level accumulated for a specified time exceeds a predetermined threshold value, the electronic device <NUM> may display the fourth UI <NUM> capable of receiving a user's input through the display <NUM>. For example, when the cumulative fatigue level accumulated over the past <NUM> hours at midnight every day exceeds a predetermined threshold value, the electronic device <NUM> may display the fourth UI <NUM> capable of receiving a user's input through the display <NUM>. For another example, when the cumulative fatigue level accumulated over the past <NUM> hours at noon every day exceeds a predetermined threshold value, the electronic device <NUM> may display the fourth UI <NUM> capable of receiving a user's input through the display <NUM>.

According to an exemplary embodiment, in response to the user's input to the fourth UI <NUM>, the electronic device <NUM> may execute an eye protection mode. According to an exemplary embodiment, in response to the user's input to the fourth UI <NUM>, the electronic device <NUM> may lower a brightness of the display <NUM>, increase a scanning rate, or change a color into a relatively warm color. According to another exemplary embodiment, in response to the user's input to the fourth UI <NUM>, the electronic device <NUM> may execute a blue light filter. According to an exemplary embodiment, an operation of executing the eye protection mode by the electronic device <NUM> in response to the user's input to the fourth UI <NUM> may be referred to as operation <NUM> of <FIG>.

Referring to <FIG>, the electronic device <NUM> in the network environment <NUM> may communicate with an electronic device <NUM> via a first network <NUM> (e.g., a short-range wireless communication network), or at least one of an electronic device <NUM> or a server <NUM> via a second network <NUM> (e.g., a long-range wireless communication network). According to an exemplary embodiment, the electronic device <NUM> may communicate with the electronic device <NUM> via the server <NUM>. According to an exemplary embodiment, the electronic device <NUM> may include a processor <NUM>, memory <NUM>, an input module <NUM>, a sound output module <NUM>, a display module <NUM>, an audio module <NUM>, a sensor module <NUM>, an interface <NUM>, a connecting terminal <NUM>, a haptic module <NUM>, a camera module <NUM>, a power management module <NUM>, a battery <NUM>, a communication module <NUM>, a subscriber identification module(SIM) <NUM>, or an antenna module <NUM>. In some embodiments, at least one of the components (e.g., the connecting terminal <NUM>) may be omitted from the electronic device <NUM>, or one or more other components may be added in the electronic device <NUM>. In some embodiments, some of the components (e.g., the sensor module <NUM>, the camera module <NUM>, or the antenna module <NUM>) may be implemented as a single component (e.g., the display module <NUM>).

According to an exemplary embodiment, the processor <NUM> may include a main processor <NUM> (e.g., a central processing unit (CPU) or an application processor (AP)), or an auxiliary processor <NUM> (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operable independently from, or in conjunction with, the main processor <NUM>.

According to an exemplary embodiment, the auxiliary processor <NUM> (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module <NUM> or the communication module <NUM>) functionally related to the auxiliary processor <NUM>. According to an exemplary embodiment, the auxiliary processor <NUM> (e.g., the neural processing unit) may include a hardware structure specified for artificial intelligence model processing.

According to an exemplary embodiment, the receiver may be implemented as separate from, or as part of the speaker.

According to an exemplary embodiment, the display module <NUM> may include a touch sensor adapted to detect a touch, or a pressure sensor adapted to measure the intensity of force incurred by the touch.

According to an exemplary embodiment, the audio module <NUM> may obtain the sound via the input module <NUM>, or output the sound via the sound output module <NUM> or a headphone of an external electronic device (e.g., an electronic device <NUM>) directly (e.g., wiredly) or wirelessly coupled with the electronic device <NUM>.

According to an exemplary embodiment, the sensor module <NUM> may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

According to an exemplary embodiment, the interface <NUM> may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

The connecting terminal <NUM> may include a connector via which the electronic device <NUM> may be physically connected with the external electronic device (e.g., the electronic device <NUM>). According to an exemplary embodiment, the connecting terminal <NUM> may include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector).

According to an exemplary embodiment, the haptic module <NUM> may include, for example, a motor, a piezoelectric element, or an electric stimulator.

According to an exemplary embodiment, the camera module <NUM> may include one or more lenses, image sensors, image signal processors, or flashes.

According to an exemplary embodiment, the battery <NUM> may include, for example, a primary cell which is not rechargeable, a secondary cell which is rechargeable, or a fuel cell.

According to an exemplary embodiment, the communication module <NUM> may include a wireless communication module <NUM> (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module <NUM> (e.g., a local area network (LAN) communication module or a power line communication (PLC) module).

According to an exemplary embodiment, the wireless communication module <NUM> may support a peak data rate (e.g., 20Gbps or more) for implementing eMBB, loss coverage (e.g., 164dB or less) for implementing mMTC, or U-plane latency (e.g., <NUM> or less for each of downlink (DL) and uplink (UL), or a round trip of <NUM> or less) for implementing URLLC.

According to an exemplary embodiment, the antenna module <NUM> may include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an exemplary embodiment, the antenna module <NUM> may include a plurality of antennas (e.g., array antennas). According to an exemplary embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module <NUM>.

According to an exemplary embodiment, the mmWave antenna module may include a printed circuit board, a RFIC disposed on a first surface (e.g., the bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a designated high-frequency band (e.g., the mmWave band), and a plurality of antennas (e.g., array antennas) disposed on a second surface (e.g., the top or a side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the designated high-frequency band.

According to an exemplary embodiment, commands or data may be transmitted or received between the electronic device <NUM> and the external electronic device <NUM> via the server <NUM> coupled with the second network <NUM>. According to an exemplary embodiment, all or some of operations to be executed at the electronic device <NUM> may be executed at one or more of the external electronic devices <NUM>, <NUM>, or <NUM>. In another exemplary embodiment, the external electronic device <NUM> may include an internet-of-things (IoT) device. According to an exemplary embodiment, the external electronic device <NUM> or the server <NUM> may be included in the second network <NUM>.

According to an exemplary embodiment of the disclosure, the electronic devices are not limited to those described above.

It should be appreciated that various embodiments of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include also other embodiments falling within the scope of the appended claims.

For example, according to an exemplary embodiment, the module may be implemented in a form of an application-specific integrated circuit (ASIC).

According to an exemplary embodiment, a method according to various embodiments of the disclosure may be included and provided in a computer program product.

A control method of the electronic device <NUM> of an exemplary embodiment may include the operations of connecting with an external electronic device <NUM> worn by a user by using wireless communication, determining whether the user is gazing at the electronic device <NUM> by using at least one first sensor, acquiring a shaking pattern of the electronic device <NUM> by using at least one second sensor in response to the user being gazing at the electronic device <NUM>, acquiring a first feature value and a second feature value which are related to a change of position between the electronic device <NUM> and the external electronic device <NUM>, by using at least one third sensor when the acquired shaking pattern corresponds to a predetermined condition, acquiring an eye fatigue level of the user, based on the first feature value and the second feature value, and controlling a display <NUM> of the electronic device <NUM>, based on the acquired fatigue level.

According to an exemplary embodiment, the at least one first sensor may include a grip sensor and a motion sensor, and the operation of determining whether the user is using the electronic device <NUM> may include the operations of determining whether the user is holding the electronic device <NUM> by using the grip sensor, and determining whether the display <NUM> of the electronic device <NUM> faces a user's face by using the motion sensor.

According to an exemplary embodiment, the method may include the operations of detecting a distance to the external electronic device <NUM> by using a UWB antenna in response to the user being holding the electronic device <NUM>, and the display <NUM> facing the user's face, detecting an eye area of the user by using a camera, and determining that the user gazes at the electronic device <NUM> when the distance to the external electronic device <NUM> is within a specified distance, and the user's eye area is detected.

According to an exemplary embodiment, the at least one second sensor may include an acceleration sensor or a gyro sensor, and the operation of determining whether the determined shaking pattern corresponds to the predetermined condition may include the operation of determining whether the shaking pattern of the electronic device <NUM> acquired through the acceleration sensor or the gyro sensor corresponds to a shaking pattern of a situation in which the user gets in a vehicle or a shaking pattern of a situation in which the user is walking.

According to an exemplary embodiment, the at least one third sensor may include a first inertial sensor, and the control method of the electronic device <NUM> may include the operation of acquiring a movement distance change amount for at least one axis indicating a preset direction within a space where the electronic device <NUM> is located, by using the first inertial sensor.

According to an exemplary embodiment, the control method of the electronic device <NUM> may include the operations of receiving a movement distance change amount of the external electronic device <NUM> for the at least one axis indicating the preset direction, which is acquired through a second inertial sensor of the external electronic device <NUM>, from the external electronic device <NUM> by using the wireless communication, and acquiring the first feature value, based on a difference between the movement distance change amount of the electronic device <NUM> and the movement distance change amount of the external electronic device <NUM>.

According to an exemplary embodiment, the at least one third sensor may include a UWG antenna, and the second feature value may be referred to as a distance between the electronic device <NUM> and the external electronic device <NUM>, acquired using the UWB antenna.

According to an exemplary embodiment, the control method of the electronic device <NUM> may further include the operations of receiving time information related to the movement distance change amount of the external electronic device <NUM> from the external electronic device <NUM> by using the wireless communication, and correcting the received movement distance change amount of the external electronic device <NUM>, based on the received time information of the external electronic device <NUM> and the movement distance change amount of the electronic device <NUM>.

According to an exemplary embodiment, the control method of the electronic device <NUM> may further include the operations of acquiring data on at least one axis within a space where the external electronic device <NUM> is located, from the external electronic device <NUM> by using the wireless communication, and correcting an axis corresponding to the at least one axis in a space where the electronic device <NUM> is located, based on the acquired data.

According to an exemplary embodiment, the operation of acquiring the first feature value and the second feature value may include the operations of acquiring the first feature value, and acquiring the second feature value in response to the first feature value exceeding a predetermined threshold value.

According to an exemplary embodiment, the operation of controlling the display <NUM>, based on the fatigue level, may include the operation of changing a position of a first user interface (UI) displayed on the display <NUM>, based on the first feature value, a current display position of the first UI, and the second feature value.

According to an exemplary embodiment, the operation of controlling the display <NUM>, based on the fatigue level, may include the operation of displaying a second UI different from the first UI when a distance between the current display position of the first UI and a position to display <NUM> the first UI is equal to or greater than a predetermined threshold value, and the second UI may include guide information for reducing the eye fatigue level of the user.

According to an exemplary embodiment, the operation of controlling the display <NUM> may include the operation of controlling at least one of a brightness of the display <NUM>, a scanning rate, and a color.

According to an exemplary embodiment, the operation of controlling the display <NUM> may include the operations of acquiring a cumulative fatigue level accumulated for a predetermined first time, based on the acquired fatigue level, and controlling at least one of a brightness of the display <NUM>, a scanning rate, and a color for a predetermined second time when the cumulative fatigue level exceeds a predetermined threshold value.

According to an exemplary embodiment, the operation of controlling the display <NUM> may include the operation of displaying a third UI capable of receiving a user's input at a predetermined time, based on the cumulative fatigue level.

The electronic device <NUM> of an exemplary embodiment may include a display <NUM>, a wireless communication circuit, and at least one processor electrically connected to the wireless communication circuit. The at least one processor may operatively connect with an external electronic device <NUM> worn by a user by using the wireless communication circuit, determine whether the user is gazing at the display <NUM> of the electronic device <NUM> by using at least one first sensor, acquire a shaking pattern of the electronic device <NUM> by using at least one second sensor in response to the user being gazing at the electronic device <NUM>, acquire a first feature value and a second feature value which are related to a change of position between the electronic device <NUM> and the external electronic device <NUM> by using at least one third sensor when the acquired shaking pattern corresponds to a predetermined condition, acquire an eye fatigue level of the user, based on the first feature value and the second feature value, and control the display <NUM>, based on the acquired fatigue level.

According to an exemplary embodiment, the at least one processor may determine whether the user is holding the electronic device <NUM> by using a grip sensor, determine whether the display <NUM> is facing a user's face by using a motion sensor, detect a distance to the external electronic device <NUM> by using a UWB antenna in response to the user being holding the electronic device <NUM>, and the electronic device <NUM> facing the user's face, detect a user's eye area by using a camera, determine that the user gazes at the electronic device <NUM> when a distance to the external electronic device <NUM> is within a specified distance, and the user's eye area is detected.

According to an exemplary embodiment, the at least one third sensor may include a first inertial sensor, and the at least one processor may acquire a movement distance change amount for at least one axis indicating a preset direction within a space where the electronic device <NUM> is located, by using the first inertial sensor, receive a movement distance change amount of the external electronic device <NUM> for the at least one axis indicating the preset direction, which is acquired through a second inertial sensor included in the external electronic device <NUM>, from the external electronic device <NUM> through the wireless communication circuit, and acquire the first feature value, based on a difference between the movement distance change amount of the electronic device <NUM> and the movement distance change amount of the external electronic device <NUM>.

According to an exemplary embodiment, the at least one third sensor may include a UWB antenna, and the second feature value may be referred to as a distance between the electronic device <NUM> and the external electronic device <NUM>, which is acquired using the UWB antenna.

Claim 1:
An electronic device (<NUM>) for reducing an eye fatigue level of a user comprising:
a display (<NUM>);
a wireless communication circuit; and
at least one processor (<NUM>),
memory storing instructions that, when executed by the at least one processor (<NUM>), cause the electronic device (<NUM>) to:
operatively connect (<NUM>) with an external electronic device (<NUM>) worn by the user by using the wireless communication circuit;
determine (<NUM>) whether the user is gazing at the display (<NUM>) of the electronic device (<NUM>) by using at least one first sensor;
in response to the user gazing at the electronic device (<NUM>), acquire a shaking pattern of the electronic device (<NUM>) by using at least one second sensor;
when the acquired shaking pattern corresponds to a predetermined condition, acquire (<NUM>) a first feature value and a second feature value which are related to a change of position between the electronic device (<NUM>) and the external electronic device (<NUM>) by using at least one third sensor;
determine (<NUM>) an eye fatigue level of the user, based on the first feature value and the second feature value; and
control (<NUM>) the display (<NUM>), based on the determined fatigue level, to reduce the eye fatigue level of the user.