HEAD-MOUNTED DISPLAY AND METHOD AND SYSTEM FOR ADJUSTING USER INTERFACE THEREOF

A method and a system for adjusting a user interface of a head-mounted display (HMD) are provided. The HMD is provided with a distance sensor and a display unit, where the distance sensor is configured to detect a distance between a user and the HMD and the display unit is configured to display a user interface for interacting with the user. The method includes the following. A determination may be made whether the HMD is in a screen locked state. A screen locked interface displayed by the display unit is adjusted according to the distance detected by the distance sensor when the HMD is in the screen locked state. And the display unit is controlled to display an adjusted user interface.

TECHNICAL FIELD

This disclosure relates to the field of head-mounted displays, and more particularly to a method and a system for adjusting a user interface of a head-mounted display.

BACKGROUND

With the development of head-mounted display technology and virtual display technology, head-mounted display (HMD) has been accepted by more and more users. Since a display screen is wrapped inside the HMD, when in use, the HMD needs to be worn on a user's head. However, the user is unable to see the actual keyboard when wearing the HMD. Therefore, the user is unable to control the HMD in a manner similar to that of operating a PC (personal computer) by a physical mouse or controlling a mobile phone by a touch screen while wearing the HMD.

In order to ensure information security, the HMD will be in a screen locked state when the HMD has not been used for a period of time or the HMD is turned on. When unlocking the screen of the HMD, the user often needs to remove the HMD from his/her head, then view what is displayed on the screen from eyepieces of the HMD, and perform corresponding operations according to contents as viewed.

However, when the HMD is removed from the user's head, the size of the graphical user interface viewed by the user from the eyepieces is smaller than that viewed with the HMD worn on the head. Therefore, it is harder for the user to discern and inconvenient for the user to operate.

SUMMARY

In view of the above, a method and a system for adjusting a user interface of a head-mounted display (HMD) are provided so as to adjust the user interface of the HMD according to a distance between a user and the HMD, thereby allowing the user to view an appropriate user interface and facilitating corresponding operations to be applied.

In order to achieve the above purpose, in a first aspect of the present disclosure, there is provided a method for adjusting a user interface, which is applicable to a head-mounted display (HMD). The HMD is provided with a distance sensor and a display unit, where the distance sensor is configured to detect a distance between a user and the HMD and the display unit is configured to display a user interface for interacting with the user. The method includes the following. A determination is made whether the user interface of the HMD is in a screen locked state. A screen locked interface displayed by the display unit is adjusted according to the distance detected by the distance sensor when the user interface of the HMD is in the screen locked state. And the display unit is controlled to display an adjusted user interface.

In a second aspect of the present disclosure, there is provided a system for adjusting a user interface, which is applicable to a head-mounted display (HMD). The HMD is provided with a distance sensor and a display unit, where the distance sensor is configured to detect a distance between a user and the HMD and the display unit is configured to display a user interface for interacting with the user. The system includes a determining module, an adjusting module, and a display control module. The determining module is configured to determine whether the user interface displayed by the HMD is in a screen locked state. The adjusting module is configured to adjust a screen locked interface displayed by the display unit according to the distance detected by the distance sensor when the user interface of the HMD is in the screen locked state. And the display control module is configured to control the display unit to display an adjusted user interface.

In a third aspect of the present disclosure, there is provided a head-mounted display (HMD), which includes a distance sensor and a display unit. The distance sensor is configured to detect a distance between a user and the HMD and the display unit is configured to display a user interface for interacting with the user. The HMD further includes a system for adjusting the user interface. The system includes a determining module, an adjusting module, and a display control module. The determining module is configured to determine whether the user interface displayed by the HMD is in a screen locked state. The adjusting module is configured to adjust a screen locked interface displayed by the display unit according to the distance detected by the distance sensor when the user interface of the HMD is in the screen locked state. And the display control module is configured to control the display unit to display an adjusted user interface.

Compared with the related art, the method and the system for adjusting the user interface of the head-mounted display (HMD) according to embodiments of the present disclosure, are capable of adjusting the user interface displayed according to the distance between the HMD and the user when the user interface displayed by the HMD is in the screen locked state, facilitating the user to view the corresponding interface and apply corresponding operations to provide user convenience.

DETAILED DESCRIPTION OF ILLUSTRATED EMBODIMENTS

To provide a better understanding of objects, technical solutions, and advantages of the present disclosure, various implementations of the disclosure will be described below in further detail with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present disclosure and are not intended to limit the present disclosure.

FIG. 1is a schematic diagram illustrating hardware modules in a head-mounted display (HMD)100according to an embodiment of the present disclosure. The HMD100includes a display unit110, a processing unit120, a distance sensor130, and eyepieces140.

The display unit110and the distance sensor130are electrically connected with the processing unit120. In this implementation, the display unit110may be a flexible display screen. The distance sensor130may be an infrared sensor disposed on the HMD100facing a user's face. The distance sensor130is configured to detect a distance of the HMD100from a user. In another implementation, the distance sensor130is an eyeball sensor. The distance sensor130is disposed at a position where an eyepiece hole (not shown) of the HMD100is located, and configured to detect a distance between the eyepieces140of the HMD100and the user's eyes. The processing unit120is configured to control a system200for adjusting a user interface (referring toFIG. 2, hereinafter referred to as an adjustment system200for short). The processing unit120may include an integrated circuit (IC), for example, may include a single packaged IC, or may include a plurality of connected packaged ICs with the same function or different functions. For instance, the processing unit120may only include a central processing unit (CPU), or may be a combination of a CPU, a digital signal processor (DSP), a graphic processing unit (GPU), and various control chips. In embodiments of the present disclosure, the CPU may have a single operation core, and may also have a multi-operation core.

In another implementation, the HMD100further includes a memory150and an input unit160. The memory150may be a memory built in the HMD100itself, or may be an external storage device such as a secure digital card, a smart media card, or a flash memory card, for storing program codes and data of the adjustment system200. The input unit160is configured to receive an input operation of the user and generate a corresponding instruction in response to the input operation, for example, inputting an instruction for conducting an unlock operation or an interface magnifying operation into an interface displayed by the display unit110.

FIG. 2is a schematic diagram illustrating functional modules of the system200for adjusting the user interface (hereinafter referred to as an adjustment system200for short) illustrated inFIG. 1according to an embodiment of the present disclosure. The adjustment system200includes a determining module210, an adjusting module220, and a display control module230. It should be noted that the modules referred to in the present disclosure are subroutine instruction segments that can be executed by the processing unit120of the HMD100and achieve specific functions. Hereinafter, the specific functions of each functional module will be described in detail.

The determining module210is configured to determine a current state of the HMD100. The current state of the HMD100includes a screen locked state and a screen unlocked state. In this implementation, the determining module210is configured to determine whether the HMD100is in the screen locked state currently.

As an implementation, the determining module210is configured to determine if the current state of the HMD100is the screen locked state or the screen unlocked state by determining whether the user interface displayed by the display unit110includes a lock screen icon or a lock screen text (such as “sliding to unlock”). When the user interface displayed by the display unit110includes a lock screen icon or/and a lock screen text, the determining module210determines that the HMD100is currently in the screen locked state. On the other hand, when the user interface displayed by the display unit110does not include a lock screen icon or a lock screen text, the determining module210determines that the HMD100is currently in the screen unlocked state.

When the HMD100is in the screen locked state, the display unit110displays a user interface of lock screen (that is, a screen locked interface). The user interface of lock screen includes a lock screen icon or/and a lock screen text. When the HMD100is in the screen unlocked state, the display unit110displays a main interface or an application interface of an application.

When the HMD100is in the screen locked state, the adjusting module220adjusts the screen locked interface displayed by the display unit110according to the distance detected by the distance sensor130.

In an implementation, the adjusting module220is configured to determine whether the distance detected by the distance sensor130is greater than a first preset value and less than a second preset value. The first preset value is equal to the distance between the eyepieces140of the HMD100and the user's eyes when the HMD100is worn. The first preset value is, for example, 2 cm. The second preset value is equal to the distance between the user (or the user's eyes) and the HMD100(or the eyepieces140of the HMD100) when the HMD100is taken off and contents (for example, the user interface) displayed by the display unit110may not be clearly visible to the user through the eyepieces140. The second preset value is, for example, 10 cm. The first preset value can be obtained by separately measuring a distance between each of a plurality of users and the HMD100, when the plurality of users wear the HMD100individually. The second preset value can be obtained by separately measuring a distance between each of a plurality of users and the HMD100, when the plurality of users remove the HMD100individually and the contents displayed by the display unit110may not be clearly visible to the users through the eyepieces140.

When the distance detected by the distance sensor130is greater than the first preset value and less than the second preset value, the adjusting module220magnifies the screen locked interface displayed by the display unit110. In an implementation, the adjusting module220is configured to magnify a lock screen icon or/and a lock screen text on the screen locked interface displayed by the display unit110. In other implementations, the adjusting module220configured to magnify the screen locked interface displayed by the display unit110, is configured to: calculate a ratio of the distance detected by the distance sensor130to a preset value and determine a magnifying coefficient of the screen locked interface according to the ratio, where the magnifying coefficient is equal to the ratio. That is, assuming that a preset value of the distance is D, and in the screen locked state, the size of the screen locked interface displayed by the display unit110is S. When a value of the distance detected by the distance sensor130is D1(D1is greater than the first preset value and less than the second preset value) and D1>D, the adjusting module220magnifies the screen locked interface, where the size of the screen locked interface magnified is S1, with S1=D1*S/D.

In another implementation, the adjusting module220is configured to determine whether the distance detected by the distance sensor130is equal to the first preset value. When the distance detected by the distance sensor130is equal to the first preset value, the adjusting module220determines that the HMD100has been mounted to the user's head and unlocks the screen locked interface displayed by the display unit110.

The display control module230controls the display unit110to display the screen locked interface adjusted by the adjusting module220.

As an implementation, when the distance detected by the distance sensor130is greater than the first preset value and less than the second preset value, the display control module230controls the display unit110to display the screen locked interface magnified. Otherwise, when the distance detected by the distance sensor130is equal to the first preset value, the display control module230controls the display unit110to display a screen unlocked interface (that is, an interface in the screen unlocked state or an unlocked user interface).

FIG. 3is a flow chart illustrating a method for adjusting a user interface of a head-mounted display according to an embodiment of the present disclosure. The sequence of blocks in the flow chart can be changed, and some blocks can be omitted.

At block301, the determining module210may determine whether the user interface displayed by the HMD100) is in the screen locked state.

If yes, the method may advance to block302.

Otherwise, end the process.

As an implementation, the determining module210may determine if the current state of the HMD100is the screen locked state or the screen unlocked state by determining whether the user interface displayed by the display unit110includes a lock screen icon or a lock screen text (such as “sliding to unlock”). When the user interface displayed by the display unit110includes a lock screen icon or/and a lock screen text, the determining module210may determine that the HMD100is currently in the screen locked state. On the other hand, when the user interface displayed by the display unit110does not include a lock screen icon or a lock screen text, the determining module210may determine that the HMD100is currently in the screen unlocked state.

When the HMD100is in the screen locked state, the display unit110may display a user interface of lock screen (that is, a screen locked interface). The user interface of lock screen includes a lock screen icon or/and a lock screen text. When the HMD100is in the screen unlocked state, the display unit110may display a main interface or an application interface of an application.

At block302, the distance sensor130may detect the distance between the HMD100and the user.

In this implementation, the distance sensor130is an eyeball sensor. The distance sensor130is disposed at a position where an eyepiece hole (not shown) of the HMD100is located, and configured to detect a distance between the eyepieces140of the HMD100and the user's eyes.

At block303, the adjusting module220may adjust the user interface displayed by the display unit110according to the distance detected by the distance sensor130.

In an implementation, the adjusting module220may determine whether the distance detected by the distance sensor130is greater than a first preset value and less than a second preset value, or whether the distance is equal to or less than the first preset value. The first preset value is equal to the distance between the eyepieces140of the HMD100and the user's eyes when the HMD100is worn. The first preset value is, for example, 2 cm. The second preset value is equal to the distance between the user (or the user's eyes) and the HMD100(or the eyepieces140of the HMD100) when the HMD100is removed and contents displayed by the display unit110may not be clearly visible to the user through the eyepieces140. The second preset value is, for example, 10 cm.

When the HMD100is currently in the screen locked state and the distance detected by the distance sensor130is greater than the first preset value and less than the second preset value, the adjusting module220may magnify the screen locked interface displayed by the display unit110. In other implementations, the adjusting module220may only magnify a lock screen icon or/and a lock screen text on the screen locked interface displayed by the display unit110.

When the HMD100is currently in the screen unlocked state and the distance detected by the distance sensor130is equal to or less than the first preset value, the adjusting module220may unlock the screen locked interface displayed by the display unit110.

In an implementation, the adjusting module220may magnify the screen locked interface displayed by the display unit110as follows. A ratio of the distance detected by the distance sensor130to a preset value may be calculated, a magnifying coefficient of the screen locked interface may be determined according to the ratio, where the magnifying coefficient is equal to the ratio. That is, assuming that a preset value of the distance is D, and in the screen locked state, the size of the screen locked interface displayed by the display unit110is S. When a value of the distance detected by the distance sensor130is D1(D1is greater than the first preset value and less than the second preset value) and D1>D, the adjusting module220may magnify the screen locked interface, and the size of the screen locked interface magnified is S1, with S1=D1*S/D.

At block304, the display control module230may control the display unit110to display the user interface adjusted by the adjusting module220.

As an implementation, the display control module230may control the display unit110to display the user interface adjusted by the adjusting module220as follows. The display control module230may control the display unit110to display the screen locked interface magnified, or to display the user interface in a screen unlocked state (that is, an unlocked user interface).

Compared with the related art, the method and the system for adjusting the user interface of the head-mounted display according to the implementations of the present disclosure, are capable of adjusting the user interface of the HMD and displaying the user interface adjusted according to the current state of the user interface of the HMD and the distance between the HMD and the user. For example, when the user interface is in the screen locked state, and the distance between the HMD and the user is greater than the first preset value and less than the second preset value, the system may magnify the user interface in the screen locked state and display the user interface magnified in the screen locked state. Thus, a lock screen icon or/and a lock screen text, on the user interface in the screen locked state, is clearly visible to the user, facilitating corresponding operations applied by the user.

The aforesaid embodiments are only preferred embodiments of the present application, and are not intended for limiting the present application. Any modification, equivalent replacement, improvement, and so on, which are made within the spirit and the principle of the present application, should be included in the protection scope of the present disclosure.