Patent Publication Number: US-2015077552-A1

Title: Head mounted system

Description:
This application claims the benefit of Taiwan application Serial No. 102133271, filed Sep. 13, 2013, the subject matter of which is incorporated herein by reference. 
     TECHNICAL FIELD 
     The invention relates in general to an electronic device, and more particularly to a head mounted system. 
     BACKGROUND 
     As technology progresses, people receive more information from electronic devices, such as multimedia players, network communication devices, and computers, which are equipped with display devices such as CRTs or LCDs for displaying images. The number of pixels and size of the image displayed by the display devices are constrained by the size of the display devices and their performance. Hence, the conventional CRT or LCD displays cannot meet the requirement of compact, portability, and a size with high display quality. For resolving this problem, the head-mounted display (HMD) is provided in the market. The head-mounted display provides two small tubes or LCDs disposed in front of the left and right eyes of a person. For example, a head-mounted display achieves stereoscopic effects by using binocular parallax, which projects images outputted from the tubes or LCDs through beam splitters onto the eyes of the user. 
     SUMMARY 
     The disclosure is directed to a head mounted system. 
     According to an embodiment, a head mounted system is provided. The head mounted system includes an abnormality sensing unit, a plurality of image capturing devices, a signal processing circuit, a memory, an application processor, and an eyeglass frame. The abnormality sensing unit detects an abnormal situation. The signal processing circuit outputs a warning signal and makes at least one of the image capturing devices start video recording when the abnormal situation occurs. The application processor receives the warning signal and storing video data, after the video recording is started, in the memory. The eyeglass frame carries the abnormality sensing unit, the image capturing devices, the signal processing circuit, the memory, and the application processor. 
     According to another embodiment, a head mounted system is provided. The head mounted system includes an auxiliary image capturing device, a main image capturing device, a signal processing circuit, a memory, an application processor, and an eyeglass frame. The auxiliary image capturing device detects an abnormal situation. The signal processing circuit outputs a warning signal and makes the main image capturing device start video recording when the abnormal situation occurs. The application processor receives the warning signal and stores video data, after the video recording starting, in the memory. The eyeglass frame carries the auxiliary image capturing device, the main image capturing device, the signal processing circuit, the memory, and the application processor. 
     The above and other aspects of the disclosure will become better understood with regard to the following detailed description of the preferred but non-limiting embodiment(s). The following description is made with reference to the accompanying drawings. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         FIG. 1  is a block diagram of a head mounted system according to a first embodiment. 
         FIG. 2  is a diagram illustrating a head mounted system according to the first embodiment. 
         FIG. 3  is a block diagram of a head mounted system according to a second embodiment. 
         FIG. 4  is a diagram illustrating a head mounted system according to the second embodiment. 
         FIG. 5  is a flowchart of capturing a first side image according to the second embodiment. 
         FIG. 6  is a flowchart of capturing a first rear image and a second rear image according to the second embodiment. 
         FIG. 7  is a diagram illustrating a head mounted system according to a third embodiment. 
         FIG. 8  is a diagram illustrating a head mounted system according to a fourth embodiment. 
     
    
    
     DETAILED DESCRIPTION 
     First Embodiment 
     Referring to  FIGS. 1 and 2 ,  FIG. 1  is a block diagram of a head mounted system according to a first embodiment, and  FIG. 2  is a diagram illustrating a head mounted system according to the first embodiment. A head mounted system  1  is a head-mounted display (HMD), for example. The head mounted system  1  includes an abnormality sensing unit  11 , a signal processing circuit  12 , a memory  13 , an application processor  14 , an eyeglass frame  15 , a first front image capturing device  16   a , a second front image capturing device  16   b , a first side image capturing device  17   a , a second side image capturing device  17   b , a first rear image capturing device  18   a , a second rear image capturing device  18   b , a first infrared light emitting diode (LED)  19   a , a second infrared LED  19   b , a third infrared LED  19   c , and a fourth infrared LED  19   d . The abnormality sensing unit  11 , for example, is a microphone or an auxiliary image capturing device. The eyeglass frame  15  is used for carrying the abnormality sensing unit  11 , the signal processing circuit  12 , the memory  13 , application processor  14 , the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , the second rear image capturing device  18   b , the first infrared LED  19   a , second infrared LED  19   b , the third infrared LED  19   c , and the fourth infrared LED  19   d.    
     The signal processing circuit  12 , for example, is an application-specific integrated circuit (ASIC), and the signal processing circuit  12  communicates with the application processor  14  through a universal serial bus (USB). The first front image capturing device  16   a  and the second front image capturing device  16   b  are connected to the application processor  14  and communicate with the application processor  14  through a mobile interface processor interface (MIPI). The first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  are connected to the signal processing circuit  12 , and communicate with the signal processing circuit  12  through a parallel interface (I/F) or MIPI. 
     The first front image capturing device  16   a , disposed in the front of the eyeglass frame  15 , is used for capturing a first front image, and the second front image capturing device  16   b , disposed in the front of the eyeglass frame  15 , is used for capturing a second front image. The viewing angles of the first front image capturing device  16   a  and the second front image capturing device  16   b  coincide with those of the human eyes. The first side image capturing device  17   a , disposed in a first side of the eyeglass frame  15 , is used for capturing a first side image. The second side image capturing device  17   b , disposed in a second side of the eyeglass frame  15 , is employed for capturing a second side image. The first side is a right side, for example, and the second side is a left side, for example. The viewing angles of the first side image capturing device  17   a  and the second side image capturing device  17   b  are different from those of the first front image capturing device  16   a  and the second front image capturing device  16   b . The first rear image capturing device  18   a , disposed in a rear of the eyeglass frame  15 , is used for capturing a first rear image. The second rear image capturing device  18   b , disposed in the rear of the eyeglass frame  15 , is used for capturing a second rear image. The viewing angles of the first rear image capturing device  18   a  and the second rear image capturing device  18   b  are different from those of the first side image capturing device  17   a  and the second side image capturing device  17   b.    
     The first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a  and the second rear image capturing device  18   b  can cover the blind spot of human eyes. The viewing angles of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  can cover 360 degrees. 
     The first infrared LED  19   a  is disposed adjacent to the first side image capturing device  17   a , and the second infrared LED  19   b  is disposed adjacent to the second side image capturing device  17   b . The third infrared LED  19   c  is disposed adjacent to the first rear image capturing device  18   a , and the fourth infrared LED  19   d  is disposed adjacent to the second rear image capturing device  18   b . The first infrared LED  19   a , second infrared LED  19   b , third infrared LED  19   c , and the fourth infrared LED  19   d  are employed to provide auxiliary light. 
     The abnormality sensing unit  11  detects an abnormal situation. When the abnormal situation occurs, the signal processing circuit  11  outputs a warning signal AL to the application processor  14 , and makes at least one of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  start video recording. The application processor  14  receives the warning signal, and stores video data, after the video recording is started, in the memory  13 . 
     For the sake of illustration, the abnormality sensing unit  11  is implemented by a microphone, for example. The microphone senses an ambient sound. When the ambient sound is greater than a threshold, it is indicated that an abnormal situation occurs. The signal processing circuit  12  outputs a warning signal AL to the application processor  14 , and makes the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  start video recording. For example, when a vehicle, such as a motorcycle or car, honks its horn loudly, the ambient sound may be greater than the threshold. 
     Second Embodiment 
     Referring to  FIGS. 3 and 4 ,  FIG. 3  is a block diagram of a head mounted system according to a second embodiment, and  FIG. 4  is a diagram illustrating a head mounted system according to the second embodiment. The second embodiment differs from the first embodiment in that an abnormality sensing unit of the head mounted system  2  is exemplified by using a first side auxiliary image capturing device  27   a , a second side auxiliary image capturing device  27   b , a first rear auxiliary image capturing device  28   a , and a second rear auxiliary image capturing device  28   b . The first side auxiliary image capturing device  27   a  is disposed adjacent to the first side image capturing device  17   a . The second side auxiliary image capturing device  27   b  is disposed adjacent to the second side image capturing device  17   b . The first rear auxiliary image capturing device  28   a  is disposed adjacent to the first rear image capturing device  18   a , and the second rear auxiliary image capturing device  28   b  is disposed adjacent to the second rear image capturing device  18   b.    
     The first side auxiliary image capturing device  27   a , the second side auxiliary image capturing device  27   b , the first rear auxiliary image capturing device  28   a , and the second rear auxiliary image capturing device  28   b  capture ambient images. The signal processing circuit  12  determines whether an object is fast approaching according to the ambient images. When the object is fast approaching, it is indicated that the abnormal situation occurs. 
     It is noticed that the first side auxiliary image capturing device  27   a , the second side auxiliary image capturing device  27   b , the first rear auxiliary image capturing device  28   a , and the second rear auxiliary image capturing device  28   b  are auxiliary image capturing devices. The first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  are main image capturing devices. The power consumption of the auxiliary image capturing devices is less than that of the main image capturing devices. 
     For example, the resolutions of the first side auxiliary image capturing device  27   a , the second side auxiliary image capturing device  27   b , the first rear auxiliary image capturing device  28   a , and the second rear auxiliary image capturing device  28   b  are less than those of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b . Alternatively, the image capturing frequencies of the first side auxiliary image capturing device  27   a , the second side auxiliary image capturing device  27   b , the first rear auxiliary image capturing device  28   a , and the second rear auxiliary image capturing device  28   b  are less than those of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b . In this way, the power consumption of the first side auxiliary image capturing device  27   a , the second side auxiliary image capturing device  27   b , the first rear auxiliary image capturing device  28   a , and the second rear auxiliary image capturing device  28   b  may be less than that of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b , thus leading to a reduced power consumption for the system. 
     Referring to  FIGS. 3 and 5 ,  FIG. 5  is a flowchart of capturing a first side image according to the second embodiment. For the sake of illustration,  FIG. 5  illustrates capturing the first side image as an example. First, in step  501 , the first side auxiliary image capturing device  27   a  captures an ambient image, wherein the power consumption of the first side auxiliary image capturing device  27   a  is less than that of the first side image capturing device  17   a . In step  502 , the signal processing circuit  12  then performs a wide-angle lens correction on the ambient image to generate a corrected ambient image. After that, in step  503 , the signal processing circuit  12  determines whether an object is fast approaching according to the corrected ambient image. If no object is fast approaching, it is indicated that no abnormal situation occurs and step  501  is performed again. 
     Conversely, if an object is fast approaching, it is indicated that the abnormal situation occurs. As shown in step  504 , the signal processing circuit  12  outputs a warning signal AL to the application processor  14 , and the application processor  14 , for example, may inform the user of the abnormal situation through a user interface. The user interface may be implemented by using a display device or a sound reproduction device. The signal processing circuit  12  makes the first side image capturing device  17   a  start video recording. In step  505 , the first side image capturing device  17   a  then captures a first side image. In step  506 , the signal processing circuit  12  performs a wide-angle lens correction on the first side image to generate a corrected side image. After that, in step  507 , the application processor  14  stores video data in the memory  13 , and the video data includes the corrected side image. 
     Referring to  FIGS. 3 and 6 ,  FIG. 6  is a flowchart of capturing a first rear image and a second rear image according to the second embodiment. First, in step  601 , the first rear auxiliary image capturing device  28   a  and the second rear auxiliary image capturing device  28   b  capture ambient images. The power consumption of the first rear auxiliary image capturing device  28   a  is less than that of the first rear image capturing device  18   a , and the power consumption of the second rear auxiliary image capturing device  28   b  is less than that of the second rear image capturing device  18   b . In step  602 , the signal processing circuit  12  then performs a wide-angle lens correction on the ambient images to generate the corrected ambient image. After that, in step  603 , the signal processing circuit  12  determines whether an object is fast approaching according to the corrected ambient images. If no object is fast approaching, it is indicated that no abnormal situation occurs and step  601  is performed again. 
     Conversely, if an object is fast approaching, step  604  is performed. As shown in step  604 , the signal processing circuit  12  outputs a warning signal AL to the application processor  14 , and the application processor  14 , for example, may inform the user of the abnormal situation through a user interface. The user interface may be implemented by using a display device or a sound reproduction device. The signal processing circuit  12  makes the first rear image capturing device  18   a  and the second rear image capturing device  18   b  start video recording. In step  605 , the first rear image capturing device  18   a  captures a first rear image, and the second rear image capturing device  18   b  captures a second rear image. In step  606 , the signal processing circuit  12  performs a wide-angle lens correction on the first rear image to generate a first corrected rear image, and performs a wide-angle lens correction on the second rear image to generate a second corrected rear image. In step  607 , the signal processing circuit  12  combines the first corrected rear image and the second corrected rear image to generate a combined corrected rear image; this process is also called image stitching. After that, in step  608 , the application processor  14  stores video data in the memory  13 , and the video data includes the combined corrected rear image. 
     Specifically, when the auxiliary image capturing device detects an abnormal situation, the signal processing circuit  12  makes not only the main image capturing device adjacent to the signal processing circuit  12  start video recording, but also other main image capturing devices start video recording. For example, when the first side auxiliary image capturing device  27   a  detects that an abnormal situation occurs, the signal processing circuit  12  makes not only the first side image capturing device  17   a  start video recording, but also the first front image capturing device  16   a  and the second front image capturing device  16   b  start video recording. 
     In addition, the abnormality sensing unit of the head mounted system  2  may further include a microphone. When the microphone detects the abnormal situation, the signal processing circuit  11  outputs a warning signal AL to the application processor  14 , and makes at least one of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  start video recording. The application processor  14  receives the warning signal and stores the video data in the memory  13  after the video recording is started. 
     Third Embodiment 
     Referring to  FIGS. 3 and 7 ,  FIG. 7  is a diagram illustrating a head mounted system according to a third embodiment. The third embodiment differs from the second embodiment in that the abnormality sensing unit of a head mounted system  3  includes a third side auxiliary image capturing device  27   c , which is an auxiliary image capturing device. The third side auxiliary image capturing device  27   c  and the first side image capturing device  17   a  are disposed on a first side of the eyeglass frame  15 , and the power consumption of the third side auxiliary image capturing device  27   c  is less than that of the first side image capturing device  17   a.    
     It is noticed that the arrangement of the auxiliary image capturing device and the main image capturing device may be one to one, but the implementation is not limited thereto. In another embodiment, a plurality of auxiliary image capturing devices may be accompanied with a main image capturing device. In yet another embodiment, an auxiliary image capturing device may be accompanied with a plurality of main image capturing devices. As shown in  FIG. 7 , the third side auxiliary image capturing device  27   c  and the first side auxiliary image capturing device  27   a  are accompanied with the first side image capturing device  17   a . When the third side auxiliary image capturing device  27   c  and the first side auxiliary image capturing device  27   a  detect that an abnormal situation occurs, the signal processing circuit outputs a warning signal and makes the first side image capturing device  17   a  start video recording. 
     In addition, the abnormality sensing unit of the head mounted system  3  may further include a microphone. When the microphone detects the abnormal situation, the signal processing circuit  11  outputs a warning signal AL to the application processor  14 , and makes at least one of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  start video recording. The application processor  14  receives the warning signal, and stores the video data in the memory  13  after the video recording is started. 
     Fourth Embodiment 
     Referring to  FIGS. 3 and 8 ,  FIG. 8  is a diagram illustrating a head mounted system according to a fourth embodiment. The fourth embodiment differs from the second embodiment in that the abnormality sensing unit of a head mounted system  4  further includes a first front auxiliary image capturing device  26   a  and a second front auxiliary image capturing device  26   b . The first front auxiliary image capturing device  26   a  is disposed adjacent to the first front image capturing device  16   a , and the second front auxiliary image capturing device  26   b  is disposed adjacent to the second front image capturing device  16   b.    
     In addition, the abnormality sensing unit of the head mounted system  4  may further include a microphone. When the microphone detects the abnormal situation, the signal processing circuit  11  outputs a warning signal AL to the application processor  14 , makes at least one of the first front image capturing device  16   a , the second front image capturing device  16   b , the first side image capturing device  17   a , the second side image capturing device  17   b , the first rear image capturing device  18   a , and the second rear image capturing device  18   b  start video recording. The application processor  14  receives the warning signal and stores the video data in the memory  13  after the video recording is started. 
     The above embodiments provide a head mounted system that can warn the user to protect oneself when an abnormal situation occurs. In addition, when an abnormal situation occurs, the head mounted system can start video recording to record the evidence of the scene. In addition, an extended time for self-protection with reduced power consumption can be achieved since the power consumption of the abnormality sensing unit is less than that of the main image capturing device and the main image capturing device is activated as an abnormal situation occurs. 
     While the disclosure has been described by way of example and in terms of the preferred embodiment(s), it is to be understood that the disclosure is not limited thereto. On the contrary, it is intended to cover various modifications and similar arrangements and procedures, and the scope of the appended claims therefore should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements and procedures.