Patent ID: 12253671

DETAILED DESCRIPTION

FIGS.1-7illustrate a device for a multi-task augmented reality heads up display18(MTAR-HUD)10according to an embodiment of the invention. It will be apparent to those skilled in the art from this disclosure that the following descriptions of the embodiments are provided for illustration only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.

As illustrated inFIG.1, the MTAR-HUD10can be inserted to or coupled between a conventional night vision device12and a conventional eyepiece14. Thus, as one of ordinary skill would understand, the MTAR-HUD10can enhance and improve a conventional night vision device12by coupling to the night vision device12using the existing coupling mechanisms. As illustrated in this embodiment, the MTAR-HUD10can be threaded to the night vision device12and the eyepiece14. It is noted that such a coupling is merely one embodiment and the MTAR-HUD10can couple to a night vision device12in any manner desired or be integrated into a night vision device12.

Moreover, as can be understood, the MTAR-HUD10can be used without connection to a night vision device12. That is, the MTAR-HUD10can be operated as a standalone device capable of viewing an image and recording the image, while providing a heads up display18of information, as discussed herein.

As can be understood, when attached to a night vision device12, the MTAR-HUD10improves the basic operation of the night vision device12by providing a heads up display18and providing recording capabilities. In one embodiment, the night vision device12can be night vision googles (optoelectronic devices) that enable visualization of images in low levels of light, improving night vision. These devices can enhance ambient visible light and convert near-infrared light into visible light which can be seen by the user; this is known as image intensification. By comparison, viewing of infrared thermal radiation is referred to as thermal imaging and operates in a different section of the infrared spectrum.

Generally, a night vision device12includes an image intensifier tube12A, a protective housing12B, an eyepiece14and can have some type of mounting system12C. The image produced by a night vision device12is typically monochrome green, as green is considered to be the easiest color to view for prolonged periods in the dark. Night vision devices can be passive, relying solely on ambient light, or may be active, using an IR (infrared) illuminator to better visualize the environment.

Night vision devices can be handheld but many are head-mounted and attach to helmets or other head-mountable gear. When used with firearms, an IR laser sight is often mounted to the user's weapon. The laser sight produces an infrared beam that is only visible through a night vision device12and aids with aiming. Some night vision device12sare specially made to be mounted to firearms. These can used in conjunction with weapon sights like rifle scopes or can be used as standalone sights; some thermal weapon sights have been designed to provide similar capabilities.

The device herein can be used in conjunction with desirable night vision device and is not limited to the specific embodiments set forth herein. It is also noted that, as discussed herein, the MTAR-HUD10can be used by itself to view images, record images and data, and provide desired overlay data on an image, among other things.

As illustrated inFIGS.2-8, in one embodiment, the MTAR-HUD10can be encased in a cylindrical rugged housing16. This housing16can be similarly sized to a night vision device12and/or an eyepiece14, such that the night vision device12does not become overly bulky and/or maintains the aesthetics or operability of the corresponding night vision device12and/or eyepiece14. The housing16protects the internal components to ensure that the MTAR-HUD10is useful in extreme situations. For example, the housing16can be waterproof and/or resistant to impact that would otherwise damage or destroy the internal components of the device. It is noted that the MTAR-HUD10can be any size or shape desired and be formed of any material.

The housing16can have a display18at a first end20, a lens for a camera24at a second or opposite end, and can also have an input (video in) connection26and output (video out) connection28to enable uploading or downloading data or information to the device. Although it is noted that data can be uploaded or downloaded in any desired wired or wireless manner. For example, the data can be uploaded or downloaded via BLUETOOTH, or a cellular or satellite network or in any wireless manner, as discussed in more detail below. The housing16is sized and configured to enable the MTAR-HUD10to house components therein to covert images captured by the camera24to be displayed in the display18.

FIG.8illustrates the components of the MTAR-HUD10disposed within the housing16. As noted, images pass from the image intensifier tube12A of the night vision device12(or from the surrounding area if used without a night vision device12) and into the MTAR-HUD10. In particular, the enhanced image from the night vision device12passes through a lens30in the MTAR-HUD10and into a camera24. The lens30can be any suitable lens, such as a convex lens that enables the image to be focused onto the camera24. The camera24captures the image and transmits the image to a multiplexer32. As can be understood, the multiplexer32is a device that enables one or more analog or digital input signals to travel together over the same communications transmission link. Here, any suitable multiplexer can be used. The multiplexer32can also be in communication with the video in connection26, so that video from another device can communicate images into the MTAR-HUD10. In other words, the multiplexer32can receive images or image information from the camera24and the video in connection26. The video in connection26can be any suitable connection that enables an external electrical component to be connected thereto.

The multiplexer32can transmit the information from the camera24and/or the video in connection26to a video decoder34. The video decoder34is an electronic circuit, and can be a single integrated circuit chip, that converts base-band analog video signals to digital video. In some embodiments, the video decoder34can enable programmable control over video characteristics such as hue, contrast, and saturation. The video decoder34then sends the information to a On screen Display subsystem (OSD)36.

The OSD36is a sub system that generally combines the image information with sensor data information or overlay information. The subsystem can include an electronic controller that contains the software that processes information. Thus, as can be understood, the OSD36can include a microcomputer with a control program that controls the MTAR-HUD10. The OSD36can also include other conventional components such as an input interface circuit, an output interface circuit, and storage devices such as a ROM (Read Only Memory) device and a RAM (Random Access Memory) device. The memory circuit stores processing results and control programs such as ones for operation that are run by a processor circuit. The OSD36is operatively coupled to the elements in the device in a conventional manner. The internal RAM of the OSD36stores statuses of operational flags and various control data. The OSD36can be capable of selectively controlling any of the components of the device in accordance with a control program. It will be apparent to those skilled in the art from this disclosure that the precise structure and algorithms for the OSD36can be any combination of hardware and software that will carry out the functions of the embodiments of the present invention.

The MTAR-HUD10includes sensors38and/or location determination devices40or any other positioning devices or sensors38. The MTAR-HUD10can include an inclinometer, an accelerometer, a stadiametric rangefinder, a compass, as well as a real time clock. Many of these devices can be part of an internal measurement unit (IMU)42. The IMU42can include pitch, roll, yaw and stadiametric rangefinder sensors38, or any other device that enables internal measurement of the MTAR-HUD10. Thus, the MTAR-HUD10can determine the angles for pitch, roll and yaw and range or distance readings. In one embodiment, the IMU42is an inertial measurement unit that measures and reports the specific force, angular rate, and the orientation of the housing16, using a combination of accelerometers, gyroscopes, and/or magnetometers. In this embodiment, the IMU42can detect linear acceleration using one or more accelerometers and rotational rate using one or more gyroscopes. In one embodiment, the IMU42includes an accelerometer, gyro, and magnetometer per axis for each of the three principal axes: pitch, roll and yaw.

The location determination device40can be any suitable device, such as the global positioning system (GPS). The location determination device40can be any suitable system that enables accurate or desired location to be determined.

The information from the IMU42and the location determination device40is communicated to an electronic control module (ECM)44. Similarly to the OSD36, the ECM44can include a microcomputer with a control program that controls the IMU42and the location determination system and any other sensors38or devices that provide information to be overlayed on the image from the camera24. The ECM44can also include other conventional components such as an input interface circuit, an output interface circuit, and storage devices such as a ROM (Read Only Memory) device and a RAM (Random Access Memory) device. The memory circuit stores processing results and control programs such as ones for operation that are run by a processor circuit. The ECM44is operatively coupled to the elements in the device in a conventional manner. The internal RAM of the ECM44stores statuses of operational flags and various control data. The ECM44can be capable of selectively controlling the components of the IMU42and the location determination device40and any other sensors38or devices that provide information to be overlayed on the image from the camera24in accordance with a control program. It will be apparent to those skilled in the art from this disclosure that the precise structure and algorithms for the ECM44can be any combination of hardware and software that will carry out the functions of the embodiments of the present invention.

The ECM44can control the information from the IMU42and the IMU42and the location determination device40and any other sensors38or devices that provide information to be overlayed on the image from the camera24. In other words, the ECM44is configured to control the sensor information (data) that is collected using the sensors38and/or location determination device40. This information is communicated to the OSD36.

The OSD36can combine the information into the desired transmission. For example, the OSD36can process the data from the video encoder46and combine this information with the information from the ECM44. Thus, the OSD36provides a data output that overlies the information from the IMU42and the location determination device40onto the video. The OSD36transmits this combined information through three separate outputs to: 1) the video encoder46; 2) the video display18; and 3) a digital video reorder (DVR)48. While in this embodiment, the OSD36transmits this combined information through three separate outputs, it is noted that in other embodiments OSD36can transmit the combined information through one, two or more than three separate outputs. For example, in one embodiment, the OSD36can transmit the combined information to only the display18.

Similarly to the video decoder34, the video encoder46is an electronic circuit, and can be contained within a single integrated circuit chip. However, the video encoder46converts the digital video to analog video, and sends this analog video to the video out connection28. The video can then be viewed through a separate viewing device connected to the MTAR-HUD10through the video out connection28. The video out connection28can be any suitable connection that enables an external electrical component to be connected thereto.

The OSD36can also transmit the combined information to the DVR48which can store data on a micro SD card50(or any other suitable storage device). Thus all imagery from the image intensifier tube12A (or external area) and the data from the IMU42and the location determination system can be recorded and stored on a micro SD card50for viewing at a later time or long term storage.

Additionally, the combined information can be wirelessly transmitted to a remote location. Such transmission can be transmitted via transmitter60. As can be understood, the combined information can be transmitted through any wireless transmission device or system desired, such as Bluetooth, satellite communication, LTE or another in any other suitable manner. Thus, as can be understood, near field communication can be established, such that users in your vicinity can view the same combined information as the user, and/or the combined information can be viewed in a remote location far from the user (i.e., in any location through satellite communications or LTE or other communication or data transmission systems).

Furthermore, as noted inFIG.2, the ECM44can transmit the data from the sensors38and the location determination device40to the DVR48.

The OSD36can also transmit the combined information to the video display18. The video display18can thus enable images captured by the camera24to be viewed with desired data and/or information overlayed on the images. For example, the display18can display range to a target as well as specific positioning location and pitch, roll and/or yaw of the MTAR-HUD10. It is noted that the data overlay is not limited to the examples herein and the image overlay can be any desired information or combination of information.

In one embodiment the MTAR-HUD10includes a mounting bracket or element58. The mounting element58enables the MTAR-HUD10to be mounted to a device or wearable article to enable hands free operation by the user. As can be understood, the mounting element58can be used when the MTAR-HUD10is used as a stand alone device, or in addition to or in replacement of the mounting bracket of the night vision device12.

Moreover, as can be understood, an operator or user can point the MTAR-HUD10by itself in the direction of an object and receive the desired image with data overlay. That is, the MTAR-HUD10can be operated by itself to view images with desired data overlayed thereon. Similarly to as described above, the images with the overlay can be stored in a storage device (such as an SD card50) or it can be viewed or stored by a device connected to the video out connection28.

In another embodiment, the MTAR-HUD10can be connected to the eyepiece14that further allows the images with desired data overlayed thereon. In other words, the images with desired data overlayed thereon can be connected to only an eyepiece14that increases viewing of the images captured by the camera24. Similarly to as described above, the images with the overlay can be stored in a storage device (such as an SD card50) or it can be viewed or stored by a device connected to the video out connection28.

In a further embodiment, the MTAR-HUD10can be coupled to the image intensifier tube12A and/or the eyepiece14. In this embodiment, the MTAR-HUD10is able to transform a conventional night vision monocular (that cannot record, or stream video—due to only providing an analogue signal, and video recording requiring a digital signal) into a recording unit. As illustrated inFIG.2, the MTAR-HUD10enables communication between the night vision device12and the MTAR-HUD10encoder46that takes the video from analogue signal (from the image intensifier tube12A) and the decoder34that converts the video into digital signal and produces it on screen of the display18. Additionally, via the established communication of the encoder46with the operating system deployment, other information can be produced as an overlay on top of the night vision image on display18of the MTAR-HUD10unit, that is currently not available to the operator on one device, from GPS, inclinometer, accelerometer, stadiametric rangefinder, compass, as well as a date stamp or real time clock. In other words, data from the GPS unit and/or the internal measurement unit can provide overlay information to the user. SeeFIG.10.

The housing16of the MTAR-HUD10can also include a power supple unit54disposed therein. The power supply unit54can be any suitable battery (either replaceable and/or rechargeable) or any other desired power supply device that would be suitable.

FIG.9illustrates a conventional night vision device display andFIG.10illustrates the display18of the MTAR-HUD10. In the embodiment illustrated inFIG.10, information such as GPS coordinates, inclinometer, accelerometer, stadiametric rangefinder, compass, as well as a date stamp or real time clock can be displayed. It is noted that such display information is exemplary only and the MTAR-HUD10can display any suitable or desired information. The MTAR-HUD10can thus improve a night vision device12by displaying an array of vital readings for IMU42max situational awareness. Each of these data elements can be displayed or hidden through the device's menu to show an operator or user only information needed a particular situation. Thus, the user can customize the display of information through a user input56, reducing operator distraction and improving focus on objectives. As seen inFIGS.2and6, the user can operate buttons56a-56dto scroll through a menu or list of options to specifically enable certain parameters or information to be displayed. In one embodiment, the user input can be in communication with the ECM44.

Utilizing the disclosed components, embodiments of the invention provide a unique software to process all the signals onto a display18for the operator.

As illustrated inFIG.11, the MTAR-HUD10does not necessarily need to be used with a night vision device12, and can be used as a standalone device, camera24with recording capability, and other data (GPS, compass etc.) produced on screen. In other words, the MTAR-HUD10, can be coupled to an eyepiece14and used as a camera24to view images without the night vision aspect. In such a configuration the device would maintain the recording capability and the overlay capabilities described above.

Thus, the displayed image can be sourced from the night vision device12via conversion of parts of MTAR-HUD10and a night vision unit, or it can also independently source imagery via a camera24that is part of the MTAR-HUD10unit.

FIGS.11and12illustrate the process of attaching the MTAR-HUD10to the night vision device12, such as a night vision monocular. As can be understood, no special tools or skills are needed to the device to the night vision device12, and the operation can take less that one minute to complete, even in stressful field conditions.

In the first step600, the front part52of the MTAR-HUD10is removed. The front part52can be a suitable device or element from protecting the lens30of the MTAR-HUD10. In the next step (second step602), the eyepiece14is removed from the night vision device12. In the third step604, the MTAR-HUD10is placed between the body (or the image intensifier tube12A) of the night vision device12and the eyepiece14. The eyepiece14and the image intensifier tube12A of the night vision device12are attached to the MTAR-HUD10. In this embodiment, the thread22aon the front or send end22of the MTAR-HUD10is compatible with the thread on the night vision monocular, and the thread20aon the back or first end20of the MTAR-HUD10is compatible with the eyepiece14. In the fourth step606, it can be seen that the night vision monocular (night vision device12) can be transformed into a full-scale tactical surveillance station. It is noted that while an embodiment is illustrated being connected to a night vision monocular, the present invention can be used with any type of night vision device12.

Embodiments of the present invention have advantages over the conventional devices. For example, embodiments described herein 1) can be used as a solitary camera or in conjunction with a night vision device12; 2) can provide on-screen display18information that includes necessary or helpful information; 3) can enhance situational awareness; 4) are useful in handheld applications; 5) are mountable to a helmet enabling handsfree use; 6) can include GPS location; 7) can include magnetic and gyroscopic compass modes; 8) can simultaneously record and stream video; 9) are compact, rugged and lightweight; and 10) fit most existing monocular night vision device12s.

The night vision device12and the eyepiece14are conventional components that are well known in the art. Since the night vision device12and the eyepiece14are well known in the art, these structures will not be discussed or illustrated in detail herein. Rather, it will be apparent to those skilled in the art from this disclosure that the components can be any type of structure and/or programming that can be used to carry out the embodiments of the present invention.

In understanding the scope of the present invention, the term “comprising” and its derivatives, as used herein, are intended to be open ended terms that specify the presence of the stated features, elements, components, groups, integers, and/or steps, but do not exclude the presence of other unstated features, elements, components, groups, integers and/or steps.

The term “configured” as used herein to describe a component, section or part of a device includes hardware and/or software that is constructed and/or programmed to carry out the desired function.

While only selected embodiments have been chosen to illustrate the present invention, it will be apparent to those skilled in the art from this disclosure that various changes and modifications can be made herein without departing from the scope of the invention as defined in the appended claims. For example, the size, shape, location or orientation of the various components can be changed as needed and/or desired. Components that are shown directly connected or contacting each other can have intermediate structures disposed between them. The functions of one element can be performed by two, and vice versa. The structures and functions of one embodiment can be adopted in another embodiment. It is not necessary for all advantages to be present in a particular embodiment at the same time. Every feature which is unique from the prior art, alone or in combination with other features, also should be considered a separate description of further inventions by the applicant, including the structural and/or functional concepts embodied by such feature(s). Thus, the foregoing descriptions of the embodiments according to the present invention are provided for illustration only, and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.