Patent Publication Number: US-2021168334-A1

Title: Data communication between image sensors and image displays

Description:
INCORPORATION BY REFERENCE TO ANY PRIORITY APPLICATIONS 
     Any and all applications for which a foreign or domestic priority claim is identified in the Application Data Sheet as filed with the present application are hereby incorporated by reference under 37 CFR 1.57. 
     BACKGROUND 
     Field of the Invention 
     The present disclosure relates to imaging, and more particularly to communicating image data between image sensors and displays, such as between weapon sights and goggle displays. 
     Description of the Related Art 
     Digital weapon sights are commonly used to generate imagery corresponding to the heading of a weapon. The imagery can be communicated to a display remote from the digital weapon site, such as in a helmet mounted goggle display, where the imagery from the digital weapon sight can be incorporated into imagery corresponding the field of view of goggles. This can provide the user awareness of heading of the weapon in relation to the orientation of the goggles, facilitating use of the weapon via the goggle display. In some goggle systems a user can toggle between a weapon sight-in-goggle and a reticle-in-goggle mode. These modes allow a user to be aware of digital weapon sight heading relative to goggles field of view, typically by overlaying a reticle representative of the digital weapon sight heading or actual video of where the digital weapon sight is heading in the helmet mounted goggle display. 
     Communicating video data from a digital weapon sight to a helmet mounted goggle display generally requires power. During intervals where heading of the digital weapon sight is outside the field of view of the goggle video data from the digital weapon can be of limited use, and the power consumption associated with communicating the video unnecessary. 
     Such conventional methods and systems have generally been considered satisfactory for their intended purpose. However, there is still a need in the art for improved data communication between digital weapon sights and helmet mounted displays. The present disclosure provides a solution for this need. 
     SUMMARY OF THE INVENTION 
     An imaging method includes determining heading of a digital weapon sight, determining heading of a helmet mounted display, and calculating difference between the heading of the digital weapon sight and the heading of the helmet mounted display. When the difference between the heading of the digital weapon sight and the heading of the helmet mounted display is outside of a predetermined range image data communication between the digital weapon sight and the helmet mounted display is disabled. 
     In certain embodiments image data communication between the digital weapon sight and the helmet mounted display can be enabled when the difference between the heading of the digital weapon sight and the heading of the helmet mounted display is outside of the predetermined range. The heading difference can be calculated at the digital weapon sight. The heading difference can be calculated at the helmet mounted display. Heading of the digital weapon sight can be communicated to the helmet mounted display using a low-bandwidth wireless channel. Heading of the helmet mounted display can be communicated to the digital weapon sight using a low-bandwidth wireless channel. 
     In accordance with certain embodiments image data communication between the digital weapon sight and the helmet mounted display using the high-bandwidth wireless channel can cease once image data communication is disabled. The method can include establishing a radio frequency link between the digital weapon sight and the helmet mounted display. The radio frequency link can have a low-bandwidth wireless channel and a high-bandwidth wireless channel. Inertial data can be collected at the digital weapon sight. Inertial data can be collected at the helmet mounted display. Inertial data can be generated at both the digital weapon sight and the helmet mounted display. 
     It is also contemplated that, in accordance with certain embodiments, the method can include toggling the helmet mounted display into a reticle pop-up mode, displaying a reticle in the helmet mounted display, and removing the reticle from the helmet mounted display when the difference between the heading of the digital weapon sight and the heading of the helmet mounted display is outside of a predetermined range. The reticle can be removed from the helmet mounted display while the helmet mounted display remains in the reticle pop-up mode. The reticle can be returned to the helmet mounted display when the difference between the heading of the digital weapon sight and the heading of the helmet mounted display is outside of a predetermined range. 
     An imaging system includes a digital weapon sight with an inertial measurement unit (IMU), a helmet mounted display with an IMU, and a wireless module coupling the sight to the helmet mounted display. A controller is operatively connected to the wireless module and responsive to instructions recorded on a memory to determine heading of a digital weapon sight, determine heading of a helmet mounted display, and calculate difference between the heading of the digital weapon sight and the heading of the helmet mounted display. The controller disables image data communication between the digital weapon sight and the helmet mounted display when the difference between the heading of the digital weapon sight and the heading of the helmet mounted display is outside of a predetermined range. 
     In certain embodiments the digital weapon sight can include an image sensor. The wireless module can couple the digital weapon sight image sensor to the helmet mounted display. The helmet mounted display can include an image sensor and a display. The helmet mounted display image sensor can have a field of view. The instructions can cause the controller to disable image data communication between the digital weapon sight and the helmet mounted display when heading of the digital weapon scope is outside of the field of view of the helmet mounted display image sensor. The helmet mounted display can be a goggle display. 
     In accordance with certain embodiments, the instructions can cause the controller to enable image data communication between the digital weapon sight and the helmet mounted display when the difference between heading of the digital weapon sight and heading of the helmet mounted display is outside of the predetermined range. The controller can be fixed relative to the helmet mounted display. The controller can be disposed in communication with the digital weapon sight IMU or the helmet mounted display IMU through the wireless module. 
     It is contemplated that the wireless module can include a low-bandwidth channel and a high-bandwidth channel. The controller can be disposed in communication with the weapon sight IMU or the helmet mounted display IMU through the low-bandwidth channel. The digital weapon sight can be disposed in communication with the helmet mounted display through the high-bandwidth channel. The digital weapon sight can include a scope with an imaging array. 
     A weapon assembly includes a weapon, imaging system as described above, and a battery. The digital weapon sight is fixed relative to the weapon and the helmet mounted display is movable relative to the weapon such that heading of the digital weapon sight can be outside a field of view of the helmet mounted display. The battery is in electrical communication, i.e., is electrically connected, with the imaging system, the controller disabling of the data communication between the digital weapon sight and the helmet mounted display conserving battery life when heading of the digital weapon sight is outside the field of view of the helmet mounted display. 
     These and other features of the systems and methods of the subject disclosure will become more readily apparent to those skilled in the art from the following detailed description of the preferred embodiments taken in conjunction with the drawings. 
    
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
       So that those skilled in the art to which the subject disclosure appertains will readily understand how to make and use the devices and methods of the subject disclosure without undue experimentation, embodiments thereof will be described in detail herein below with reference to certain figures, wherein: 
         FIG. 1  is a schematic view of view of an exemplary embodiment of a weapon assembly constructed in accordance with the present disclosure, showing an imaging system include a helmet mounted display and a digital weapon site; 
         FIG. 2  is a schematic view of the helmet mounted display of  FIG. 1 , showing elements of the helmet mounted display including an image sensor a field of view and a display module; 
         FIG. 3  is a schematic view of the digital weapon sight of  FIG. 1 , showing elements of the digital weapon sight including an image sensor with heading and a wireless module; 
         FIGS. 4A and 4B  are schematic views of the imaging system of  FIG. 1 , showing a controller disabling and enabling image data communication between the digital weapon sight image sensor and the helmet mounted display according to whether heading of the digital weapon sight is within the field of view of the helmet mounted display image sensor; and 
         FIG. 5  is block diagram of an imaging method, showing steps of the imaging method according to an exemplary embodiment. 
     
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
     Reference will now be made to the drawings wherein like reference numerals identify similar structural features or aspects of the subject disclosure. For purposes of explanation and illustration, and not limitation, a partial view of an exemplary embodiment of an imaging system in accordance with the disclosure is shown in FIG. I and is designated generally by reference character  100 . Other embodiments of imaging systems, imaging methods, and weapon assemblies in accordance with the disclosure, or aspects thereof, are provided in  FIGS. 2-5 , as will be described. The systems and methods described herein can be used for image data communication between digital weapon sights and helmet mounted displays, such as in imaging systems include helmet mounted goggle displays and digital weapon sights in soldier kit, though the present disclosure is not limited to goggle displays to military applications in general. 
     Referring to  FIG. 1 , a weapon assembly  200  is shown. Weapon assembly  200  includes a weapon  202 , imaging system  100 , and one or more battery  204 . Imaging system  100  includes a digital weapon sight  102  and a helmet mounted display  104 . Digital weapon sight  102  is fixed relative to weapon  202  and helmet mounted display  104  is movable relative to weapon  202  such that heading  10  of digital weapon sight  102  can be outside a field of view  12  of helmet mounted display  104 . Battery  204  is in electrical communication with imaging system  100  and controller  106  operative to disable image data communication between digital weapon sight  102  and helmet mounted display  104  to limit power consumption when the heading  10  of digital weapon sight  102  is outside the field of view  12  of helmet mounted display  104 . 
     With reference to  FIG. 2 , digital weapon sight  102  is shown. Digital weapon sight  102  is configured and adapted for fixation to weapon  202  (shown in  FIG. 1 ), such as by being coaxially aligned with a bore of the weapon  202 , and includes an image sensor  108 , an inertial measurement unit (IMU)  110 , a wireless module  112 , and a controller  114 . Image sensor  108  is aligned along the heading  10  (shown in  FIG. 1 ) of digital weapon sight  102 , includes a photodiode array, and is configured and adapted for generating image data  26  of a scene  18  in the direction the heading  10  of digital weapon sight  102 . IMU  110  is configured and adapted for generating heading data  20  indicative of heading  10  (shown in  FIG. 1 ) of digital weapon sight  102 . Heading data  20  can be, for example, indicative of azimuth and elevation of digital weapon sight  102  by way of non-limiting example. In certain embodiments IMU  110  can include one or more a gyroscope and/or accelerometer. In the exemplary embodiment shown in  FIG. 2  digital weapon sight  102  is incorporated in a scope. 
     Wireless module  112  is configured and adapted for communicating wirelessly with helmet mounted display  104  (shown in  FIG. 1 ). In this respect wireless module  112  is configured and adapted for passing heading data  20  over a low-bandwidth channel  22  (shown in  FIG. 1 ) coupling digital weapon sight  102  with helmet mounted display  104 . Wireless module  112  is additionally configured and adapted for passing image data  26  over a high-bandwidth channel  24  (shown in  FIG. 1 ) coupling digital weapon sight  102  with helmet mounted display  104 . 
     Controller  114  is disposed in communication with IMU  110  and is operatively connected to both image sensor  108  and wireless module  112  for controlling communication at least one of heading data  20  and/or image data  14  between digital weapons sight  102  and helmet mounted display  104  (shown in  FIG. 1 ). In this respect controller  114  includes an interface  116 , a memory  118 , and a processor  120  disposed in communication with interface  116  and memory  118 . Memory  118  has a plurality of program modules  122  recorded on it that, when read by processor  120 , cause processor to execute certain operations, e.g., operations of an imaging method  200 . In this regard controller  114  is arranged to selectively communicate image data between digital weapon sight  102  and helmet mounted display  104 , digital weapon sight  102  passing image data  26  to helmet mounted display  104  when heading  10  is within field of view  12 , digital weapon sight  102  passing image data  26  to helmet mounted display  104  when heading  10  is outside field of view  12 . This reduces power drawn from battery  202  (shown in  FIG. 1 ). 
     With reference to  FIG. 3 , helmet mounted display  104  is shown. Helmet mounted display  104  is configured and adapted for mounting to a helmet and includes and includes image sensor  124 , an IMU  126 , and a wireless module  128 . Helmet mounted display  104  also includes a display  130  and a controller  132 . In the illustrated exemplary embodiment helmet mounted display  104  is integrated into a set of goggles, the goggles in tum being mounted to a helmet. As will be appreciated by those of skill in the art in view of the present disclosure, other types of display devices can benefit from the present disclosure. 
     Image sensor  124  has field of view  12  (shown in  FIG. 1 ) and is configured and adapted for generating image data  30  of scene  18  (shown in  FIG. 1 ). IMU  126  is configured and adapted for generating heading data  32  indicative of the heading  12  of helmet mounted display  104 . Heading data  32  can be, for example, indicative of azimuth and elevation of helmet mounted display  104  by way of non-limiting example. In certain embodiments IMU  126  can one or more gyroscope and/or accelerometer. 
     Wireless module  128  is configured and adapted for communicating wirelessly with digital weapon sight  102  (shown in  FIG. 1 ). In this respect wireless module  112  is configured and adapted for passing heading data  20 , received from digital weapon sight  102  via low-bandwidth channel  22 , to controller  132 . Wireless module  112  is also configured and adapted for receiving image data  26 , received via high-bandwidth channel  24  coupling digital weapon sight  102  and helmet mounted display  104 , from digital weapon sight  102 . 
     Controller  132  is disposed in communication with IMU  126  and is operatively connected to image sensor  124 , wireless module  128 , and display  130  for displaying at least one of image data  26  from the image sensor  108  of digital weapon sight  102  and the image data  30  from image sensor  124  of helmet mounted display  104 . In this respect controller  132  includes an interface  134 , a memory  136 , and a processor  138  disposed in communication with interface  134  and memory  136 . Memory  136  has a plurality of program modules  140  recorded on it that, when read by processor  138 , cause processor  138  to execute certain operations, e.g., the operations of imaging method  200  (shown in  FIG. 5 ). It is contemplated that controller  132  can be implemented with circuitry, software, or a combination or circuitry and software. 
     With reference to  FIGS. 4A and 4B , display  130  is shown with imaging system  100  in reticle “pop-up” mode. In certain embodiments the instruction recorded in program modules  122  detect instances where difference between heading  10  of digital weapon sight  102  and heading  26  of helmet mounted display  104  is such that heading  10  is outside the field of view  12  of helmet mounted display  104 . Upon detection of such instances controller  114  throttles down video transmission between digital weapon sight  102  and helmet mounted display  104 , reducing power draw from battery  204  (shown in  FIG. 1 ). For example, the instructions recorded on program modules  122  can cause controller  114  to disable communication of image data  14  between digital weapon sight  102  and helmet mounted display  104  when heading  10  of digital weapon scope  102  is outside of field of view  12  of an image sensor  124  (shown in  FIG. 3 ) of helmet mounted display  104 . 
     With reference to  FIG. 5 , imaging method  200  is shown. Imaging method  200  includes determining heading of a digital weapon sight, e.g., digital weapon sight  102  (shown in  FIG. 1 ), as shown with box  230 . Imaging method  200  also includes determining heading of a helmet mounted display, e.g., helmet mounted display  104  (shown in  FIG. 1 ), as shown with box  240 . Difference between the heading of the digital weapon sight and the helmet mounted display is calculated, as shown with box  250 . The difference between heading of the digital weapon sight and the helmet mounted display is compared to a predetermined range, as shown with box  260 . 
     If the difference is within the predetermined range image data communication between digital weapon sight and the helmet mounted display is enabled, as shown in box  262 , and image data acquired from the digital weapon sight image senor is inserted into image data acquired by the helmet mounted display image sensor, as shown with box  264 . If the difference is outside of the predetermined range image data communication between digital weapon sight and the helmet mounted display is disabled, as shown in box  266 , and image data acquired by the helmet mounted display image sensor without image data from the digital weapon sight image sensor, as shown with box  268 . It is contemplated that power can be removed from the transceivers associated with the high-bandwidth data channel and/or the digital weapon sight image sensor when image data communication between the digital weapon sight and helmet mounted display is disabled. 
     Heading can be determined using inertia data. In this respect it is contemplated that inertial data be generated at both the digital weapon sight and the helmet mounted display, as shown with bracket  230 . Inertial data can be collected at the digital weapon sight by communicating the inertial data generated at the helmet mounted display to the digital weapon sight, as shown with box  242 . Inertial data can be collected at the helmet mounted display by communicating the inertial data generated at the digital weapon side to the helmet mounted display, as shown with  240 . In certain embodiment inertial data can be collected at the helmet mounted display by communicating the inertial data collected at the digital weapon sight to the helmet mounted display, as shown with box  232 . 
     It is contemplated that imaging method  200  include establishing a radio frequency link between the digital weapon sight and the helmet mounted display, as shown with box  220 . Establishing the radio frequency link includes establishing a low-bandwidth wireless channel, e.g., low-bandwidth channel  22  (shown in  FIG. 1 ), between the digital weapon sight and the helmet mounted display, as shown with box  222 . Establishing the radio frequency link also includes establishing a high-bandwidth wireless channel, e.g., high-bandwidth channel  24  (shown in  FIG. 1 ), between the digital weapon sight and the helmet mounted display, as shown with box  224 . The heading data is communicated between the digital weapon sight and the helmet mounted display using the low-frequency channel. 
     It is also contemplated that, in accordance with certain embodiments, the method can include toggling the helmet mounted display into a reticle pop-up mode, e.g., reticle pop-up module  16  (shown in  FIGS. 4A and 4B ), as shown in  FIG. 210 . When in reticle pop-up mode a reticle can be displayed in the helmet mounted display during time intervals that the heading of the digital weapon sight is within the field of view of the helmet mounted display, as shown in with box  264 . When in reticle pop-up mode the reticle can be removed from the helmet mounted display during time intervals that the heading of the digital weapon sight is outside the field of view of the helmet mounted display, as shown in with box  268 . As will be appreciated by those of skill in the art in view of the present disclosure, disabling image data communication between the digital weapon sight and the helmet mounted display when the digital weapon sight is outside the field of view of the helmet mounted display can reduce power consumption of imaging system  100  (shown in  FIG. 1 ) without degrading functionality of the imaging system. 
     The methods and systems of the present disclosure, as described above and shown in the drawings, provide for imagine systems, weapon assemblies, and imaging methods with superior properties including reduction in the power required to display image data acquired by a digital weapon sight in image data acquired by a helmet mounted display by disabling image data communication from the digital weapon sight when the digital weapon sight and helmet mounted display are not heading in the same direction. While the apparatus and methods of the subject disclosure have been shown and described with reference to preferred embodiments, those skilled in the art will readily appreciate that changes and/or modifications may be made thereto without departing from the scope of the subject disclosure.