Patent ID: 12235408

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS OF THE INVENTION

Embodiments provide improved systems and methods for gathering information during a wildfire or other short term event (e.g., days to weeks to months), typically from multiple (2 or more, 10 or more or even 100 or more) Real-Time unmanned Surveillance and Data Acquisition sensor array Units (RTSDAUs) or more simply Data Acquisition Units (DAUs) deployed at strategic locations around a fire (e.g., on ridges, in valleys or canyons, around escape routes, around structures, and the like) or other situations (e.g., post wildfire slide or mudflow regions) that could benefit from monitoring. Such apparatus may include one or more working heads that may include various sensors, actuators, a housing, shields, water jackets, batteries, battery charging systems (solar, wind, thermal electric generators, or the like), one or more fixed, adjustable, or even actuatable legs for positioning and orienting the working heads (e.g., 5-8 feet, or more, off the ground with, for example, a nominally horizontal primary orientation), open or windowed housings, motors or actuators for reorienting position (e.g., of camera viewing direction). In some implementations, batteries may be located away from the working heads, e.g., in shielded housings on the ground at the base of a DAU. Gathered data is transmitted by RF, wired, or other wireless technology to local or central command centers where the data is received directly by one or more command and control consoles, CCC (e.g., computers and display panels running specialized software). In some cases, particularly when the monitored area is not too large, the CCC might take the form of a laptop, tablet, cell phone, or the like while in other cases, e.g., when a larger area to be monitored exists, the CCC functionality might be divided between multiple laptops, or the like, and may also use supplemental displays (e.g., LED, LCD, plasma displays, projectors, or the like). The data display may occur via text but in the most preferred embodiments, most data is displayed in a graphical or image-based format over a map (e.g., a topo map, a satellite image, a real-time visual image, or IR image gathered by a satellite, drone, helicopter, or the like) of the region based on GPS coordinates of the individual DAUs. Information gathered and transmitted may include for example wind direction, wind speed, air temperature, humidity, barometric pressure, directional IR levels around and above the sensor array, visual images and/or IR images, GPS coordinators, compass direction, gravity direction (e.g., this may be used to detect systems that have fallen over), DAU status, and the like. In the most preferred embodiments imaging systems will provide vision capability in multiple directions (e.g., forward-backward, side-to-side, in 60-degree intervals circumferentially around the array and possibly above the array or at various angles (e.g., to provide visual or IR imaging of ember movement), and/or or they may be directable in a programmed or commanded manner. IR imaging sensors may measure relevant IR information associated with a fire using filtered wavelength bands that are non-existent in ground level solar radiation so that solar radiation doesn't blind or otherwise interfere with the detection of flying embers or relevant fire related detections. In some embodiments, actuated camera scanning may be eliminated. In some embodiments, still or video camera functionality may be completely eliminated in favor of directional IR sensing. In some embodiments imaging system orientation may be dictated by the wind direction. In some implementations, DAUs or at least the sensor array portions thereof (e.g., working heads), may be actuatable between a primary functioning mode and a protected mode (e.g., turtle mode), wherein the most sensitive sensor array elements or costly sensor array elements forming part of a DAU are withdrawn into a protective shield (which may include radiation reflective shielding as well as thermally insulative shielding and perhaps even water jacketed pockets to provide water that can boil away during high temperature exposure events so as to maintain survivable temperature within the shielded enclosures for longer periods. The transition to protective, or turtle, mode can occur automatically based on data received from the sensor array indicating that the conditions for normal operation have become unfavorable or are anticipated to become unfavorable (e.g., when temperature or IR levels become too high). Alternatively, the transition may occur upon command from a control center (e.g., to help protect the system from an upcoming water drop). In another alternative, approaching battery depletion may dictate the transition from an operational to a protected state. Similarly, the array may automatically come out of the protective mode or be commanded to do so. In some embodiments, where need for data overrides enhanced survivability associated with entering the turtle mode, a DAU may be commanded to not enter turtle mode. In some embodiments even while in protected mode, the sensor array and its control systems may continue some data gathering, communication, and even battery charging. In some implementations the sensor arrays and associated hardware can provide radio wave repeater functionality to provide improved overall radio communications (either for voice communications or data communications) during a fire. In some embodiments, the sensor arrays may not only include information gathering and transmission capability but also data processing capability to automatically change data transmission content when certain events occur. For example, such a content change may occur when a fire or flying embers become visible in some direction (either as seen by a camera or by a directional IR tracker), or when wind direction, speed, temperature, humidity is changing or trending for good or bad. Alternatively, such processing of information may be limited to command center computers based on raw data received. In some embodiments, the DAUs may be equipped with user interface features, displays, speakers, microphones, lights, beacons, or the like. In some embodiments radio communications may be line of sight based, cell tower based, satellite based, or have a different RF basis.

Some embodiments of the invention provide for improved systems for monitoring fires and include: (1) Multiple (local or remote), unmanned information acquisition stations with real-time communication capability (e.g., Real-Time Data Acquisition Stations or Units, i.e. DAUs); (2) One or more data integration, processing, display, and possibly even control stations (e.g., laptop computers running specialized programs possibly with enhanced display capabilities, aka Data Integration and Display Stations, or DIDSs); and programs, or hard coded functionality, executable by the multiple DAUs and DIDSs.

In some embodiments, the DAUs may include one or more sensor control, and communication modules (i.e., SCCMs). Some embodiments add additional mechanical & electromechanical features to the one or more communications modules. In some embodiments, multiple communication modules may provide largely redundant functionality while in other embodiments, different functionality might be provided by different modules. In some embodiments sensing functionality may be provided, at least in part, in a distributed manner. In some embodiments, some SCCMs may be provided with or be movable in and out of thermally shielded doors, walls, or housings.

In different embodiments, the DAUs may include a number of different types of sensors, components, and/or functionality. For example, such sensors, components, and functionality may include: (1) one or more GPS coordinate sensors (e.g., to provide a DAUs position information); (2) one or more compass direction sensors (e.g., to provide a DAUs orientation information or orientation information for individual DAU components such as the direction a camera or IR directional sensor is pointing); (3) one or more gravity sensors (e.g., to aid in leveling a DAU or determining if it as fallen over), (4) one or more wind speed sensors; (5) one or more wind direction sensors; (6) one or more internal & external air temperature sensors; (7) one or more surface temperature sensors (e.g., to provide an indication of IR heating level within a DAU); (8) one or more IR sensors, e.g., an array of IR sensors looking horizontally and above the horizontal plane (e.g., to provide IR tracking or directional information for detecting visible fire or flying embers) or even filtered wavelength specific IR sensors, e.g., that may be used to separate IR readings originating from sources of interest from IR readings that originate from non-interesting sources (e.g., flames are an interesting IR source but the sun may not be); (9) one or more humidity sensors; (10) one or more barometric pressure sensors (e.g., this may be used in combination with other data to predict upcoming changes in wind direction or speed); (11) one or more elevation sensors; (12) one or more visible image camera/video systems; (13) one or more IR image camera/video systems; (14) one or more microcontrollers and/or data processors (e.g., in some embodiments these may include user interface controls for displays, microphones, and/or speakers); (15) one or more batteries internal to an SCCM; (16) one or more batteries external to an SCCM; (17) linear or rotary encoders (e.g., for ascertaining motor or component position or as part of wind direction or wind speed detectors); (18) force or pressure sensors (e.g., for use in determining wind speed): (19) motors or actuators located within an SCCM or external to an SCCM (e.g., for controlling horizontal rotational, or vertical tilt motion of a camera or video system that is internal to an SCCM, controlling the relative movement of protective doors or shields); thermal electric coolers (e.g., to help control the environment within an SCCM or for a particular component; (20) one or more radio receivers; (21) one or more radio transmitters; (22) one or more radio signal relays or repeaters; (23) window shielding, e.g., quartz, for protecting sensitive electronics while in operational mode and/or (24) additional sensors or dual use of some of the above noted sensors for detecting ground movement around a DAU, for example, to detect movement of the ground during hillside or mudslide monitoring during rains after a wildfire.

In different embodiments, the DAUs may include a number of additional components such as, for example: (1) A single pole-like leg (seeFIGS.10A and10B) with a mounting spike or positioning base with or without holes for locating mounting spikes or other anchoring elements (e.g., rope and sand bags); (2) A tripod-like stand or quad-leg stand for positioning an SCCM at a desired location (seeFIGS.7A and7B); (3) a shielded rectangular base box, a three sided pyramid base box, or four sided pyramid base box in which the SCCM may be located during protective mode and from which the SCCM can extend during normal operation (seeFIGS.8A and8B); (4) relatively short legs extending from a base box for leveling the base box relative to a non-horizontal or simply non-planar positioning location (seeFIGS.9A and9B); (5) anchors for attaching the stand to the ground or other positioning surface (e.g., roof of a building or structure; (6) one or more batteries & protective compartments; (7) thermally shielded wiring for getting power from the battery to the SCCM; (8) one or more battery chargers, such as a solar panel, a wind turbine, or a thermal electric generator; (9) multimode external SCCM housing components, for example those necessary to convert from a protected or turtle mode to a normal or operational mode; (10) strong, and potentially thermally insulating, durable construction materials such as steels, ceramics, rubber, quartz, aramids, and the like; (11) reflective shielding such as thin metal foils (e.g., aluminum foil); (12) water pockets or jacketing in some shielding material to provide enhanced low temperature protection as the water evaporates or boils away—such shielding may include plugs (e.g., wax or the like) that inhibit low temperature evaporation but which opens to provide water evaporation or boiling away as temperature begins to rise—such shielding may be supplied in SCCM doors, housings, in the legs of a stand, or the like; and (13) a low volume water supply and pump for boosting water jacket performance.

FIG.1provides an example of what a fire behavior analyst might see on a CCC when a fire in the Santa Clarita valley area of California is surrounded by several dozen DAU devices. The burnt area may or may not be shown depending on how the software handles fire history information or information from other sources such as drone flyovers, data gathering from visible or infrared devices carried by helicopters or other fire retardant or water dropping aircraft. When viewing, an analyst might select between a number of different options some of which would illustrate one or more of the DAUs locations and status, wind speeds and directions, temperatures, humidity, wind speed and direction trending, temperature trending, humidity trending, DAU battery status, DAU camera images and/or orientations, DAU IR tracking information, or the like. Due to the wide array perspective of the figure, little about the fire and individual DAUs are shown. More could be seen, for example, by clicking on individual DAUs or drawing a rough boundary around the area to be viewed.

FIG.2provides an example of what a fire behavior analyst might see when looking at a region where DAUs are located between a fire and a number of structures. The DAUs are being displayed in this view as simple location points. As indicated in the figure, three structural protection units (SPUs) have been defined (in an actual fire emergency, to the extent SPUs were available many more would be defined and located in proximity to the other units). Each SPU is made up of one or more fire companies (engine or engines and its, or their, associated firefighters) and may be assigned a group of structures to protect. The red dots in the figure represent DAUs some of which are deployed away from structures while others are deployed close to, or even on, the structures. The units that are far from the structures (remote units) are intended to provide insight regarding the fire's movement to a central command center while the close by units, or local units, are intended to provide immediate information to a specific SPU concerning fire movement and ignition around the dwellings that they are to protect. Due to the presence of these sensor units, firefighters in an SPU can focus more of their attention on putting out ignition sites and less on monitoring possible ignition sites around other structures in their zones. This also may allow firefighters to stay closer together to improve overall safety while also improving overall effectiveness.

FIG.3focuses attention down to only the local groups of DAUs that are being used directly by several SPUs to provide enhanced structural protection. CCCs at the command center might monitor these DAUs along with the remote units but most preferably each SPU has a CCC to monitor the DAUs most relevant to it (i.e., those near its structures) and perhaps those along an escape route (if considered an issue). As with the previous figures this figure shows the DAUs in a “display location mode” only.

FIG.4depicts an even closer view of a single SPU, its structures and its DAUs along with more detailed information being provided by each DAU. In this FIG. the CCC is displaying the DAUs data in a wind and fire mode. Different symbols are used to convey different information to the firefighters. The flames shown on the right side of the drawing may not actually be seen until this information is extracted from visual or IR camera data. In this example, the directions of the arrows show the direction the wind is blowing while the size of their respective arrowheads show the local wind strength. The circle in the center of each DAU symbol shows an IR signature overhead. If the sun is overhead, it may be necessary to have filtered IR detection so that solar blind determinations may be made to allow detection of other IR sources that are overhead (e.g., flying embers). Instead of using IR trackers for this purpose, a visible camera or IR camera with image recognition software may be used. Imaging processing may be done at the DAUs or by the CCC. The eight sections surrounding the central region for each DAU provide an indication as to the directions in which IR signatures are present (e.g., from flames). The DAUs having multiple arrows show erratic wind conditions. In some embodiments, for example, flashing DAU images may indicate that changes have occurred for which attention is required such as, for example, IR signals are coming from a new direction, IR signals have increased significantly, local air temperature has increased, a need to enter a protected state is approaching or the DAU has already entered such a state, or the like. As indicated at the top of the figure, additional data from a given DAU can be presented in text format. As noted previously, alternative screen configurations can be shown that present different types of data for all DAUs or for some DAUs. In some alternatives different icons may be used to depict different fire relevant parameters either individually or simultaneously. In some alternative embodiments, additional non-vertical and non-horizontal IR directional sensors may be used to provide additional pieces of information.

FIG.5provides a schematic illustration of some elements that may be included in a DAU.

FIGS.6A and6Bdepict two versions of the relationship between DAUs and command and control consoles.

FIGS.7A and7Bdepict collapsed and expanded versions of a DAU that uses a tripod stand and includes the ability to rotate the working head about a vertical axis and rotate the working head to different angles above the horizontal plane, the device depicts a flag-like wind direction sensor and a triple cup wind speed sensor as well as domed sensor including a plurality of IR trackers. The device also includes a camera system and various other electronic modules. The legs include pads or feet that allow the insertion of spikes or other anchoring elements. Alternative devices may use different numbers of legs (e.g., four legs), different numbers of leg extension sections such as 2, 4 or 5 sections.

FIGS.8A and8Bdepict open and closed versions of a DAU that includes a pyramidal box-like protective housing from which the sensor array can be extended from or drawn into. The front protective shields have been removed so that the extendible arms, working head, battery, and collapsible cap can be seen. The unit also includes extendable legs for leveling the device on uneven terrain. In alternative embodiments, the protective housing may take on a rectangular-box shape, a cylindrical shape, a box with sloped sides and a vertical front and back, and the like.

FIGS.9A and9Bdepict another alternative DAU configuration wherein the stand includes a single pole-like leg, a base and a pivotable joint between the two. In some variations, the base may not only include holes for holding spikes or other anchoring elements but standoffs for providing a more stable contact with uneven terrain. In this embodiment, the working head is topped by a shielded cap and can move up and down, out of and into a protective housing that may for example be provided by a box, cylinder, hexagonal, or other extended hollow structure.

FIGS.10A and10Bprovide another example DAU lowered into the protective housing as seen inFIG.10Aand raised out of the housing as can be seen inFIG.10B. In this embodiment the pole-like stand is provided with a spike and base which may be used to anchor the pole to the ground.

Control and command consoles (CCCs) or processing and display stations (PADS) useable with the various DAUs set forth herein may take on a variety of forms from laptop computers, workstations, tablets, and even smart phones, or the like. Such CCCs may further include supplemental monitors or projectors.

In use, data obtained from each DAU is periodically transmitted to the CCC, CCCs, PAD, and/or PADs so data may be displayed on a location basis, e.g., over a map of the region of interest, in substantially real time. Various functionalities are possible and include for example (1) changing the display format or display content as a whole or on a DAU-by-DAU basis; (2) opening and closing visible or IR video displays or still shot displays from individual DAUs, (3) turning selected DAU cameras to desired directions to gain additional insight about a location, (4) communicating with DAUs as a whole or on an individual basis, e.g., to change update rates, type of information being sent with each update, camera type being used, camera direction, position recalibration, other DAU embedded functionality, and the like. In some embodiments, the CCC or PADS may directly transmit area relevant information to firefighters in those areas. Real time monitoring systems as set forth herein may be used with personal electronic monitoring devices carried by individual firefighters.

It will be apparent to those of skill in the art that numerous variations of the embodiments of the invention are possible upon review of the teachings herein. Some such variations may involve completely removing the pole or leg portion of the DAUs in favor of other mounting hardware that may be used to attach the DAUs to some existing buildings, trees, fence posts and the like that may be located in an area of interest. In some embodiments, a working head may be located on a controllable base which in turn sits on a battery or other relatively heavy mounting structure.

In view of the teachings herein, many further embodiments, alternative methods and systems will be apparent to those of skill in the art. As such, it is not intended that the invention be limited to the illustrative embodiments, alternatives, and uses described above but instead that it be solely limited by the claims presented hereafter.