Patent ID: 12205447

Like reference symbols in the various drawings indicate like elements.

DETAILED DESCRIPTION

The disclosed system enables the safe egress of occupants in a home or other building in the event of an emergency, such as a fire. The disclosed system can be extended to apply to non-residential buildings that are three to four stories, including but not limited to schools, office and retail buildings, and other limited scale buildings. Predictive analytics are incorporated into this system to guide occupants to safely egress without creating false starts and unproductive, chaotic scrambling on the way to safety.

Since modern homes are built by using more composite materials, the homes can go up in flames much faster than traditional homes that are built from wood. Simulating fire scenarios, predicting occupants' ability to escape the simulated fire scenarios, and modeling possible egress strategies then selecting an optimal egress strategy in real-time based on current conditions of a fire in the home are critical steps to minimize the need for any course corrections during the egress process. As a result, occupants can exit as quickly and calmly as possible before the home is engulfed entirely in flames. A goal of the disclosed system is that none or only one course correction may be necessary to guide occupants to safety.

As mentioned, modern/newer construction homes are more likely to reach full flame engulfment in less time than older constructions, based on the materials used to build the homes. For example, it may take a new construction only 3½ minutes to reach full flame engulfment while an older home may reach full flame engulfment in 15 minutes. Given a compressed 3½ minute to 5 minute time frame in modern homes from when a fire starts to the point that the flames engulf the entire structure, the guiding outputs of the disclosed system to occupants are designed to minimize course corrections in the egress process. This is in part made possible by the predictive analytics incorporated into the system to guide occupants to safe egress without creating false starts and unproductive, chaotic scrambling on the way to safety.

In some implementations, the disclosed system can include wearable devices for occupants experiencing sight or hearing deficiencies. Such devices can be beneficial to help these occupants safely egress from the home during an emergency when they typically cannot hear and/or see the audio/visual outputs (i.e. directions out of the home) described throughout this disclosure.

Now turning to the figures,FIG.1is a conceptual diagram of an example system for predicting safe egress strategies out of a building and selecting an optimal egress strategy in real-time during an emergency. The system includes a predictive fire pathway server100and house102. The house102has a house layout104, which can include rooms110A-N (e.g., kitchen, living room, bathroom, hallway, bedroom, etc.). The house layout104can be communicated/transmitted to the server100such that the server100can use the layout104in simulating fire scenarios (refer to step B).

In the house103, one or more signaling devices108A-D and a hub106are installed. The hub106can be a central control system that receives and communicates current conditions in real-time with the signaling devices108A-D. In some implementations, the hub106can act like the signaling devices108A-D by sensing real-time conditions of a fire in the house102and/or selecting an optimal egress strategy and outputting instructions to occupants about how to safely egress from the house102. For example, the hub106can act as a signaling device in a room where there are no other installed signaling devices. The hub106can be located in a main foyer/hallway of the house102and thus can act as a signaling device for that foyer/hallway.

Preferably, each of the signaling devices108A-D can be installed in each room in the house102, as depicted in the house layout104. The signaling devices108A-D are configured to wirelessly communicate with each other in real-time via a communication such as WIFI, BLUETOOTH, or any other form of wireless connectivity. In some implementations the signaling devices108A-D can communicate through a wired connection. This can be beneficial during emergencies in which a wireless connection (i.e., WIFI) is down and/or damaged by conditions of the emergency (i.e., a fire spreads and engulfs a router sending WIFI signals throughout the house102).

As mentioned, the signaling devices108A-D can communicate real-time, current information about conditions of a fire in the house102. Current conditions can include a temperature of the fire, a temperature of a room that a signaling device is located in, and whether the fire spread to the room. In some implementations, the signaling devices108A-D can include a monitor and/or one or more cameras to observe current conditions of the rooms that each of the signaling devices108A-D are located in. Consequently, based on the captured footage, the signaling devices108A-D can determine whether the fire started and/or spread to any of the rooms in the house102. In other implementations, the signaling devices108A-D can be connected to one or more cameras that are installed throughout the house102. The one or more cameras can be wirelessly communicating with the signaling devices108A-D. Alternatively, the cameras can communicate with the signaling devices108A-D through a wired communication. A setup involving the use of cameras that are already installed and/or separately installed in the house102can be beneficial where the described system (the signaling devices108A-D and the hub106) is retrofitted to an existing house.

Preferably, the signaling devices108A-D can include temperature sensors (i.e., thermocouple heat sensors) to read temperature values in each of the rooms in real-time. In some implementations, the signaling devices108A-D can communicate with sensors that are installed in the house102. These sensors can be installed around windows, doors, and/or at higher points in the rooms (i.e., near the ceiling). The sensors can also be installed prior to installation of the described system (the signaling devices108A-D and the hub106), wherein the described system is retrofitted to the house102. In yet other implementations, the signaling devices108A-D can have integrated temperature sensors and still communicate with additional sensors that are installed throughout the house102. This setup can be beneficial for redundancy and ensuring that accurate temperature readings are acquired and used by the signaling devices108A-D in determining what egress strategy to select during an emergency. Current temperature information is beneficial for the signaling devices108A-D to adopt the optimal egress strategy from the house102. For example, if current temperature information indicates that the fire is at the back of the house102, then a signaling device located at the front of the house can select an egress strategy that will not direct occupants towards the back of the house.

The signaling devices108A-D can also be configured to output instructions to home occupants for safely egressing from the house102. For example, the signaling devices108A-D can include speakers that are integrated into the devices so that the devices can provide an audio output of instructions. The signaling devices108A-D can also include integrated lights to display a visual output of instructions to egress from the house102. In other implementations, the signaling devices108A-D can communicate with one or more speakers and/or lights that are installed in the house102through a wired and/or wireless communication. In yet other implementations, the signaling devices108A-D can communicate with wearable devices and other devices that are used by occupants experiencing a disability (i.e. blindness, deafness).

Moreover, the hub106can include a monitor for displaying potential fire scenarios to home occupants. For example, home occupants can view egress routes at any time, as desired, via the hub106. The hub106can also be connected to a device within the house102(i.e., a TV) and serve as an input for changes to any occupant and/or home design information. For example, if a babysitter is in the house102one night, the home occupants can update the described system about the babysitter's presence via the hub106. That way, the babysitter can be considered by the individual signaling devices108A-D in the event of an emergency wherein the signaling devices108A-D must select an egress strategy and output egress instructions to all occupants within the house102. Information about occupants that can be updated and/or changed includes age (i.e., birthday just occurred) and agility level (i.e., an occupant no longer has crutches or a cast on his leg, an elder relative just moved in and is in a wheelchair, etc.).

Prior to customization and installation of the signaling devices108A-D and the hub106, the predictive fire pathway server100can explore different fire scenarios, identify vulnerabilities that compromise safety in the house102, suggest remediation steps and processes for the identified vulnerabilities, predetermine most effective egress routes for potential fire scenarios, and establish a design and programming of the signaling devices108A-D and the hub106to then be installed in the house102. When the server simulates fire scenarios and identifies potential egress strategies (refer to steps B-C), the server100can use information including transit distances between each room and each exit point in the house102, each occupant's mobile abilities (i.e., an occupant in a wheelchair is slower than a teen who is healthy and active), and other specifics related to the house layout104, potential paths that a fire can spread throughout the house102, how long it would take the fire to spread, etc.

Establishing safe egress strategies requires a comprehensive prior evaluation and analysis of the house102with respect to its layout (i.e., the house layout104or floorplan) and structure (i.e., whether the house102is a new construction with composite materials or whether the house102is an older house built with traditional materials such as natural/dense wood), age and physical capabilities of its occupants, and other factors. Performing such evaluation and analytics before real-time execution can be beneficial to determine all potential scenarios of how a fire would pan out and how all occupants would react. Consequently, in real-time, the optimal egress strategy can be selected to ensure that all occupants safely exit the house102without chaos and without having to correct/change a selection of the optimal egress strategy.

The server100can also be configured to guide homeowners to relocate persons with disabilities (i.e., elderly in a wheelchair) beforehand to a place in the house102that would enable safe and non-chaotic egress in the event of a fire. The server100can make such a determination and suggestions based on simulating fire scenarios and determining how each occupant in the house102would react and egress from the house102(refer to steps B-C). In some implementations, the server100can be configured to guide homeowners about making one or more changes to the house102itself that would ensure safety and proper egress for all occupants. For example, the server100may determine that a door should be installed in a doorway that separates two zones in the house102in order to create a firewall effect that provides for additional egress time from other parts of the house102. In another example, the server100can determine that a fuel load in one zone of the house102, for a given fire scenario, would prohibit safe egress for the occupants. Consequently, the server100can determine that that particular zone should be modified in some way to reduce the fuel load. The server100's determinations can be beneficial to guide homebuilders in constructing better home designs or retrofits that reduce egress distances to exits and ensure increased occupant safety. This is particularly important today where homes are built with more composite materials rather than real wood and homeowners are seeking spacious, open architecture. In other words, homebuilders may still design open architecture and floorplans but have a better understanding and adaptation of such floorplans to shorter and safer egress paths in the event of a fire emergency.

Still referring toFIG.1, the server100can receive home layout (i.e. the house layout104, distances/measurements between different rooms in the house102and exit points, etc.) and user information (i.e., age, agility, and disabilities of each of the occupants, etc.) from the house102in step A. In this step, a homebuilder can upload this information about the house102and its occupants directly to the server100. In other implementations, this information can be uploaded in real-time to the server100by an occupant in the house102and/or by updating/inputting/adding into the hub106information about the occupants or other home design information. Using this information, the server100can simulate fire scenarios in step B then perform predictive analytics on the ability of all of the occupants to safely egress in any of those fire scenarios in step C.

By simulating fire scenarios in step B, the server100can flush out potential safety vulnerabilities and determine appropriate egress strategies (i.e., routes, paths) for each of the simulated scenarios. The server100can simulate different fire scenarios to determine how quickly a fire would spread to other areas in the house102and how the spread of the fire would impact different exit points throughout the house102. The server100can use information including temperatures of a fire when it starts, when it's at a peak, and when it's on a decline to simulate fire scenarios in the house102. The server100can also use information about the house102to simulate fire scenarios, including when the house102was built, what materials were used to build the house102, and the house layout104.

Then, using specialized predictive analytics and elements of artificial intelligence, the server100can determine how well occupants can egress using predicted egress strategies in any of the simulated fire scenarios (step C). In some implementations, the predictive analytics utilizes a specialized time temperature equation that is mathematically deterministic, but can also incorporate stochastic analysis for added rigor and safety. Moreover, elements of AI can be incorporated with respect to predictive analytics in order to broaden its scope and ensure that it accommodates emerging technology and advances in modes of analysis. The power of predictive analytics lies in its ability to predict the rate of rise of temperature in a space that contains a fire, starting from fire initiation to maximum growth before ultimate decline. As its primary goal, the methodology utilized by the server100can predict times to maximum escape temperature and flashover. These parameters, coupled with information on home layout (i.e., house layout104) versus the mobility and general physical and mental capabilities of occupants in the house102, establish the viability of predicted egress strategies and routes.

The basic defining time-temperature equation for the example predictive analytics methodology utilized by the server100is as follows, in which its application is in the space with fire:
T=Tmax[t/tmaxexp(1−t/tmax)]C

In which T is the computed temperature above initial room temperature at time, t, Tmaxis the maximum expected temperature in a room with fire, tmaxis the expected time when Tmaxis reached, and C is shape factor for the time-temperature curve. In most house fires, Tmaxis about 1100° F. and tmaxis about 3½ minutes in a typical home fire. The values of Tmaxand tmaxcan be modified for known characteristics and conditions in a home as determined by the server100. The factor C, which determines the critical shape of the time-temperature curve, is determined as follows:
C=[lnT1/Tmax]/[lnt1/tmax+1−t1/tmax]

In which T1is the temperature above initial room temperature at time, t1, and all other variables are as previously defined. In the simulation performed by the server100, T1is estimated from a rationally-based audit methodology that includes extremum analysis and critical ranges of possibility. At the signaling devices108A-D, T1is determined from one or more thermocouple outputs during an actual fire via a sampling process, a vital distinction. The time, t1, is chosen to be 15 seconds, for reasons elaborated later. In a fire, temperature is sampled every second or quicker, with a running 10-second time-averaging window applied to the process. That is, to determine T1at t1=15 seconds, temperature data that is sampled starting at 10 seconds and ending at 20 seconds are averaged to calculate the value for T1. Therefore, t1=15 resides at the midpoint of the 10-second time-averaging window in determining T1. The averaging process is critical to smoothing the data to yield a more accurate representation of T1, because a fire fluctuates, hence so does temperature. Choosing a 10-second time-averaging window in determining T1is arbitrary, but is based on engineering experience and judgement in collecting temperature data in a fire setting. Also, a larger time-averaging window can reduce the available egress time.

A fire typically starts on a limited, localized scale, then experiences a sudden “pulse” growth for a period of time before reaching flashover, followed by final growth at a continuously reducing rate until it reaches its maximum level of intensity. After reaching its maximum, a fire goes into a declining stage as its fuel is depleted. The time at which temperature becomes impassible at a particular egress location, followed later by the temperature for when flashover occurs, are predicted by the server100as follows.

The precise time to maximum escape temperature, chosen to be 300° F. (149° C.) for dry conditions, and the specific shape of the curve depend on tmax, Tmax, and T1at time t1. As stated above, and repeated now for emphasis, the value of T1for a chosen time, t1, which is 15 seconds in this example, is estimated by the server100when simulating fire scenarios in step B, as stated above, but measured directly in an actual fire in the signaling devices108A-D. Using the equations from above,FIG.9depicts four time-temperature curves as a function of time for various values of T1, assuming the values of Tmaxand tmaxcited above. InFIG.9, curves labeled 1, 2, 3, and 4 correspond to T1values of 0.1° F., 2° F., 5° F., and 15° F., respectively (0.06° C., 1.1° C., 2.8° C., and 8.3° C.). Time, t1, equals 15 seconds in all cases. The values for T1were chosen arbitrarily to elucidate the potential shapes of the time temperature curve and to assess the range of potential egress times. All four curves are “sigmoid” in basic shape, accurately representing the behavior of a real fire, but differ importantly in the information each provides on precise temperature history. If T1=0.1° F. (0.06° C.) after 15 seconds, the fire can be considered embryonic, while if T1=15° F. (8.3° C.) in the same timeframe, the fire is still in a relative infancy but not embryonic. The times in the respective curves at which the temperature in the room reaches the impassible point, 300° F. (149° C.) for dry conditions, are 70, 52, 45, and 35 seconds, respectively, in which t1=15 seconds plus one half of the 10-second time-averaging window, totaling 20 seconds, have been subtracted.

Choosing t1=15 seconds reasonably assures that enough temperature measurements have been undertaken with the thermocouples to determine accurate results with the predictive analytics methodology in a real fire. There is a feature in the methodology, as previously mentioned, that allows for one course correction in egress early in the process after a fire is detected in real-time. Regardless, the basic process is as follows. During the 20-second sampling time in determining T1in a real fire, the signaling devices108A-D can be configured to alert occupants about the fire, providing initial guidance, and allowing them to prepare for egress. In some implementations, t1can be longer, i.e., 25-30 seconds, but given the typical 3½ minute time in which flames fully encompass a home, 15 seconds can be more prudent. In the final analysis, as performed by the signaling devices108A-D, occupants ought to not be guided quickly to a point on an escape path that may become engulfed with flames by the time they arrive. For the four egress times cited above inFIG.9, choosing conservatively that 35 seconds is available for egress along a path that passes through the room with the fire, that time span is insufficient for many cases unless the transit distance to safety is short and the occupant is physically mobile.

If the egress pathway is in a room adjacent to the room with fire, the flashpoint becomes the criterion for determining allowable egress time. If a closed door exists between rooms, then more time is available for egress. The times to flashover, assuming a typical residential flashpoint of 932° F. (500° C.) are 137, 127, 122, 115 seconds, respectively, for the four shown curves inFIG.9. As before, t1=15 seconds plus half of the 10 second averaging window have been subtracted from the predicted times when flashover occurs for the four curves. Again, choosing conservatively, the allowable time for egress is 115 seconds, which may be adequate in some instances, depending on transit distances, occupant mobility, and other factors described above. If not, and the fire is on the second floor, safe egress can be through a room window. The same reasoning can be applied to various other scenarios.

In the server100and the signaling devices108A-D, the deterministic aspects of the above equations are complemented by stochastic processes and artificial intelligence (AI) in the form of neural networks and genetic algorithms, for example, to make the server100and signaling devices108A-D more robust and resilient. Factors that are included in the server100and signaling devices108A-D through stochastics and AI include such things as determining the possibility of (a) window blow out that can amplify fire flow paths, and (b) the effects of fuels types and fire loads on fire dynamics in various places in a home. The estimation of Tmaxand tmax, and related parameters, are affected by these various factors.

To summarize the basic predictive analytics methodology described herein, when a fire ignites an initial sampling period of t1+5=20 seconds occurs in which the installed signaling devices108A-D can gather temperature data with the various thermocouples located strategically throughout the house102. Once T1is determined, the second equation depicted above can be used to calculate C. Then the first equation depicted above can be used to predict the time that temperature will rise to its maximum allowable escape level, and the time at which flashover will occur. Escape and flashover times, with t1+5=20 seconds subtracted, coupled with predetermined exit transit distances and estimated egress speeds for each home occupant, as determined by the server100, considering instances of required assistance by able-bodied persons, allow the installed signaling devices108A-D to provide proper and effective guidance for escape to safety.

The predictive analytics described throughout includes a feature for one course correction in a fire in the house102, as previously discussed. After the initial sampling period of 20 seconds (i.e. t1+5), the signaling devices108A-D can continue to sample temperatures from the thermocouples in the room(s) with fire as well as those distributed in various rooms throughout the house102. The hub106and/or the signaling devices108A-D can determine at various points in time to what extent the initial predictions in temperature rise hold and whether they were low or high. If high, the initial assessment of allowable egress time holds. If low beyond a certain tolerance level, occupants can be instructed to return to their starting point and to exit from an egress window. This course correction can be valid for a short time after the initial sampling period, i.e., 15-30 seconds beyond the initial 20 seconds, depending on occupant mobility, egress distances, and other logistical factors. In the final analysis, conservative judgments can be made, by the signaling devices108A-D, on egress guidance.

As a simple example, using predictive assessments, the server100can determine that it would take a particular occupant 30 seconds to get out through a front door from an upstairs bedroom. The server100can also determine that based on the materials used to build the house102and the house layout104, the fire will spread to the front door or anywhere along the occupant's escape route in less than 30 seconds. So, the server100can determine alternative egress strategies that can safely lead the occupant out of the house102without coming into contact with the fire. In an example scenario where the fire starts or is located in the kitchen, the server100can determine that the fire can reach the front door in 1 minute. Based on this information, the server100can determine that the occupant can safely exit through the front door because it would take the occupant 30 seconds to do so. Thus, this exit route can become one of the modeled egress strategies (refer to step D). The goal of the server100is to create and predict optimal egress strategies that direct occupants away from the fire and out of the house102in the fastest and safest way possible. The server100is configured to predetermine egress pathways through the house102and predetermine contingencies should any of the predicted egress pathways not be the most optimal one during an emergency in real-time.

In some implementations, the use of predictive analytics by the server100does not necessarily entail artificial intelligence (AI). Rather, it can entail deterministic mathematics, conventional and/or clever applications of statistics, and/or AI. Moreover, AI itself can entail statistics and/or stochastics in its inner workings. In the example depicted throughout this disclosure, a deterministic mathematical approach is employed by the server100in simulating fire scenarios (refer to step B). However, in other implementations, the disclosed determinations of fire and/or temperature growth can be performed using artificial intelligence or artificial intelligence in combination with various forms of predictive analytics.

Next, still referring toFIG.1, in step D, the server100can model egress strategies for each of the rooms in the house102based on the simulations and predictive analytics of steps B-C. The server100can perform if/else true/false logic to determine a list of key egress strategies for each of the rooms in the house102. For example, the server100can determine that if fire exists in room A on a first floor of the house102, then exit strategy 1 should be selected as an optimal exit strategy for exiting room B on a second floor of the house102. As another example, if the fire is in room A on the first floor of the house102and it spread to at least one other room on the first level, then the server100can determine that exit strategy 2 should be selected as the optimal exit strategy for exiting room B on the second floor of the house102. Then, in real-time execution, a signaling device can select any egress strategy from the list of key egress strategies made by the server100but would optimally select the egress strategy that the server100modeled as the optimal exit strategy in the particular scenario.

Once the list of key egress strategies is created, the server100can model signaling instructions that are associated with each of the key egress strategies in the list in step E. The server100can model instructions that can be visually outputted and/or outputted as audio. For example, based on occupant preference, instructions for exiting the house102along a particular egress strategy can be outputted using lights (i.e. LED lights). The lights can be displayed, from the signaling devices108A-D and/or in any of the rooms in the house102, depicting arrows or some other illumination that would indicate the appropriate path to take out of the house102. In another implementation, the lights can be in the form of LED strips attached on top of a molding of one or more windows and/or doors in each of the rooms in the house102. The LED strips can become illuminated to direct occupants safely out of the house102upon instruction from a signaling device and/or the hub106during an emergency. The LED strips can communicate wirelessly or through a wired connection with the signaling devices108A-D and the hub106. In yet another implementation, instructions to exit the house102can be outputted using audio, in which the signaling devices108A-D and/or external speakers installed in the house102dictate instructions to occupants about exiting the house102. In some implementations, audio output can come from a speaker embedded in one or more outlets throughout the house102.

Once the signaling instructions are modeled, the server100can transmit the list of key egress strategies and their associated signaling instructions to the house102in step F. The signaling devices108A-D can preload the lists of key egress strategies, wherein the list includes all possible strategies to exit a particular room that each of the signaling devices108A-D is located in. As mentioned, these predicted egress strategies can foreshadow a time it would take any particular occupant to exit the house102and a time it would take for the fire to spread to any area of the house102, thereby restricting or closing off any exit points in the house102.

Each of the signaling devices108A-D can receive the egress strategies and their associated signaling instructions that relate to exiting the particular room that each signaling device108A-D is located in. For example, if signaling device108D is located in a kitchen (i.e., room110C) of the house102, then the signaling device108D will only receive a list of key egress strategies and signaling instructions that relate to exiting the kitchen during an emergency. Likewise, if signaling device108B is located in a living room of the house102, then that signaling device108B will only receive the modeled egress strategies and signaling instructions that relate exiting the living room during an emergency.

In some implementations, the hub106can also receive all of the modeled egress strategies and signaling instructions, regardless of which room those strategies pertain to. In yet other implementations, the hub106may only receive modeled egress strategies and signaling instructions that relate to the room that the hub106is located within (i.e., in a foyer, entrance, or hallway of the house102). Thus, in some implementations, the hub106can function and act like the signaling devices108A-D.

The server100can determine which egress strategies are transmitted to which of the signaling devices108A-D by assigning values to each of the rooms in the house102. Then, each signaling device108A-D can be assigned a value that corresponds to the value of each of the rooms. For example, the kitchen can be assigned a value of 1 and the signaling device108D, which is located in the kitchen, can likewise be assigned a value of 1. Once the server100generates a list of key modeled egress strategies for the kitchen, the server100can determine which signaling device108A-D is located in the kitchen based on its assigned value and then transmit the list of egress strategies associated with the kitchen to that signaling device (in the example provided above, the signaling device108D is located in the kitchen so the signaling device108D and the kitchen have corresponding identification values).

Once each of the signaling devices108A-D receive the modeled egress strategies and signaling instructions, the signaling devices108A-D can communicate and receive current conditions in real-time from the other signaling devices108A-D and the hub106(step G). As previously discussed, each of the signaling devices108A-D can collect real-time conditions on their own by using sensors or other devices integrated into each of the signaling devices108A-D. Alternatively, the signaling devices108A-D can communicate real-time conditions with each other as well as with sensors and other devices already installed in the house102(i.e., smart smoke detectors, thermocouple heat sensors, etc.). Based on the sensed/received current conditions, the signaling devices108A-D can make real-time determinations of which egress strategies are appropriate for safe egress from the house102.

For example in the example mentioned above, if a fire is sensed by the signaling device108D in the kitchen based on a sudden increase in temperature in the kitchen, then the signaling device108D can communicate this condition in real-time to the other signaling devices108A-D as well as the hub106. Other signaling devices108A-D can communicate additional conditions in real-time, including but not limited to a temperature of a room and/or a change in temperature of the room, wherein the rooms are nearby the kitchen. The signaling devices108A-D can use this information to determine whether the fire is spreading from the kitchen, whether it is getting stronger, and/or whether it's getting hotter.

Based on communication of conditions in real-time in step G, each of the signaling devices108A-D can then select an optimal egress strategy from the list of modeled egress strategies associated with the particular room that each of the signaling devices108A-D is located in (step H). For example, in this step H, the signaling device108D selects the best egress strategy that would allow an occupant to safely exit the house102without coming into contact with the fire that started in the kitchen, regardless of where the fire spreads. Because of the simulating and predicting performed by the server100in steps B-D, the signaling device108D's selection would be accurate such that the signaling device108D would not have to correct its egress strategy selection in real-time. After all, the server100has simulated a fire scenario like the present one and predicted how an occupant would egress in that particular scenario (refer to steps B-C). The possibility of error in selection by the signaling devices108A-D would consequently be minimal, if not nonexistent. In the event that course correction is required in real-time, then a signaling device should only have to make a single course correction.

In the event that the single course correction is necessary, the signaling device can continue to receive samples of temperature values from sensors throughout the house102as well as from the other signaling devices108A-D and the hub106to make an accurate correction of the signaling device's strategy selection. In some implementations, the hub106(or any of the signaling devices108A-D) can determine at various points in time to what extent initial predictions in temperature rise hold and whether they are high or low. If high, then the initial assessment of allowable egress time, as determined by the server100, and selected egress strategy, as determined by a signaling device in real-time, holds. If low beyond a certain predetermined level, then the hub106and/or any of the signaling devices108A-D can select a different egress strategy and instruct occupants to return to their starting points and/or follow new directions associated with a different selected egress strategy.

As mentioned, thermocouple heat sensors placed judiciously throughout the house102can sense temperatures in different rooms in real-time. These temperature readings can be transmitted to each of the signaling devices108A-D during the emergency and/or before the emergency. In step H, each signaling device108A-D can estimate a rate of temperature rise along each of the modeled egress strategies to determine which of the modeled egress strategies is appropriate, safe, and ought to be selected. The signaling devices108A-D can predict the rate of rise in temperature starting from fire initiation to maximum growth before the fire's ultimate decline. This prediction can also be performed by the server100before run-time execution. A temperature at any given time can be determined via thermocouple heat sensor outputs during an actual fire via a sampling process. Temperature readings from the sensors can be collected over a period of time then averaged in order to smooth the data and yield a more accurate representation of the temperature at any given time. Consequently, the signaling devices108A-D can predict times to maximum escape temperature and flashover, which, as mentioned, is also performed by the server100before run-time execution. Coupled with predetermined egress transit distances and estimated egress speeds for each occupant (which was determined by the server100in steps B-D), the signaling devices108A-D can accurately select and provide for proper and effective guidance to safety during an emergency in real-time.

As mentioned the determinations concerning rise of temperature can be performed by the server100beforehand in step C. When the server100determines a rise in temperature, it can employ a rationally-based audit methodology that includes extremum analysis and critical ranges of possibility to determine a temperature at any given time in each of the rooms in the house102. Prediction of what temperatures will be at various critical points along an egress strategy (i.e., route, path) and at a destination exit point is important to ensure that occupants can be safely guided to safety without chaos or confusion. These are critical determinations performed by the server100in order to determine occupants' ability to safely egress during any fire scenario and model key egress strategies (refer to steps C-D).

For example, if the sensed, determined, or predicted temperature values along an egress strategy are below a maximum escape level at all points along that strategy and will remain so until all occupants can reach the exit, then the server100can determine that that egress strategy is an optimal strategy in the list of modeled egress strategies provided to a signaling device. To make this determination, the server100needs to know a time before the temperature becomes too hot at each point along the egress strategy, a transit distance, and a speed at which an occupant is reasonably able to move along the egress strategy to safety. If conditions are not suitable to exit via one of the modeled egress strategies, with an embodied safety time factor to accommodate for any uncertainties, then the server100can determine that a different egress strategy in the list of modeled strategies may be the better option in the even of an emergency. These steps described can also be performed in real-time by each of the signaling devices108A-D in step H, when each of the signaling devices108A-D must select the optimal egress strategy from the list of modeled egress strategies received from the server100.

After each of the signaling devices108A-D selects the optimal egress strategy associated with the particular room that the signaling device108A-D is located in (step H), each signaling device108A-D is configured to output egress instructions associated with the selected egress strategy in step I. For example, if the fire starts in the kitchen where the signaling device108D is located, then the signaling device108D will output instructions associated with the selected egress strategy for exiting the house102from the kitchen. In the same example, the signaling device108B, located in the living room of the house102, will output instructions associated with the selected egress strategy for exiting the house102from the living room. As previously mentioned, output of the instructions for the selected egress strategy can be visual and/or audio. The signaling devices108A-D can make this determination based on information about the occupants, such as whether an occupant is blind, deaf, or prefers one form of output over the other. In some implementations, the signaling devices108A-D may only have one form of output based on the devices installed in the house102. For example, if every room in the house102has a speaker installed in/integrated into an outlet, then audio output is used. If every room in the house102, or some of the rooms, has LED strips installed on molding of doors and/or windows, then a visual output is used. In yet other examples, output can be both audio and visual, which can be beneficial in situations where, for example, there is a lot of smoke that makes it harder for occupants to see lights as time goes on.

In other implementations, the signaling devices108A-D can select an optimal form of output based on a current condition in real-time. For example, if the signaling device108D senses that there is a lot of smoke in the kitchen that obstructs ones vision, it may be hard for an occupant in the kitchen to see any visual outputs. Therefore, in this example, the signaling device108D can select an audio output of egress instructions rather than a visual output.

Each of the signaling devices108A-D perform steps H and I. In some implementations, the hub106can also perform steps H and I (not shown), especially in situations where the hub106is located within a room in the house102that does not have its own signaling device108A-D and wherein the hub106functions like the signaling devices108A-D. In some implementations, the house102may not have the hub106but rather can designate one of the signaling devices108A-D to act as the hub106or a central control system.

The system described herein can further include features for assisting disabled occupants. For example, a deaf occupant can wear or carry a device (i.e. a wearable device or a hand-held device) that uses vibrational signals to guide the occupant via a selected egress strategy. As another example, a blind occupant can wear or carry a device that provides continuous audible verbal messages for egress instructions (i.e., to supplement other fixed audio devices or act as a substitute if fixed audio devices are not functioning within the house).

The system described herein can also include other features. For example, some or all devices, such as the signaling device108and the hub device106, can include battery backup (i.e., lithium) for use in case of a power outage affecting some parts or all of the house. Various hardware and software security measures can further be employed to prevent local and/or remote hacking. Security measures can prevent unauthorized users (i.e., would-be thieves) from obtaining information about a house floor plan, for example. In some implementations, the system described herein can be used as a stand-alone system for a fire egress and guidance system. Other configurations for the system are also possible.

FIG.2is an example system diagram of the embodiment ofFIG.1. The system includes a predictive fire pathway system100(FIG.1's predictive fire pathway server100), a fire detection hub device106(FIG.1's hub106), and at least on signaling device108(FIG.1's signaling devices108A-D) that communicate via network(s)200. The system100, hub device106, and signaling device108can use one or more wired and/or wireless communications (i.e. BLUETOOTH, WIFI) in the network(s)200.

In some implementations, the hub device106can detect whether there is a fire in a house and provide an associated fire indication230to the predictive fire pathway system100as well the signaling device108. The hub device106can be of various configurations and can include a smoke detector and/or heat sensor (i.e. temperature sensor, infrared sensor, etc.) in order to detect whether there is a fire and where in the house the fire is located. Further, the hub device106and/or signaling device108can be of various configurations, such as motion sensors, cameras, door sensors, window sensors, door locks and window locks, other security devices, etc.

The predictive fire pathway system100can include a fire simulation module202, an egress pathway modeling module204, a user behavior engine206, and a fire egress pathway determination engine208. The system100can also communicate wirelessly and/or wired with a determined egress pathways database210and a determine user behaviors database212. In other implementations, the system100can alternatively store information associated with its functions in a cloud-based network and/or use the cloud-based network as backup storage.

The user behavior engine206can collect information about home occupants from the hub106, signaling device108, or other sources (refer toFIG.1step A). For example, when the hub106and signaling device108are installed in the house, an installer (i.e., homeowner, homebuilder, etc.) can input/transmit information about the home's occupants directly to the predictive fire pathway system100. Some of the information that the user behavior engine206can collect includes an age, agility level, and any possible disabilities associated with each occupant. The user behavior engine206can then determine key characteristics of the occupants that may impact their ability to safely egress from the house during an emergency. For example, if an elderly person in a wheelchair lives in the house, then the user behavior engine206can determine that this factor will change how the elderly person can egress from the house during a fire. In other words, it may take longer for the elderly person to egress. The user behavior engine206can also use this type of occupant information in order to suggest to a homebuilder, homeowner, or any other occupant about what modifications can be made directly within the house to ensure occupant safety. For example, if the elderly person lives in the house, the user behavior engine206can create a suggestion, communicated to the hub device106to then be outputted for display, that the elderly person should have a bedroom on a first floor of the house and/or close to a major exit of the house (i.e., back door, front door).

Once the user behavior engine206determines the user information that is key to egressing safely out of the house during an emergency, that user behavior information can be stored in the determined user behaviors database212. The information stored in the database212can be updated at any time by a user inputting updated and/or new information into the hub device106. For example, if a baby is added to a family living in the house, one of the occupants can update the occupant information via the hub device106such that when egress pathways are modeled by the module204, the module204can take into consideration the fact that a baby is now one of the occupants that needs to safely egress from the house during an emergency.

Still referring toFIG.2, the fire simulation module202can simulate potential fire scenarios in the house based on a house layout, what materials the house is built with, user behavior information, and other information as previously mentioned (refer toFIG.1step B).

The egress pathway modeling module204can be configured to model/create potential egress strategies out of the house based on the simulated fire scenarios from the module202and taking into consideration the occupant information stored in the determined user behaviors database212(refer toFIG.1step C). The module204can use predictive analytics and components of artificial intelligence to predict abilities of each of the occupants to exit the house during an emergency, no matter the simulated fire scenario.

The fire egress pathway determination engine208can be configured to select one or more of the predicted egress pathways from the module204that can be used during an emergency (refer toFIG.1step D). In this step, the engine208can model the predicted egress strategies for each of the rooms in the house, thereby creating a list of key potential egress strategies that the signaling device108can choose from in real-time. The engine208can also be configured to model signaling instructions associated with each of the potential egress strategies in the list (refer toFIG.1step E). In some implementations, as previously discussed, the engine208can list the egress strategies in order from optimal to least optimal exit strategy in any given fire scenario.

Once the engine208determines a list of egress strategies associated with each room in the house, the list of egress strategies, as well as the associated signaling instructions, can be stored in the determined egress pathways database210. Over time, if the module204predicts new egress strategies and the engine208models, selects, and/or determines new strategies that can be implemented by the signaling device108, then egress strategies stored in the database210can be updated to reflect such changes/additions. Thus, the module204operates to bolster functioning and effectiveness of the system100by adjusting the system100for changing circumstances in occupant status, occasions with guests, and/or changes in the home itself (i.e., renovating the house, adding room(s), removing room(s), etc.). As such, egress strategies can be modified rapidly with changing circumstances.

After egress strategies are determined and stored, the system100can communicate the egress strategies226and the associated signaling instructions228to the signaling device108(refer toFIG.1step F).

The signaling device108can include an audio output system214, a visual output system216, a predetermined signaling logic218, a predetermined output logic220, a temperature sensor222, and a user presence sensor224. Upon receiving the egress strategies226and signaling instructions228, the signaling device108can collect current conditions in real-time (refer toFIG.1step G). The temperature sensor222(i.e. heat sensor, infrared sensor, etc.) can get a read on a temperature of the room that the signaling device108is located within. Based on the sensed temperature, the signaling device108can determine whether there is a fire in the room and/or whether a fire is spreading/getting closer to the room. Moreover, the user presence sensor224can determine whether an occupant is located within the room. If the occupant is sensed in the room, then the signaling device108can determine that it must output some instructions to that occupant to safely egress from the room.

The predetermined signaling logic218can then select an optimal egress strategy from the list of egress strategies226(refer toFIG.1step H). This selection can be based on information sensed in real-time by the temperature sensor222and/or the user presence sensor224, as previously discussed throughout this disclosure. Once an egress strategy is selected, the predetermined output logic220can determine which form of output should be used to output the egress instructions. This determination can be based on user information, preferences, and/or what devices are installed within the room that the signaling device is located in. Based on that determination, the signaling instructions can be outputted using the audio output system214and/or the visual output system216(refer toFIG.1step I).

FIGS.3A-Care conceptual diagrams of a building floor map with predicted egress strategies that are used to instruct occupants in the building about how to safely exit during an emergency. As depicted, one or more devices can be located in each of the rooms in a house300, including hub310and signaling devices314A-E. The signaling devices314A-E and hub310can communicate via a wired and/or wireless connection, as previously discussed.

In some implementations, rooms, such as a first bedroom306, can include additional sensors, such as a sensor337. The sensor337can detect a presence of a fire, a presence of an occupant, temperature of the bedroom306, and other current conditions in real-time. For example, the sensor337can be a motion detector and/or a smart thermostat. In yet other implementations, the sensor337can be a smoke detector and/or a smart smoke detector, which can act as a primary sensor for determining an existence of a fire and its location. In other implementations, the sensor337can be a thermocouple heat sensor, which is beneficial to sense and report temperatures at various locations as a fire grows and spreads throughout the house300. Optionally, the house300can include a sensor such as sensor337in each of the rooms in the house300along with additional sensors for redundancy (i.e., a sensor can be placed inside each bedroom at a door to each bedroom and a third sensor can be placed in a hallway between both bedrooms). Thermocouple heat sensors can also be placed along a stairway303and throughout the house300with judicious placement near a ceiling height since heat rises and distributes itself. As a result, such sensors are less likely to be visible to home occupants but can still be effective in obtaining accurate temperature readings in real-time.

As discussed, the hub310and/or signaling devices314A-E can also include integrated motion detectors and/or other types of sensors such that individual sensors, such as the sensor337, are not required or heavily relied upon. In general, other devices that can communicate real-time conditions with the hub310and signaling devices314A-E can include smart outlet covers, smoke detectors, sensors, etc. Moreover, any given device, such as a signaling device, can include a motion detector as well as any other devices discussed herein.

In some implementations, the hub310is a master monitoring system and other monitoring devices, such as the signaling devices314A-E are secondary monitoring systems. In some implementations, each secondary monitoring system can take over control as a new master monitoring system if the hub310is out of commission (i.e., consumed by fire). A new master monitoring system can operate using last-received information from the hub310and information received from other secondary monitoring systems. In some implementations, all monitoring systems located in the house300can act as peer devices (i.e., pre-disaster and/or during a disaster), with no device designated as a master monitoring device or hub310.

Additionally or alternatively, devices in the house300can connect to a cloud based service, to upload and download information provided by other devices, so that a given device can send and receive data even if a home network is compromised, for example, by fire. During a disaster, devices may not be able to communicate on a local network, but a smart thermostat or signaling device in one room and the hub310may each be able to communicate via the cloud service (i.e., using a cellular network) and thereby exchange information with each other, using the cloud service as an intermediary.

FIG.3Ais a drawing of the house300that includes a lower level302and the stairway303that goes to an upper level at time t=0. The upper level includes a hallway304, a first bedroom306, and a second bedroom308. In this example, at time t=0, two egress strategies, a first strategy312and a second strategy318, have been predicted, determined, and preloaded into a signaling device314E. The signaling device314E receives information360(refer toFIGS.1-2) which can include (1) a list of potential egress strategies to select from (the first predicted egress strategy312and the second predicted egress strategy318), (2) which strategy the signaling device314E selects as an optimal egress strategy, a first choice366, and (3) which strategy would be second best in case of an error in the signaling device314E's selection, a second choice368.

In some implementations, the bedroom306can include LED lights above a door332and above windows338and336, in addition to a speaker (i.e., integrated into the signaling device314E), and sensors such as the sensor337, which can be a thermocouple heat sensor. Lights, speakers, and/or sensors can also be co-located without wall outlets/sockets. All these devices can be located strategically, including near exit points themselves. These devices can be connected wirelessly or via wires to the hub310and/or other signaling devices314A-E and other devices placed strategically throughout the house300. This configuration can be applied to all the rooms in the house300and/or each room can have a different configuration of devices.

In this example, a fire301occurs on the first level302. Signaling device314E in the first bedroom306can receive a current condition of the fire301from the hub310that is located on the first level302. The hub310can determine that a fire is present on the first level302by using sensors (i.e., temperature, infrared) that measure current conditions in real-time. The hub310can also be in communication with sensors on the first level302that are configured to determine real-time conditions and transmit those conditions to the hub310and the other signaling devices314A-E. The presence of the fire301can be determined, for example, based on one or more received temperature readings being more than a threshold temperature.

As another example, the hub310can receive a fire indication signal from one or more smoke detection devices located on the first level302. Other fire detection approaches can include IR (Infra-Red) fire detection and rate of rise temperature detection. Fire indication information can indicate which location(s) in the house300is on fire (or sufficiently close to a fire so as to be avoided by occupants of the house300).

Once the signaling device314E receives a notification that the fire301is present and where it is located, the signaling device314E selects one of the strategies318and312for an occupant350to safely egress from the house300, using techniques previously mentioned (refer toFIG.1). In this example, the signaling device314E selected the second strategy318, which then is reflected as the signaling device314E's first choice366. The second strategy318is to direct the occupant350out a window338.

In the example ofFIG.3A, at time t=0, the signaling device314E selected the second egress strategy318because based on real-time conditions of the fire301, the occupant350may not have enough time to safely egress from the house300if the occupant350is instructed to take the first egress strategy312out of the house300through a front door330. The server100described in reference toFIG.1had already simulated fires like that depicted inFIG.3Aand determined using predictive analytics how the occupant350would egress based on that occupant's age, agility, and other information. Therefore, all the signaling device314E had to do in real-time was determine which of the modeled egress strategies would match up with the current, real-time conditions of the fire301in this scenario.

In some implementations, a temperature along the first egress strategy312can reach an untenable level even if a point along the strategy312down the stairs303is not yet too hot. Thus, the safest exit is via the second egress strategy318, out the window338. The signaling device314E can make this determination and strategy selection in real-time based on collecting temperature readings from other devices/sensors along each of the egress strategies312and318. In some implementations (not depicted), a door that is opened and/or closed can also change the signaling device314E's determination of which egress strategy to select. For example, if a fire starts in the bedroom306and an occupant is in the bedroom308, wherein both doors332and334are closed, a signaling device in the bedroom308can determine that there is enough time for the occupant to escape through the hallway304, down the stairs303, and through the front door330. The signaling device in the bedroom308can make this determination based on the fact that the door332is closed (i.e., sensors, like the sensor337, placed around the door332determine whether it is open or closed), which can increase the amount of time it would take for (1) the fire to spread from the bedroom306and into the hallway304and (2) a temperature of the hallway304to raise to an untenable level. Moreover, if the door is made of hollow-core or solid-core construction, that condition can also change the signaling device's determination of whether an egress strategy through the hallway304is safe and appropriate. It is worth noting that such a determination can also be made by the server100as depicted inFIG.1, step B when simulating fire scenarios. In another example of a similar situation, if the door332is open, then the signaling device in the bedroom308can determine that the fire will quickly spread into the hallway304and the temperature in the hallway304will rapidly increase to an untenable level before the occupant can escape from the bedroom308. Consequently, the occupant in the bedroom308should not escape through the door334. Instead, the signaling device in the bedroom308can select a modeled egress strategy from the list that leads the occupant out through a window342in the bedroom308.

In a scenario such as that depicted inFIGS.3A-C, if all occupants are on the second level of the house300when the fire301is on the first level302, signaling devices on the second level can work together to determine which egress strategy is optimal for all occupants to exit safely together. This determination can depend on the number of occupants on the second level, their ages and physical abilities, and a particular layout of rooms on the second level. Signaling devices in different rooms can select the same egress strategy out of the house300but can provide occupants in each of the rooms with particular instructions to exit those rooms and meet, for example, in the hallway304to finish exiting together. For example, this would be advantageous where a disabled occupant needs help egressing out of the house300.

In other scenarios, one occupant can receive instructions from a signaling device that direct the occupant to another occupant who is disabled or in need of some form of assistance to safely egress out of the house300(refer toFIG.1). The signaling devices can identify which occupants are in what rooms in real-time. The disclosed system can access information stored about each of the occupants. That stored information can form profiles for each occupant of the house300and can include an age of the occupant, any disabilities, an agility level, etc. The signaling devices and/or the disclosed system can use such information (e.g., occupant profiles) to determine how each occupant can safely egress from the house300and whether that occupant would need assistance from another occupant in the house300. If assistance would be needed, the disclosed system can determine egress strategies that involve one or more occupants getting to and assisting the disabled occupant out of the house300, both safely and quickly. Based on these determinations, the signaling devices can receive such egress strategies and their associated instructions. During a fire scenario, the signaling devices can then select an optimal egress strategy, whether it requires occupants to egress individually, in pairs, and/or in teams, and provide the associated instructions to occupants in the house300.

In implementations where an infant or toddler is in the house300, a signaling device can select the appropriate egress strategy that will account for, and instruct, an occupant to get the infant or toddler and safely exit together. In yet other implementations, visitor information (e.g., age, agility level, familiarity with the house300, disabilities, etc.) can be provided to the disclosed system. This information can be provided by an occupant of the house300via a user computing device, a signaling device, and/or the hub310. Once the visitor information is received by the disclosed system, the disclosed system can use such information to determine potential egress strategies for that visitor and whether the visitor would need assistance to egress in the event of a fire.

In yet other scenarios (not depicted), the signaling device314E may select the second strategy318but something that is unpredicted can occur, such as the window338blowing out in the time it took the occupant350to get out of the bed. If such an unpredicted event was not previously predicted and considered in determining which egress strategy to select in real-time, then the signaling device314E can make a correction and select a new egress strategy within seconds. In this case, where the signaling device314E initially selected the second strategy318, the signaling device can now make a selection correction and select the first strategy312. In that case, the signaling device314E can provide updated instructions to guide the occupant350out the front door rather than through the window. Regardless, the use of predictive analytics, an abundance of data, and AI in the system and techniques described throughout this disclosure greatly reduce the need for correcting an egress strategy selection in real-time.

Still referring toFIG.3A, once the signaling device314E selects an egress strategy (in this case, it is the second strategy318), the occupant350is instructed by the signaling device314E to “exit the room through the window” (316). In this example, the outputted instructions are verbally communicated to the occupant350. In other implementations, the outputted instructions can be communicated to the occupant350by using lights and/or LED strips that illuminate a path out of the house300. In this example, multiple other signaling devices can also produce audio outputs to remind the occupant350to exit through the window338(i.e., signaling device314C in the hallway304verbally outputs “Go back to your room and exit through the window” (320), signaling device314A near the stairs303verbally outputs “The fire will spread. Go back to your room and exit through the window” (324), and the hub310on the first level302near the front door330verbally outputs “Fire on the first level!”). This is beneficial in the event that the occupant350leaves the bedroom306despite instructions signaling for the occupant350to leave through the window338in the bedroom306.FIGS.3A-Cindicate examples of outputted instructions but in each implementation of the disclosed system, the instructions can vary, as demonstrated.

The signaling devices314A-E can emit multi-colored, strobing, LED (Light Emitting Diode) laser light, and can be mounted low, at exit points (i.e., door, window) in each room. LED guiding lights can be mounted low in outlet-type components and/or along pathways leading to egresses from the house300. As mentioned, the signaling devices314A-E can also emit various audio and visual cues to occupants, for example. For instance, the signaling device314E can include flashing lights that may indicate a direction the occupant350is to take to proceed to (or stay on) the selected egress strategy318out the window338. A series of flashing lights (i.e., in a hallway) can also indicate a presence and direction of the selected egress strategy. Moreover, the signaling devices314A-E can be placed on doors and windows to indicate the presence of respective doors and windows and to indicate whether a given door or window is part of an egress route. Different colors can indicate inclusion or exclusion of a given door, window, or pathway on an egress route.

For example, a flashing red signal (i.e., a red “X”) on a doorway may indicate that the doorway is to be avoided (and the door kept shut). In the implementation depicted inFIG.3A, the signaling device314D or signaling device314E can project a flashing red “X” over the door332so that the occupant350understands not to exit the bedroom306. In another implementation, a flashing green light may indicate that a given door, window, or path segment is part of the selected egress route. In the example ofFIG.3A, the signaling device314E can project the flashing green light on the window338to instruct the occupant350that he must exit through that window338.

Audio instructions that are outputted by the signaling devices314A-E can include a fire status description (i.e. “a fire has been detected downstairs”), directional clues (i.e. “go out of the door and to your left”), or more detailed instructions (i.e. “place a wet towel under the door and leave the door closed”). Audio instructions can be specific to the particular room in which an audio signaling device is located, based on the location of the room, the location of the detected fire, and a selected egress strategy.

Other types of signaling instructions and corresponding signals can be generated in the house300. For example, information can be sent to mobile devices of occupants of the house300that directs the occupants to and on the selected egress route(s). The hub310, secondary monitoring systems, and/or an application running on a mobile device may know where the mobile device (and associated user) are within the house300, with respect to the fire301and the selected egress route(s). Such knowledge can be used to tailor instructions that are sent to and displayed (or played) on a given mobile device.

Other devices in the home may receive and present information related to the fire301and recommended evacuation of the house300. For example, the hub310can communicate with various computing devices or displays located within the house300. For example, the hub310can send information or signaling instructions to one or more desktop computing devices, smart televisions, or other devices located within the house300. The computing devices can be configured to display information (i.e., a fire warning, egress route information), based on information received from the hub310. In some implementations, the hub310can remotely control (i.e., turn on) devices that include a display, and instruct the devices to display (and/or play) information useful for evacuation of the home300, such as egress route information that is specific to the location of the fire301and the location of the respective device (i.e., a smart television in the lower level302may display different information from a smart television in the bedroom306)

FIG.3Bis a depiction of the house300at time t=1. This example demonstrates where a hypothetical occupant370would be had he taken the first predicted egress strategy312to exit through the front door330of the house300. As depicted, the fire301has moved closer to the front door330. Therefore, the signaling device314E accurately predicted, at time t=0, where the fire301would spread at time t=1 to then select the optimal egress strategy (the second strategy318out the window338) to safely exit the house300.

FIG.3Cis a depiction of the house300at time t=2. This example demonstrates that, at time t=2, the hypothetical occupant370would be running into the fire301that has now spread to the stairs303had the hypothetical occupant370been instructed to take the first predicted egress strategy312to exit through the front door330. However, at time t=2, the occupant350has safely exited the house300through the window338by following the signaling device314E's instructions352that are associated with the selected second egress strategy318.

FIG.4is a conceptual diagram of yet another example floor map for which a predicted egress strategy is selected and used during an emergency. This figure is another implementation of the scenario depicted inFIGS.3A-C. In this implementation, a hub410can determine, and communicate to signaling devices418A-E, that a fire414is blocking a stairway403. The signaling device418E can select egress strategy424from a list of preloaded, predicted egress strategies associated with exiting bedroom406and instruct an occupant481in the bedroom406to exit through window430. The occupant481can receive an audio message426from the signaling device418E that instructs the occupant481about what to do as part of the selected egress strategy424. For example, the audio message426can direct the occupant481to use a ladder, if available, to exit through the window430. If the ladder is not available, the audio message426can direct the occupant481to get a wet towel, place it under a door428, close the door428(and not subsequently open it), and signal firefighters from a window (i.e. the window430). These types of audio instructions are beneficial in scenarios in which the occupant481is in a room on a second level of the house400and the occupant481cannot safely egress down the stairs403. These audio instructions are also beneficial in scenarios in which fire fighters and/or other emergency assistance is on its way to help the occupant481.

Referring back to the example where the signaling device418E instructs the occupant481about getting the wet towel, based on known locations of the fire414and a bathroom409, the signaling device418E can determine that the occupant481has time and access to retrieve the wet towel before closing the door428. The signaling device418E may also know that the door428is currently open (i.e., based on information provided by one or more sensors surrounding the door428), and can direct the occupant481to get the wet towel based on the door428being currently open. If the signaling device418E knows that the door428is currently closed, it can play an audio message that directs the occupant481to keep the door428closed.

Other signals can be emitted in the bedroom406to direct the occupant481on what to do during the emergency. For example, the signaling device418E and a signaling device418D can direct the occupant481towards the window430by emitting directional lights as disclosed throughout this disclosure. Further, devices436and438can also emit signals to indicate the presence of the window430(i.e., flashing lights, symbols above the window430indicating that the window430is the appropriate exit, green lights to indicate that the occupant481should go through the window430, etc.).

Guidance similar to that provided in the bedroom406can be provided in other rooms throughout the house400. For example, devices440and442and444and446can indicate the presence of a window448or a window450, respectively. Signaling device418C can emit a directional signal directing occupants to the window448and the window450, and can play an audio recording (i.e., messages, instructions, etc.) that directs occupants to not use the stairway403. A device456can also emit a signal indicating that a door458is not part of a selected egress route. As previously mentioned, each signaling device can select an egress strategy from the list of predicted, preloaded egress strategies associated with the room that each signaling device is located in. Therefore, in the example above, the signaling device418C located in a bedroom408can select an egress strategy from the list of predicted strategies associated with the bedroom408that directs an occupant in the bedroom408out through the window450. The signaling device418C can use the same current conditions collected from other signaling devices and sensors throughout the house400as the signaling device418E in the bedroom406to determine that an egress strategy out through the door458and down the stairway403would not be the optimal and safest exit route. Therefore, the signaling device418C can select the egress strategy associated with the bedroom408that directs the occupant out the window450, just like the signaling device418E selected the egress strategy424associated with the bedroom406that directs the occupant481out the window430.

Other signals can be played throughout the house400. For example, signaling device418B in a hallway405can play an audio messages466directing occupants to not use the stairway403. A device468can also play an audio message470directing occupants to not enter a lower level402. The various signals played by various devices in the house400can be emitted in response to egress strategies that each of the signaling devices418A-E select.

In some implementations, as depicted inFIG.4, fire fighter or other safety personnel can receive information provided by the hub410. The hub410can send information to a fire fighter system or device and/or to a cloud service to enable the fire fighter system or device to retrieve the information from the cloud service. In some implementations, any of the signaling devices locate in the house400can transmit information and communicate with the fire fighter system. Information obtained from the hub410can be displayed, for example, on a fire fighter device472, which can be a mobile device, as shown (i.e., in a fire truck474that is en route to the house400).

The fire truck474may be en route, based on receiving an alarm from the hub410. Information476displayed on the fire fighter device472includes fire location and stairway blockage information478, number and location of occupants480(i.e., for an occupant481), last occupant movement information482, status484of doors and windows in the house400, a timeframe486of when last audio instructions were played for occupants in the house400, and an entrance suggestion488so that the safety personnel know how to safely enter the house400. In addition or alternatively, the information476can include location(s) of fire hydrants. The information476can be used by the fire fighters to better respond to the fire situation in the house400and to safely enter the house400.

The number and location of occupants480and the last occupant movement information482can be generated based on motion detection devices in the house400. Such devices can be integrating into the signaling devices418A-E or can be standalone/independent devices, such as devices436,438,440,442,444, and446. Fire fighters can tailor their emergency response based on information that indicates who may be in the house400and where they are located. Occupant movement information can be generated and sent to a cloud service, on a periodic basis, for example. Security measures can be implemented so that occupant movement information is only accessed by authorized personnel, and optionally, only in cases of an emergency (i.e., only fire fighters can view occupant status information and only after an alarm has been received from the hub410or any of the signaling devices418A-E). For some cases, the hub410may know that no occupant movement has been detected, i.e., within the last forty-eight hours, which may indicate that the house400is not occupied. Such information can be shared with the fire fighter system, so that fire fighters know that the house400may not be occupied and thus can determine whether they need to endanger themselves by entering the house400(or a certain level of the house400).

In some scenarios (not depicted), the house400can be vacant but the fire fighters still need to enter the house400to extinguish the fire before it spreads to other buildings, structures, and/or surrounding area(s). Consequently, the disclosed system can assist the fire fighters in assessing the danger of entering the burning house400. For example, thermocouples and/or other types of sensing devices (e.g., smoke detectors, temperature readers, etc.) placed throughout the house400can be used to capture real-time conditions of a fire as it spreads through the house400. The captured real-time conditions can be used by the disclosed system to determine whether the fire has spread. Consequently, the disclosed system can use this information to determine which windows, doors, exits, and/or entry points are still open and safe options for fire fighters to use when entering the house400. Upon making this determination, the disclosed system can provide the possible entry points to the fire fighter system disclosed throughout and the fire fighters can then choose an entry point to safely enter the house400. While the fire fighters are in transit to the house400, the fire fighter system can also receive a floorplan for the house400from the disclosed system. The fire fighter system can also receive real-time updates about the fire pathway so that the fire fighters can use this information to determine which entrance to take into the house400. It is also possible that the fire fighter system can automatically determine which entrance to take into the house400and then provide that information along with associated instructions to the fire fighters. Moreover, predictive analytics and AI can be used to predict flashovers. Flashovers are caused by radiative heat transfer from ignited materials in the interior of a room to its bounding surfaces in which pyrolysis on those surfaces releases particles and gases leading to sudden explosion. Therefore, by predicting where and when in the house400there may be flashovers, the disclosed systems can better determine an optimal and safe strategy/pathway for the fire fighters to enter the house400. This can be beneficial to fire fighters whether they are entering a vacant burning house to prevent the fire from spreading and/or entering a burning house to save its occupants.

Referring back toFIG.4, the fire fighter system can share information with the hub410and the signaling devices418A-E, and the hub410may tailor guidance based on the received information. For example, an estimated fire fighter response time may be sent by a fire fighter system in response to an alarm received from the hub410. The hub410and/or each of the signaling devices418A-E can receive the estimated fire fighter response time. Based on the estimated response time, one or more of the signaling deices418A-E can output additional instructions to the occupants (i.e., occupant481). For example, if the expected response time is less than a threshold amount (i.e., less than two minutes), the signaling device418E can play an audio message that directs the occupant481to open the window430and wave something out the window430to attract fire fighter attention. In other implementations, the signaling device418E can be configured to start playing a sound or audio message to draw attention of fire fighters based on an estimated fire fighter response time. Estimated response times may be dynamically received, as mentioned, or may be predetermined and available to the signaling devices418A-E and the hub410before the emergency.

Occupant movement information and information about known occupants may be used by signaling devices418A-E to tailor guidance to occupants in the house400. For example, if an occupant is detected in a room (i.e. the occupant is still sleeping), then one or more signaling devices418A-E can play audio messages in other rooms that indicate that the occupant may still be in a particular room and in need of assistance. In yet other implementations, and as previously discussed, information about known occupants can be used by the signaling devices418A-E to determine a selection of the optimal egress strategy from the list of predicted, preloaded egress strategies.

In some implementations, after fire fighter arrival, movement of fire fighters within the house400can be determined by movement detection devices in the house400. Location information of fire fighters (and occupants) can be made available to and presented on the fire fighter device472, for assisting the fire fighter team during the emergency response.

The entrance suggestion488can be determined by the signaling devices418A-Es' selection of optimal egress strategies. For example, inFIG.4, the signaling device418E selected egress strategy424as the optimal egress strategy for the occupant481out of the bedroom406. The instructions outputted by the signaling device418E prompt the occupant481to exit through the window430if there is a ladder and if there is not, to wave something out of the window430to attract the attention of fire fighters. The signaling device418E communicates with the fire fighter device472that the occupant481will be exiting through the bedroom window430(entrance suggestion488). Receiving this information at the fire fighter device472makes for faster and safer response time during an emergency. In other words, when fire fighters arrive at the house400, they will not have to spend valuable time determining what is the best entrance into the burning house400and where the occupant481is located in the house400. In scenarios where a signaling device must make one course correction, the information about the entrance suggestion488can be updated and transmitted to the fire fighter device472in real-time such that no time is lost for the fire fighters to safely assist the occupant481. In some implementations, as depicted inFIG.4, the entrance suggestion488can also provide some sort of indicator to make it easier for the fire fighters to identify the entrance point when they arrive at the scene. For example, inFIG.4, the fire fighter device472receives information that the bedroom window is open. In other examples, the device472can receive information about what corner/area/front/back/side of the house400that the fire fighters should enter, what level of the house400, whether a door or window is open or closed, whether something is coming out of the door or window to indicate it as an entrance, whether lights emitted from inside the house400indicate an entrance (i.e., LED light strips attached on top of the molding of a window), etc.

FIG.5depicts a flowchart of an example technique for predicting egress strategies and selecting the optimal egress strategy during an emergency. The technique described can be performed by the predictive pathway server100and each of the signaling devices108A-D ofFIG.1. First, in step502, the server receives home layout and user occupant information. As discussed, this information can be inputted by occupants through the hub device (refer toFIG.1step A). This information can also be transmitted directly to the server by a homebuilder when the house is being constructed and/or when the signaling devices and hub are being installed in the house.

Next, in step504, the server can simulate fire scenarios in the house based on the information received in step502(refer toFIG.1, step B). The server also performs predictive analytics on an ability for occupants to safely egress from rooms in the home in step506(refer toFIG.1, step C). Based on the simulations and predictive analytics, the server can then model egress strategies in step508(refer toFIG.1, step D). As previously described, the server can create a list of egress strategies for each room in the house that are based on the ability of occupants in the house to safely egress from the house during an emergency.

Once egress strategies are modeled, the server can model signaling instructions that are associated with each of the modeled egress strategies in step510(refer toFIG.1, step E). In this step, the server can create both audio and visual signaling instructions or one or the other. Next, in step512, the server can transmit the modeled egress strategies and associated signaling instructions to each signaling device (refer toFIG.1, step F). Each signaling device receives the list of modeled egress strategies and signaling instructions that are associated with the particular room that the signaling device is located in (514). For example, if the signaling device is located in the kitchen, then it will only receive a list of predicted egress strategies and signaling instructions for an occupant to exit from the kitchen. Likewise, if the signaling device is located in a first bedroom, that signaling device will receive a list of egress strategies and associated signaling instructions for an occupant to exit from the first bedroom.

Once each signaling device preloads the list of egress strategies, the signaling devices can receive current conditions in real-time in step516(refer toFIG.1, step G). As previously discussed, each signaling device can detect current conditions itself and/or it can communicate, wireless or wired, with the hub, other signaling devices, and/or other devices in the house (i.e., smart thermostat, temperature sensors, smoke detector, motion detector, etc.) about current conditions in any room in the house. Based on the current conditions, for example, a fire started in the kitchen, the signaling device can select an optimal egress strategy from the preloaded list of egress strategies in step518(refer toFIG.1, step H). The primary goal is that due to the simulations and predictive analytics performed beforehand by the server in steps504-506, the signaling devices can select the optimal egress strategies without having to correct those selections in real-time.

Once an egress strategy is selected, the signaling device outputs the selected egress strategy based on the associated signaling instructions in step520(refer toFIG.1, Step I). As discussed, the signaling device can emit a signal, such as lights and/or audio, that indicate to the occupant the directions to take to exit the home quickly and safely.

FIG.6is an example apparatus600for providing emergency guidance and advisement in accordance with this present disclosure. In this implementation, the apparatus600is configured as an electrical power outlet that includes one or more receptacles601. The apparatus600can be configured to include a user detection device, a fire detection device, and a signaling device (i.e., signaling devices108A-D inFIG.1), which are devices depicted in the previous figures. In other implementations, the apparatus600can be configured to implement one or more of the user detection device, the fire detection device, and the signaling device, with or without other functionalities.

The apparatus600includes a user detector602, a fire detector604, a communication device606, a speaker608, and a display device610. The user detector602can be configured for, or be part of, the user detection device. For example, the user detector602operates to detect user motion or presence around the apparatus600over time. The user motion or presence can be recorded locally in the apparatus600and/or in one or more remote computing devices. As described herein, the user detector602can be of various types, such as motion sensors and cameras. In addition or alternatively, the user detector602can include a door/window sensor, door/window locks, etc.

The fire detector604can be configured for, or be part of, the fire detection device, and operates to detect presence and location of fire. Information on the fire presence and location can be recorded locally in the apparatus600and/or in one or more remote computing devices. As described herein, the fire detector604can be of various types, such as a smoke detector and a heat sensor (i.e., a temperature sensor, an infrared sensor, etc.).

The communication device606is included in the apparatus600and configured to enable data communication with the hub and other signaling devices. The communication device606can include a wireless or wired data communication interface.

The speaker608and the display device610can be configured for, or be part of, the signaling device. The speaker608operates to generate sounds, such as audible cues, horns, or verbal messages for egress guidance. The speaker608can be used to supplement other fixed audio devices or act as a substitute if fixed audio devices are not functioning. Such sounds can complement visual signs in situations where smoke intensity can diminish or preclude the ability to see the visual signs. The display device610operates to display visual signs that can guide a user along a selected egress route. In some implementations, the display device610includes a display screen that is provided in the apparatus600and displays information with visual signs thereon. In addition or alternatively, the display device610operates as a projector that projects a lighted sign on another object, such as a wall, a floor, or a ceiling. In the illustrated example, the display device610projects a lighted arrow612on the floor to guide the direction in the selected egress route.

FIG.7is another example apparatus630for providing emergency guidance and advisement in accordance with this present disclosure. The apparatus630is configured similar to the apparatus600except that the apparatus630is implemented as an electrical switch having a switch button632. Similar to the apparatus600, the apparatus630can include at least one of the user detector602, the fire detector604, the communication device606, the speaker608, and the display device610. As the apparatus630is similar to the apparatus600, the description of the apparatus600is incorporated by reference with respect to the apparatus630.

FIG.8Adepicts another example system for providing emergency guidance and advisement. The signaling device108ofFIGS.1-2is used as an example inFIG.8A. The signaling device108can be a singular device, as depicted inFIG.8A, or it can optionally be spread out physically with separate components that can be in wired or wireless communication with each other (refer toFIG.8B). In this example inFIG.8A, the signaling device108includes a light signaling component830, an audio signaling component840, and a signaling controller852. In some implementations, the signaling controller852can have a one-to-one ratio of communication. Alternatively, in some implementations, the signaling device852can have a one-to-multiple ratio of communication. The audio signaling component840and/or the light signaling component830can optionally be integrated into/part of a same housing unit and/or circuit board as each other, the signaling controller852, and/or the entire signaling device108as a whole. Alternatively, and in some preferred implementations, each of the components inFIG.8A,830,840, and852, can be housed separately (i.e., separate devices; refer toFIG.8B). In yet other implementations, the controller852can be in the same housing with the light signaling component830and the audio signaling component840can be housed separately. In other implementations, the controller852and the audio signaling component840can share the same housing unit/circuit board while the light signaling component830is arranged separately. Moreover, in some implementations, the components830and840can be housed in the same unit and the signaling controller852can be housed separately.

In the example ofFIG.8A, the components830and840are housed in the same unit (i.e., the signaling device108) as the signaling controller852. Optionally, the signaling device108can have an external power supply870(i.e., lithium battery). The signaling device108can also receive fire signals from the hub device106as described throughout this disclosure (refer toFIGS.1-2). The signaling controller852can communicate directly with the light signaling component830as well as the audio signaling component840.

The signaling controller852can include a predetermined signaling logic854, a predetermined output logic856, a temperature sensor858, and a user presence sensor860, as previously discussed in reference toFIG.2. In some implementations, the controller852may not have sensors858and860, and can instead collect sensor information regarding a temperature and/or user presence from sensors placed throughout the house and/or other signaling devices in the house. The controller852further can include a communications interface862to facilitate communication (i.e., wired or wireless) with the other components,830and840, comprising the signaling device108. The communications interface862can also facilitate communication between the signaling device108, the hub device106, other signaling devices throughout the house, and sensors in the house. The signaling controller852can also optionally include a power source864(i.e., battery) in order to power the signaling controller852and/or the signaling device108.

The light signaling component830can include a light source832, a controller834, a communications interface836, and an optional power source838. The light source832can be any form of lighting, including but not limited to an LED light strip (refer toFIG.8B). The light source832can emit different colors, patterns, symbols based on signaling instructions communicated to the light signaling component830by the signaling controller852. The controller834can be configured to activate the light source832based on receiving an activation signal/instruction from the signaling controller852. The communications interface836is configured to allow the light signaling component830to communicate with the signaling controller852. As mentioned, the power source838can power the light signaling component830. In some implementations, the component830may not include the power source838and can instead rely on power from the external power supply870that provides power to the signaling device108as a whole.

The audio signaling component840can include a speaker842, a controller844, a communications interface846, stored audio signals848, and an optional power source850. The speaker842can be any form or mechanism to output audio cues/instructions (refer toFIG.8B). The speaker842can emit audio/verbal instructions to a user in the house based on signaling instructions communicated to the audio signaling component840by the signaling controller852. The controller844can be configured to activate the speaker842based on receiving an activation signal/instruction from the signaling controller852. The communications interface846is configured to allow the audio signaling component840to communicate with the signaling controller852. The audio signaling component840can further include the stored audio signals848, which can include a plurality of verbal instructions that are associated with each possible egress strategy out of a room that the signaling device108is located within. Therefore, when the signaling controller852transmits an activation signal to the audio signaling component840, the activation signal can indicate which of the stored audio signals from the stored audio signals848should be played. Then, the controller844can activate the speaker842by having the speaker output the selected audio signals from the stored audio signals848. As mentioned, the power source850can power the audio signaling component840. In some implementations, the component840may not include the power source850and can instead rely on power from the external power supply870that provides power to the signaling device108as a whole.

FIG.8Bdepicts an example system for providing emergency guidance and advisement. In this example room800, a door802is fitted with a first LED strip812. The first LED strip812can be attached on top of a molding of the door802or anywhere else along a perimeter of the door802. A window804is also fitted with a second LED strip810, which can be attached on top of a molding of the window804or anywhere else along a perimeter of the window804. This way, the first and second LED strips812and810are not visible to an occupant or at least are not prominently displayed in the room800.

In this example, a signaling device806is also configured to a wall of the room800. The signaling device806can be retrofitted into an existing socket in the wall. In other implementations, the signaling device806can be a plug-in that is inputted into an outlet in the room800. Here, the signaling device806supports audio output. Thus, the signaling device806communicates with the first and second LED strips812and810to display additional and/or alternative signals to an occupant during an emergency. The strips812and810and the signaling device806can communicate through a wired and/or wireless connection, as previously discussed throughout this disclosure, wherein a communication signal (i.e., activation signal) between the signaling device806and the first LED strip812is signal820B and a communication signal between the signaling device806and the second LED strip810is signal820A. During an emergency and once the signaling device806selects an optimal egress strategy, the signaling device806can communicate visual signaling instructions to the first and second LED strips812and810via the signals820B and820A, respectively.

For example, if the selected egress strategy requires the occupant to exit through the door802, the signaling device806can prompt (i.e., send an activating signal) the first LED strip812to turn green, depict arrows, and/or flash. The signaling device806can also prompt the second LED strip810to turn red and/or depict “X” signals so that the occupant understands not to exit through the window804. The signaling device806can optionally output audio messages instructing the occupant about how to exit in addition to the first and second LED strips812and810displaying visual signals for exiting the room800.

The computing devices described in this document that may be used to implement the systems, techniques, machines, and/or apparatuses can operate as clients and/or servers, and can include one or more of a variety of appropriate computing devices, such as laptops, desktops, workstations, servers, blade servers, mainframes, mobile computing devices (e.g., PDAs, cellular telephones, smartphones, and/or other similar computing devices), computer storage devices (e.g., Universal Serial Bus (USB) flash drives, RFID storage devices, solid state hard drives, hard-disc storage devices), and/or other similar computing devices. For example, USB flash drives may store operating systems and other applications, and can include input/output components, such as wireless transmitters and/or USB connectors that may be inserted into a USB port of another computing device.

Such computing devices may include one or more of the following components: processors, memory (e.g., random access memory (RAM) and/or other forms of volatile memory), storage devices (e.g., solid-state hard drive, hard disc drive, and/or other forms of non-volatile memory), high-speed interfaces connecting various components to each other (e.g., connecting one or more processors to memory and/or to high-speed expansion ports), and/or low speed interfaces connecting various components to each other (e.g., connecting one or more processors to a low speed bus and/or storage devices). Such components can be interconnected using various busses, and may be mounted across one or more motherboards that are communicatively connected to each other, or in other appropriate manners. In some implementations, computing devices can include pluralities of the components listed above, including a plurality of processors, a plurality of memories, a plurality of types of memories, a plurality of storage devices, and/or a plurality of buses. A plurality of computing devices can be connected to each other and can coordinate at least a portion of their computing resources to perform one or more operations, such as providing a multi-processor computer system, a computer server system, and/or a cloud-based computer system.

Processors can process instructions for execution within computing devices, including instructions stored in memory and/or on storage devices. Such processing of instructions can cause various operations to be performed, including causing visual, audible, and/or haptic information to be output by one or more input/output devices, such as a display that is configured to output graphical information, such as a graphical user interface (GUI). Processors can be implemented as a chipset of chips that include separate and/or multiple analog and digital processors. Processors may be implemented using any of a number of architectures, such as a CISC (Complex Instruction Set Computers) processor architecture, a RISC (Reduced Instruction Set Computer) processor architecture, and/or a MISC (Minimal Instruction Set Computer) processor architecture. Processors may provide, for example, coordination of other components computing devices, such as control of user interfaces, applications that are run by the devices, and wireless communication by the devices.

Memory can store information within computing devices, including instructions to be executed by one or more processors. Memory can include a volatile memory unit or units, such as synchronous RAM (e.g., double data rate synchronous dynamic random access memory (DDR SDRAM), DDR2 SDRAM, DDR3 SDRAM, DDR4 SDRAM), asynchronous RAM (e.g., fast page mode dynamic RAM (FPM DRAM), extended data out DRAM (EDO DRAM)), graphics RAM (e.g., graphics DDR4 (GDDR4), GDDR5). In some implementations, memory can include a non-volatile memory unit or units (e.g., flash memory). Memory can also be another form of computer-readable medium, such as magnetic and/or optical disks.

Storage devices can be capable of providing mass storage for computing devices and can include a computer-readable medium, such as a floppy disk device, a hard disk device, an optical disk device, a Microdrive, or a tape device, a flash memory or other similar solid state memory device, or an array of devices, including devices in a storage area network or other configurations. Computer program products can be tangibly embodied in an information carrier, such as memory, storage devices, cache memory within a processor, and/or other appropriate computer-readable medium. Computer program products may also contain instructions that, when executed by one or more computing devices, perform one or more methods or techniques, such as those described above.

High speed controllers can manage bandwidth-intensive operations for computing devices, while the low speed controllers can manage lower bandwidth-intensive operations. Such allocation of functions is exemplary only. In some implementations, a high-speed controller is coupled to memory, display (e.g., through a graphics processor or accelerator), and to high-speed expansion ports, which may accept various expansion cards; and a low-speed controller is coupled to one or more storage devices and low-speed expansion ports, which may include various communication ports (e.g., USB, Bluetooth, Ethernet, wireless Ethernet) that may be coupled to one or more input/output devices, such as keyboards, pointing devices (e.g., mouse, touchpad, track ball), printers, scanners, copiers, digital cameras, microphones, displays, haptic devices, and/or networking devices such as switches and/or routers (e.g., through a network adapter).

Displays may include any of a variety of appropriate display devices, such as TFT (Thin-Film-Transistor Liquid Crystal Display) displays, OLED (Organic Light Emitting Diode) displays, touchscreen devices, presence sensing display devices, and/or other appropriate display technology. Displays can be coupled to appropriate circuitry for driving the displays to output graphical and other information to a user.

Expansion memory may also be provided and connected to computing devices through one or more expansion interfaces, which may include, for example, a SIMM (Single In Line Memory Module) card interfaces. Such expansion memory may provide extra storage space for computing devices and/or may store applications or other information that is accessible by computing devices. For example, expansion memory may include instructions to carry out and/or supplement the techniques described above, and/or may include secure information (e.g., expansion memory may include a security module and may be programmed with instructions that permit secure use on a computing device).

Computing devices may communicate wirelessly through one or more communication interfaces, which may include digital signal processing circuitry when appropriate. Communication interfaces may provide for communications under various modes or protocols, such as GSM voice calls, messaging protocols (e.g., SMS, EMS, or MMS messaging), CDMA, TDMA, PDC, WCDMA, CDMA2000, GPRS, 4G protocols (e.g., 4G LTE), and/or other appropriate protocols. Such communication may occur, for example, through one or more radio-frequency transceivers. In addition, short-range communication may occur, such as using a Bluetooth, Wi-Fi, or other such transceivers. In addition, a GPS (Global Positioning System) receiver module may provide additional navigation and location-related wireless data to computing devices, which may be used as appropriate by applications running on computing devices.

Computing devices may also communicate audibly using one or more audio codecs, which may receive spoken information from a user and convert it to usable digital information. Such audio codecs may additionally generate audible sound for a user, such as through one or more speakers that are part of or connected to a computing device. Such sound may include sound from voice telephone calls, may include recorded sound (e.g., voice messages, music files, etc.), and may also include sound generated by applications operating on computing devices.

Various implementations of the systems, devices, and techniques described here can be realized in digital electronic circuitry, integrated circuitry, specially designed ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

These computer programs (also known as programs, software, software applications, or code) can include machine instructions for a programmable processor, and can be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly/machine language. As used herein, the terms “machine-readable medium” “computer-readable medium” refers to any computer program product, apparatus and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., LCD display screen, LED display screen) for displaying information to users, a keyboard, and a pointing device (e.g., a mouse, a trackball, touchscreen) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, and/or tactile feedback); and input from the user can be received in any form, including acoustic, speech, and/or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (“LAN”), a wide area network (“WAN”), peer-to-peer networks (having ad-hoc or static members), grid computing infrastructures, and the Internet.

The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

The above description provides examples of some implementations. Other implementations that are not explicitly described above are also possible, such as implementations based on modifications and/or variations of the features described above. For example, the techniques described above may be implemented in different orders, with the inclusion of one or more additional steps, and/or with the exclusion of one or more of the identified steps. Additionally, the steps and techniques described above as being performed by some computing devices and/or systems may alternatively, or additionally, be performed by other computing devices and/or systems that are described above or other computing devices and/or systems that are not explicitly described. Similarly, the systems, devices, and apparatuses may include one or more additional features, may exclude one or more of the identified features, and/or include the identified features combined in a different way than presented above. Features that are described as singular may be implemented as a plurality of such features. Likewise, features that are described as a plurality may be implemented as singular instances of such features. The drawings are intended to be illustrative and may not precisely depict some implementations. Variations in sizing, placement, shapes, angles, and/or the positioning of features relative to each other are possible.