Patent Description:
A thermal imaging camera is a vital tool for firefighters. Typically, a crew of firefighters will carry a single thermal imaging camera. Currently, the benefits of the conventional thermal imaging camera are limited to the explicit user, and can only be viewed in real-time or near real-time (i.e., immediately or in milliseconds from the time of capture) on the display of the camera.

<CIT> describes a shoulder microphone including infrared-light LEDs surrounding a camera for use in police services. The infrared-light LEDs can be automatically activated when the background light amount detected by a sensor is lower than a predetermined amount, thereby activating the night vision function.

<CIT> describes a talk device for use in a prison system. The device includes infrared night vision lamp arranged around a camera. The night vision function can be activated when a background light amount detected by a sensor is insufficient.

The present disclosure concerns implementing systems and methods for operating a shoulder SM device coupled to a radio. The method according to the present invention is set out in claim <NUM>.

Activation of the thermal imaging device is achieved autonomously based on location information generated by a location device of the shoulder SM device or radio.

In some scenarios, the method also comprise: displaying the thermal images on a display integrated with the shoulder SM device in real-time or near real-time; detecting an injured or unresponsive person based on at least one of the thermal images and location information generated by a location device of the shoulder SM device or radio; issuing an alarm, alert or notification indicating that an injured or unresponsive person has been detected; and/or tracking movement of the injured or unresponsive person based on at least the thermal images. The alarm, alert or notification causes one or more individuals to be dispatched to the last known location of the injured or unresponsive person.

In those or other scenarios, the methods further comprise: storing the thermal images in at least one of a memory local to the shoulder SM device and a remote datastore; and/or deactivating the thermal imaging device when the incident event is resolved, the user of the radio has checked-out of the incident event, or the shoulder SM device no longer resides at a location of the incident event. Deactivation of the thermal imaging device may be achieved through a user-software interaction facilitated by a user interface element of the shoulder SM device, automatically in response to a signal received from a remote device, automatically in response to a voice command received by the shoulder SM device or radio, or autonomously based on location information generated by a location device of the shoulder SM device or radio.

The present document also concerns a shoulder SM device. The shoulder SM device according to the present invention is set out in claim <NUM>.

In some scenarios, the processor is also configured to: detect an injured or unresponsive person based on at least one of the thermal images and location information; cause issuance of an alarm, alert or notification indicating that an injured or unresponsive person has been detected; and/or track movement of the injured or unresponsive person based on at least the thermal images. The alarm, alert or notification causes one or more individuals to be dispatched to the last known location of the injured or unresponsive person.

In those or other scenarios, activation of the thermal imaging device may be achieved through a user-software interaction facilitated by a user interface element of the shoulder SM device, automatically in response to a signal received from a remote device, or automatically in response to a voice command. Additionally or alternatively, the thermal imaging device is further configured to be deactivated when the incident event is resolved, the user has checked-out of the incident event, or the shoulder SM device no longer resides at a location of the incident event. Deactivation of the thermal imaging device may be achieved through a user-software interaction facilitated by a user interface element of the shoulder SM device, automatically in response to a signal received from a remote device, automatically in response to a voice command, or autonomously based on location information.

Embodiments will be described with reference to the following drawing figures, in which like numerals represent like items throughout the figures.

The present invention may be embodied in other specific forms The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by this detailed description.

Furthermore, the described features, advantages and characteristics of the invention may be combined in any suitable manner in one or more embodiments.

The present solution concerns systems and methods for facilitating the safety of personnel during public safety incidents. The systems comprise LMRs communicatively coupled to novel shoulder SM devices. The LMRs include Short Range Communication ("SRC") enabled devices, Near Field Communication ("NFC") enabled devices, and/or Radio Frequency Identification ("RFID") enabled devices. The NFC and/or RFID enabled devices are used by individuals to check-into and/or check-out of an incident event via a field computing device (e.g., a laptop, a tablet, a smart phone, a separate LMR device, or other mobile device). The SRC enabled devices are used to communicate check-in/check-out information and other information to a central location (e.g., dispatch center) for storage and/or processing. The other information may include, but is not limited to, timestamp information, unique identifiers, thermal imaging data generated by the shoulder SM devices during the incident event and/or audio data captured by the shoulder SM devices during the incident event. The other information may additionally be communicated from an LMR to the field computing device and/or the other LMRs present at the incident event.

The thermal imaging data and audio data provides information about a surrounding environment and/or the health of the individual(s) at the time of checking-in to the incident event, during the time period in which the incident event is being handled, and/or at the time of checking-out of the incident event. The check-in information includes, but is not limited to, unique identifiers, check-in times and/or location information (e.g., Global Positioning System ("GPS") coordinates). The event handling information includes the temperature of the individual(s), movement of the individual(s), the lack of movement of the individual(s), location information, and/or timestamps. The check-out information includes, but is not limited to, unique identifiers, check-out times and/or location information (e.g., GPS coordinates).

Referring now to <FIG>, there is provided an illustration of an illustrative public safety incident system <NUM>. System <NUM> is designed to manage operations by a field personnel member <NUM><NUM>,. , <NUM>N (collectively referred to as "<NUM>") of public safety and security organizations (e.g., the fire department, police department and/or other emergency response organizations). Each field personnel member is assigned and provided an LMR <NUM><NUM>,. , <NUM>N (collectively referred to as "<NUM>") and a novel shoulder SM device <NUM><NUM>,. , <NUM>N (collectively referred to as "<NUM>"). Similar to conventional LMRs (e.g., the LMR disclosed in <CIT>), the LMR <NUM><NUM>,. , <NUM>N is configured to provide communication with other LMRs and/or a packet switched LMR infrastructure <NUM> via an LMR network <NUM> and/or a cellular data network <NUM>. The packet switched LMR infrastructure <NUM> includes, but is not limited to, base stations and/or routers.

The LMR <NUM><NUM>, <NUM><NUM>,. , <NUM>N additionally implements RFID technology, NFC technology, and/or SRC technology. The RFID, NFC and/or SRC technologies facilitate communications between the LMR and a field computing device <NUM> for incident check-in/check-out purposes. The field computing device <NUM> includes, but is not limited to, an LMR, a ruggedized tablet, or other incident command solution.

During these RFID, NFC and/or SRC communications, unique identifiers are provided from the LMRs to the field computing device <NUM>. These unique identifiers are used by the field computing device <NUM> to identify the individual field personnel members <NUM> that are checking-into an incident event and/or checking-out of an incident event. The field computing device <NUM> respectively sends signals to the LMRs when the individual field personnel members <NUM> are successfully checked-in to an incident event. In response to this signal from the field computing device <NUM>, the LMRs perform operations to enable the thermal imaging functions of the shoulder SM devices <NUM><NUM>,. These operations can include, but are not limited to, outputting a request to manually enable the thermal imaging function using a switch, button, knob or other electro-mechanical means of the shoulder SM device <NUM><NUM>,. , <NUM>N, and/or sending to each shoulder SM device <NUM><NUM>,. , <NUM>N a command for automatically enabling the thermal imaging function.

Once enabled, each shoulder SM device <NUM><NUM>,. , <NUM>N generates thermal images that show areas of varying temperatures in different colors. The thermal images are continuously or periodically sent directly or indirectly (e.g., via the LMRs and/or device <NUM>) from the shoulder SM device <NUM><NUM>,. , <NUM>N to the field computing device <NUM>, the other shoulder SM devices, the LMRs, and/or at least one remote computing device <NUM>, <NUM> along with the unique identifier and/or timestamp information. The remote computing device(s) include(s), but is(are) not limited to, a remote server <NUM> and/or computing device <NUM> (e.g., a dispatch console). The thermal images sent from the shoulder SM devices <NUM><NUM>,. , <NUM>N are stored in a datastore <NUM>, a local memory of the field computing device <NUM>, local memories of the shoulder SM devices, and/or local memories of the LMRs <NUM><NUM>,. The thermal images may be sent over a packet switched LMR infrastructure <NUM> and/or a public network <NUM> (e.g., the Internet).

Referring now to <FIG>, there is provided an illustration of an illustrative architecture for an LMR <NUM>. LMRs <NUM> of <FIG> are the same as or similar to LMR <NUM>. As such, the discussion of LMR <NUM> is sufficient for understanding LMRs <NUM> of <FIG>.

LMR <NUM> can include more or less components than that shown in <FIG> in accordance with a given application. For example, LMR <NUM> can include one or both components <NUM> and <NUM>. The present solution is not limited in this regard.

As shown in <FIG>, the LMR <NUM> comprises an LMR communication device <NUM> and a cellular data network communication device <NUM>. Both of these communication devices <NUM>, <NUM> enable end-to-end LMR services in manners known in the art. For example, the end-to-end LMR services are achieved in the same or similar manner as that taught in <CIT>. The present solution is not limited in this regard. In this way, voice data is communicated from the LMR <NUM> over an LMR network (e.g., LMR network <NUM> of <FIG>) and/or a cellular data network (e.g., cellular data network <NUM> of <FIG>). A processor <NUM> and selector <NUM> are provided to select whether the LMR network or the cellular data network is to be used for communicating voice data at any given time.

The LMR <NUM> also comprises an SRC enabled device <NUM>, an NFC enabled device <NUM> and/or an RFID enabled device <NUM>. The SRC enabled device <NUM> facilitates SRC communications. An SRC communication occurs between the LMR <NUM> and an external device (e.g., the field computing device <NUM> and/or the shoulder SM device <NUM><NUM>,. , <NUM>N of <FIG>) over a short distance (e.g., Y feet, where Y is an integer such as ten). The SRC communication may be achieved using SRC transceivers. SRC transceivers are well known in the art, and therefore will not be described in detail herein. Any known or to be known SRC transceiver can be used herein without limitation. For example, a Bluetooth® or Wi-Fi enabled transceiver is used here. The present solution is not limited in this regard.

The NFC enabled device <NUM> facilitates NFC communications. An NFC communication occurs between the LMR <NUM> and an external device (e.g., field computing device <NUM> of <FIG>) over a relatively small distance (e.g., X centimeters or C inches, where C is an integer such as twelve). The NFC communication may be established by touching the LMR <NUM> and the external device together or bringing them in close proximity such that an inductive coupling occurs between inductive circuits thereof. In some scenarios, the NFC operates at <NUM> and at rates ranging from <NUM> kbit/s to <NUM> kbit/s. The NFC communication may be achieved using NFC transceivers configured to enable contactless communication at <NUM>. NFC transceivers are well known in the art, and therefore will not be described in detail herein. Any known or to be known NFC transceiver can be used herein without limitation. In some scenarios, the NFC enabled device <NUM> comprises an NFC tag or maker. NFC tags and markers are well known in the art, and will not be described herein.

The RFID enabled device <NUM> facilitates RFID communications. An RFID communication occurs between the LMR <NUM> and an external device (e.g., field computing device <NUM> of <FIG>) over relatively short distance (e.g., W feet, where W is an integer such as <NUM> feet). The RFID communication may be achieved using an RF antenna and/or RF transceiver. RF antennas and RF transceivers are well known in the art, and therefore will not be described in detail herein. Any known or to be known RF antenna and/or RF transceiver can be used herein without limitation. In some scenarios, the RFID enabled device <NUM> comprises a passive RFID tag or an active RFID tag. Both of the listed RFID tags are well known in the art, and will not be described herein.

The above-described communication components <NUM>-<NUM> are connected to a processor <NUM>. A memory <NUM>, display <NUM>, user interface <NUM>, I/O device(s) <NUM>, and/or a system interface <NUM> are also connected to the processor <NUM>. During operation, the processor <NUM> is configured to control selection of either the LMR communication device <NUM> or the cellular data communication device <NUM> for providing LMR services using the selector <NUM>. The processor <NUM> is also configured to collect and store data generated by the I/O device(s) <NUM> and/or external devices (e.g., the shoulder SM device <NUM><NUM>,. , <NUM>N of <FIG>). The I/O device(s) include(s), but is(are) not limited to, environmental sensors and/or motion sensors. Accordingly, the data stored in memory <NUM> can include, but is not limited to, audio, sensor data (e.g., temperature data, moisture data, light data, etc.), and/or thermal images captured by the shoulder SM device <NUM><NUM>,. , <NUM>N of <FIG>. This stored data and/or other stored data (e.g., a unique identifier for the LMR <NUM>) can be communicated from the LMR <NUM> via any communication device <NUM>-<NUM> in accordance with a given application.

The user interface <NUM> includes, but is not limited to, a plurality of user depressible buttons that may be used, for example, for entering numerical inputs and selecting various functions of the LMR <NUM>. This portion of the user interface may be configured as a keypad. Additional control buttons and/or rotatable knobs may also be provided with the user interface <NUM>. The user interface <NUM> may additionally or alternatively comprise a touch screen display, and/or a microphone to facilitate voice-activated commands.

The system interface <NUM> can include an electrical connector for connecting an antenna and/or an external device (e.g., the shoulder SM device <NUM><NUM>,. , <NUM>N of <FIG>) to the LMR <NUM>. Such electrical connectors are well known in the art, and therefore will not be described herein.

A battery <NUM> is provided for powering the components <NUM>-<NUM> of the LMR <NUM>. The battery <NUM> may comprise a rechargeable and/or replaceable battery. Batteries are well known in the art, and therefore will not be discussed here.

Referring now to <FIG>, there is provided an illustration of an illustrative architecture for a communication enabled device <NUM>. The SRC enabled device <NUM>, NFC enabled device <NUM>, and/or RFID enabled device <NUM> of <FIG> is(are) the same as or similar to the communication enabled device <NUM>. Therefore, the discussion of communication enabled device <NUM> is sufficient for understanding SRC enabled device <NUM>, NFC enabled device <NUM>, and/or RFID enabled device <NUM> of <FIG>.

Communication enabled device <NUM> can include more or less components than that shown in <FIG>. However, the components shown are sufficient to disclose an illustrative embodiment implementing the present solution. Some or all of the components of the communication enabled device <NUM> can be implemented in hardware, software and/or a combination of hardware and software. The hardware includes, but is not limited to, one or more electronic circuits.

The hardware architecture of <FIG> represents an illustration of a representative communication enabled device <NUM> configured to facilitate (a) the checking-in of field personnel members to incident events, (b) the monitoring of field personnel members' health during the handling of the incident events, and/or (c) the checking-out of field personnel members from incident events.

The communication enabled device <NUM> also comprises an antenna <NUM> and a communication device <NUM> for allowing data to be exchanged with the external device via SRC technology, NFC technology, and/or RFID technology. The antenna <NUM> is configured to receive SRC, NFC and/or RFID signals from the external device and transmit SRC, NFC and/or RFID signals generated by the communication enabled device <NUM>. The communication device <NUM> may comprise an SRC transceiver, an NFC transceiver and/or an RFID transceiver. SRC, NFC and RFID transceivers are well known in the art, and therefore will not be described herein. However, it should be understood that the SRC, NFC and/or RFID transceiver processes received signals to extract information therein. This information can include, but is not limited to, a request for certain information (e.g., a unique identifier <NUM> and/or other information <NUM>), and/or a message including information, for example, about the health of a given individual. The communication device <NUM> may pass the extracted information to the controller <NUM>.

If the extracted information includes a request for certain information, then the controller <NUM> may perform operations to retrieve a unique identifier <NUM> and/or other information <NUM> from memory <NUM>. The other information <NUM> can include, but is not limited to, sensor data generated by sensors <NUM> of <FIG>, audio captured by the shoulder SM device <NUM><NUM>,. , <NUM>N of <FIG>, and/or thermal images generated by a shoulder SM device <NUM><NUM>,. , <NUM>N of <FIG>. The retrieved information is then sent from the communication device <NUM> to a requesting external device (e.g., field computing device <NUM> of <FIG>, another LMR, or another shoulder SM device).

In some scenarios, the connections between components <NUM>, <NUM>, <NUM>, <NUM>, <NUM> are unsecure connections or secure connections. The phrase "unsecure connection", as used herein, refers to a connection in which cryptography and/or tamper-proof measures are not employed. The phrase "secure connection", as used herein, refers to a connection in which cryptography and/or tamper-proof measures are employed. Such tamper-proof measures include enclosing the physical electrical link between two components in a tamper-proof enclosure.

Memory <NUM> may be a volatile memory and/or a non-volatile memory. For example, the memory <NUM> can include, but is not limited to, a Random Access Memory ("RAM"), a Dynamic Random Access Memory ("DRAM"), a Static Random Access Memory ("SRAM"), a Read-Only Memory ("ROM") and a flash memory. The memory <NUM> may also comprise unsecure memory and/or secure memory. The phrase "unsecure memory", as used herein, refers to memory configured to store data in a plain text form. The phrase "secure memory", as used herein, refers to memory configured to store data in an encrypted form and/or memory having or being disposed in a secure or tamper-proof enclosure.

The components <NUM>-<NUM> of the communication enabled device <NUM> are coupled to a power source (not shown in <FIG>). The power source may include, but is not limited to, battery or a power connection (not shown). Alternatively or additionally, the communication enabled device <NUM> is configured as a passive device which derives power from an RF signal inductively coupled thereto.

Referring now to <FIG>, there is provided an illustration of an illustrative shoulder SM device <NUM>. The shoulder SM devices <NUM> of <FIG> are the same as or similar to shoulder SM device <NUM>. As such, the discussion of shoulder SM device <NUM> is sufficient for understanding shoulder SM devices <NUM> of <FIG>.

The shoulder SM device <NUM> can include more or less components than that shown in <FIG> in accordance with a given application. For example, the shoulder SM device <NUM> can be absent of communication device(s) <NUM>. The present solution is not limited in this regard.

As shown in <FIG>, the shoulder SM device <NUM> comprises communication device(s) <NUM>, an audio transducer (e.g., a speaker) <NUM>, a microphone <NUM>, a display <NUM>, and a thermal imaging device <NUM>. The communication device(s) <NUM> is(are) configured to communicate via public network (e.g., the Internet) communications, cellular data network communications, SRC communications, NFC communications, and/or RFID communications. Each of these listed types of communications are well known in the art, and therefore will not be described in detail here. Similarly, each of the listed components <NUM>, <NUM>, <NUM>, <NUM> are well known in the art, and therefore will not be described here. Notably, the display <NUM> can comprise a Liquid Crystal Display ("LCD"), and/or a touch screen display. Also, the communication device(s) <NUM> can facilitate the continuous (e.g., streaming) and/or periodic wireless communication of audio, thermal images and/or user input data from the shoulder SM device <NUM> while in use.

The shoulder SM device <NUM> also comprises a system interface <NUM> and a user interface <NUM>. The system interface <NUM> includes an electrical connector for connecting an antenna to the shoulder SM device <NUM> and/or for establishing a wired connection between an external device (e.g., the LMR <NUM><NUM>,. , <NUM>N of <FIG>) and the shoulder SM device <NUM>. Such electrical connectors are well known in the art, and therefore will not be described herein. The user interface <NUM> includes, but is not limited to, one or more input means that may be used, for example, for entering numerical inputs and/or selecting/enabling/disabling various functions of the shoulder SM device <NUM>. The input means can include, but is not limited to, a keypad, a user depressible button, a virtual button of a touch screen display <NUM>, a rotatable knob, a switch, and/or the microphone <NUM> to facilitate a voice-activated command.

The shoulder SMO device <NUM> may further comprise an optional location device <NUM>. The location device <NUM> is generally configured to determine a geographical location of the shoulder SM device <NUM> and/or track changes in the geographical location. Such location devices are well known in the art, and therefore will not be described herein. For example, the location device can include, but is not limited to, a GPS device and/or a triangulation device. In some scenarios, the location device is also configured to determine an altitude of the shoulder SM device <NUM> and/or the floor of a building in which the shoulder SM device <NUM> resides.

These components <NUM>-<NUM>, <NUM>-<NUM>, <NUM> are coupled to a processor <NUM>. The processor <NUM> is generally configured to control operations of the shoulder SM device <NUM>, output audio from the audio transducer (e.g., speaker) <NUM>, process/store audio captured by the microphone <NUM>, present content (e.g., text, media and/or thermal images) on the display, and/or process/store thermal images captured by the thermal imaging device <NUM>. The processor <NUM> can also cause audio, thermal images and/or user inputs to be communicated to one or more external devices (e.g., LMRs <NUM><NUM>,. , <NUM>N of <FIG>) via the communication device(s) <NUM> and/or system interface <NUM>.

The audio, thermal images and/or user inputs can be stored locally in memory <NUM>. Memory <NUM> may be a volatile memory and/or a non-volatile memory. For example, the memory <NUM> can include, but is not limited to, a RAM, a DRAM, an SRAM, a ROM and a flash memory. The memory <NUM> may also comprise unsecure memory and/or secure memory. The phrase "unsecure memory", as used herein, refers to memory configured to store data in a plain text form. The phrase "secure memory", as used herein, refers to memory configured to store data in an encrypted form and/or memory having or being disposed in a secure or tamper-proof enclosure.

As shown in <FIG>, one or more sets of instructions <NUM> (e.g., software code) reside, completely or at least partially, within the memory <NUM> and/or within the processor <NUM> during execution thereof by the shoulder SM device <NUM>. The instructions <NUM> are configured to implement one or more of the methodologies, procedures, or functions described herein. The memory <NUM> and the processor <NUM> can constitute machine-readable media. The term "machine-readable media", as used here, refers to a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions <NUM>. The term "machine-readable media", as used here, also refers to any medium that is capable of storing, encoding or carrying a set of instructions <NUM> for execution by the shoulder SM device <NUM> and that cause the shoulder SM device <NUM> to perform any one or more of the methodologies of the present disclosure.

The components <NUM>-<NUM>, <NUM> of the shoulder SM device <NUM> are coupled to a power source <NUM>. The power source may include, but is not limited to, battery or a power connection (not shown) to an LMR <NUM><NUM>,. , <NUM>N of <FIG>. Alternatively or additionally, the shoulder SM device <NUM> is configured as a passive device which derives power from external energy (e.g., light and/or RF signals).

A mechanical coupler <NUM> is provided to removably couple the shoulder SM device <NUM> to an individual. For example, the mechanical coupler <NUM> includes a clip or a magnet for coupling the shoulder SM device <NUM> to a jacket of a field personnel member (e.g., field personnel member <NUM><NUM>,. , <NUM>N of <FIG>), as shown in <FIG>. The clip/magnet is designed so that the field personnel member can easily uncouple the shoulder SM device <NUM> from the jacket and re-couple the shoulder SM device <NUM> to the jacket. The present solution is not limited to the particulars of this example.

Illustrations of an illustrative architecture for the shoulder SM device <NUM> are provided in <FIG>. As shown in <FIG>, the audio transducer <NUM>, the microphone <NUM>, and the thermal imaging device <NUM> are located in/on a front housing portion <NUM> of the shoulder SM device <NUM> so that they are forward facing at least when the shoulder SM device <NUM> is coupled to the individual. A first user interface element <NUM><NUM> (e.g., a depressible button) is located in/on a side housing portion <NUM> of the shoulder SM device <NUM>. The first user interface element <NUM><NUM> (e.g., a depressible button) may be provided to allow the individual to turn on and turn off the microphone <NUM>. The system interface <NUM> is located in/on a bottom housing portion <NUM> of the shoulder SM device <NUM>. A cable <NUM> is connected to the system interface <NUM> for providing a wired connection between the shoulder SM device <NUM> and an LMR <NUM> (e.g., LMR <NUM><NUM>,. , or <NUM>N of <FIG>). The display <NUM> is located in/on a back housing portion <NUM> of the shoulder SM device <NUM> so that it is rear facing at least when the shoulder SM device <NUM> is coupled to the individual. A second user interface element <NUM><NUM> (e.g., a switch) and the mechanical coupler <NUM> are also located in/on the back housing portion <NUM> of the shoulder SM device <NUM>. The second user interface element <NUM><NUM> (e.g., a switch) may be provided to allow the individual to selectively turn on and turn off the display <NUM> and/or thermal imaging device <NUM>.

The thermal imaging function of the shoulder SM device <NUM> can be used for detecting/locating an injured or un-responsive civilians and/or field personnel, capturing/recording real events to be used for training purposes, capturing/displaying real time thermal imaging video to a user of the shoulder SM device <NUM>, and/or capturing/streaming real time thermal imaging video for use by one or more individuals (e.g., field personnel and/or dispatcher) to handle an incident event.

Referring now to <FIG>, there is provided an illustration of an illustrative architecture for a computing device <NUM>. Field computing device <NUM>, computing device <NUM> and/or server <NUM> of <FIG> is(are) the same as or similar to computing device <NUM>. As such, the discussion of computing device <NUM> is sufficient for understanding these component of system <NUM>.

In some scenarios, the present solution is used in a client-server architecture. Accordingly, the computing device architecture shown in <FIG> is sufficient for understanding the particulars of client computing devices and servers.

Computing device <NUM> may include more or less components than those shown in <FIG>. However, the components shown are sufficient to disclose an illustrative solution implementing the present solution. The hardware architecture of <FIG> represents one implementation of a representative computing device configured to provide an improved field personnel check-in, check-out and management process, as described herein. As such, the computing device <NUM> of <FIG> implements at least a portion of the method(s) described herein.

Some or all components of the computing device <NUM> can be implemented as hardware, software and/or a combination of hardware and software. The hardware includes, but is not limited to, one or more electronic circuits. The electronic circuits can include, but are not limited to, passive components (e.g., resistors and capacitors) and/or active components (e.g., amplifiers and/or microprocessors). The passive and/or active components can be adapted to, arranged to and/or programmed to perform one or more of the methodologies, procedures, or functions described herein.

As shown in <FIG>, the computing device <NUM> comprises a user interface <NUM>, a Central Processing Unit ("CPU") <NUM>, a system bus <NUM>, a memory <NUM> connected to and accessible by other portions of computing device <NUM> through system bus <NUM>, a system interface <NUM>, and hardware entities <NUM> connected to system bus <NUM>. The user interface can include input devices and output devices, which facilitate user-software interactions for controlling operations of the computing device <NUM>. The input devices may include, but are not limited, a physical and/or touch keyboard <NUM>, a mouse, and/or a microphone. The input devices can be connected to the computing device <NUM> via a wired or wireless connection (e.g., a Bluetooth® connection). The output devices include, but are not limited to, a speaker <NUM>, a display <NUM>, and/or light emitting diodes <NUM>. System interface <NUM> is configured to facilitate wired or wireless communications to and from external devices (e.g., network nodes such as access points, databases, etc.).

At least some of the hardware entities <NUM> perform actions involving access to and use of memory <NUM>, which can be a RAM, a disk driver and/or a CD-ROM. Hardware entities <NUM> can include a disk drive unit <NUM> comprising a computer-readable storage medium <NUM> on which is stored one or more sets of instructions <NUM> (e.g., software code) configured to implement one or more of the methodologies, procedures, or functions described herein. The instructions <NUM> can also reside, completely or at least partially, within the memory <NUM> and/or within the CPU <NUM> during execution thereof by the computing device <NUM>. The memory <NUM> and the CPU <NUM> also can constitute machine-readable media. The term "machine-readable media", as used here, refers to a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions <NUM>. The term "machine-readable media", as used here, also refers to any medium that is capable of storing, encoding or carrying a set of instructions <NUM> for execution by the computing device <NUM> and that cause the computing device <NUM> to perform any one or more of the methodologies of the present disclosure.

Computing device <NUM> facilitates an improved field personnel check-in, check-out and management process. In this regard, computing device <NUM> runs one or more software applications <NUM> for facilitating the collection, processing and/or storage of field personnel related information and/or incident event related information. The field personnel related information includes, but is not limited to, check-in status information, check-out status information, location information, audio information, and/or thermal imaging information. The incident event related information includes, but is not limited to, location information, time information, structure information, surrounding environment information, incident type information, field personnel on-site information, field equipment on-site information, thermal imaging information, and/or incident status information.

Referring now to <FIG>, there is provided a flow diagram of an illustrative method <NUM> for facilitating the safety of personnel (e.g., personnel <NUM><NUM>,. , <NUM>N of <FIG>) during public safety incidents. Method <NUM> begins with <NUM> and continues with <NUM> where an audio transducer (e.g., audio transducer <NUM> of <FIG>) and a microphone (e.g., microphone <NUM> of <FIG>) of a shoulder SM device (e.g., shoulder SM device <NUM><NUM>,. , <NUM>N of <FIG> or <NUM> of <FIG>) are used to facilitate auditory communications between users of a plurality of radios (e.g., LMRs <NUM><NUM>,. , or <NUM>N of <FIG>). Techniques for using shoulder SM devices to facilitate auditory communications are well known in the art, and therefore will not be described herein.

In <NUM>, a thermal imaging device (e.g., thermal imaging device <NUM> of <FIG>) (that is integrated with the shoulder SM device) is activated when the shoulder SM devices resides at a location of an incident event. This thermal imaging device activation is achieved autonomously based on location information generated by a location device (e.g., location device <NUM> of <FIG>) of the shoulder SM device or radio. This thermal imaging device activation can also be achieved through a user-software interaction facilitated by a user interface element (e.g., user interface element <NUM> of <FIG>) of the shoulder SM device, automatically in response to a signal (e.g., a check-in signal or command signal) received from a remote device (e.g., field computing device <NUM> of <FIG> or a computing device <NUM> of <FIG>), or automatically in response to a voice command received by the shoulder SM device and/or LMR (e.g., LMR <NUM><NUM>,. , or <NUM>N of <FIG>) to which the shoulder SM device is communicatively coupled.

Once activated, the thermal imaging device captures thermal images in <NUM>. In <NUM>, the thermal images are displayed on a display (e.g., display <NUM> of <FIG>) of the shoulder SM device. The thermal images can be displayed in real-time or near real-time so that the thermal images can be viewed immediately or within milliseconds from their times of capture.

The thermal images may also be wirelessly communicated in <NUM> to one or more remote devices. For example, in some scenarios, the thermal images are transmitted directly from a communication device (e.g., communication device <NUM> of <FIG>) of the shoulder SM device to a field computing device (e.g., field computing device <NUM> of <FIG>), an LMR (e.g., LMR <NUM><NUM>,. , or <NUM>N of <FIG>), a server (e.g., server <NUM> of <FIG>), and/or a computing device (e.g., computing device <NUM> of <FIG>). In other scenarios, the thermal images are communicated from the shoulder SM device to a radio (e.g., LMR <NUM><NUM>,. , or <NUM>N of <FIG>) via a cable (e.g., cable <NUM> of <FIG>), and then transmitted from the radio to the field computing device (e.g., field computing device <NUM> of <FIG>), one or more other radios, a server (e.g., server <NUM> of <FIG>), and/or a computing device (e.g., computing device <NUM> of <FIG>). The present solution is not limited to the particulars of these scenarios.

Notably, this wireless communication of the thermal images can be performed on a periodic basis or on a continuous basis (e.g., streamed over a network). In the continuous scenarios, multiple people can view the thermal images in substantially real-time or near real-time as the incident event is being handled. These people can include, but are not limited to, field personnel, a dispatcher at a remote dispatch center, and/or a commander at a central command center. Additionally, other information may be wirelessly communicated with the thermal images in <NUM>. This other information can include, but is not limited to, timestamp information and/or a unique identifier.

In <NUM>, operations are performed to detect an injured or unresponsive person using the thermal images and/or location information generated by the shoulder SM device. These operations can be performed by a processor (e.g., processor <NUM> of <FIG>) of the shoulder SM device, by the radio, and/or by a remote device (e.g., LMR <NUM><NUM>,. , or <NUM>N of <FIG>, field computing device <NUM> of <FIG>, server <NUM> of <FIG>, or computing device <NUM> of <FIG>). Such a detection of an injured or unresponsive person can be made by (i) analyzing the thermal images to determine if the person has not moved at all or has only moved a relatively small distance in a given period of time, and/or (ii) analyzing location information generated by a location device (e.g., location device <NUM> of <FIG>) to determine or confirm that the person has not moved at all or has only moved a relatively small distance in a given period of time.

Next in <NUM>, operations are performed to issue an alert, alarm or notification indicating that an injured or unresponsive person has been detected. These operations can be performed by the shoulder SM device, the radio, and/or by a remote device (e.g., LMR <NUM><NUM>,. , or <NUM>N of <FIG>, field computing device <NUM> of <FIG>, server <NUM> of <FIG>, or computing device <NUM> of <FIG>). The alert and/or alarm can include, but is not limited to, a visual alert/alarm, an auditory alert/alarm, and/or a tactile alert/alarm. The notification can include, but is not limited to, a textual message displayed on a display, a symbol displayed on a display, and/or an auditory message output from a speaker. For example, the alert can include an electronic message (e.g., text message and/or electronic mail message) output from a display of a given device and/or transmitted from a given device to another device for display to particular person(s). The alarm can include a siren noise emitted from an audio transducer of the shoulder SM device. The notification can include the inclusion of a given symbol on a map at a location of the injured or unresponsive person relative to the locations of other individuals on site of the incident event. The present solution is not limited to the particulars of this example. In some scenarios, the alert, alarm or notification are intended to cause the dispatch of one or more individuals to the last known location of the injured or unresponsive person.

In <NUM>, movement of the shoulder SM device is tracked. In this regard, communication of thermal images and/or location information from the shoulder SM device is continued even after an injured or unresponsive person is detected in <NUM>. This feature of the present solution allows movement of the injured or unresponsive person to be monitored and tracked after one or more individuals have been dispatched to assist the injured or unresponsive person. The tracked movement can ensure that the injured or unresponsive person receives medical care in a relatively short amount of time or an optimized amount of time.

In <NUM>, the thermal imaging device is deactivated manually or automatically. This deactivation can be performed when the incident event is resolved, the user of the shoulder SM device has checked-out of the incident event, and/or the shoulder SM device no longer resides at a location of an incident event. The thermal imaging device deactivation can be achieved through a user-software interaction facilitated by a user interface element (e.g., user interface element <NUM> of <FIG>) of the shoulder SM device, automatically in response to a signal (e.g., a check-in signal or command signal) received from an external device (e.g., field computing device <NUM> of <FIG> or a computing device <NUM> of <FIG>), automatically in response to a voice command received by the shoulder SM device and/or LMR (e.g., LMR <NUM><NUM>,. , or <NUM>N of <FIG>) to which the shoulder SM device is communicatively coupled, or autonomously based on location information generated by a location device (e.g., location device <NUM> of <FIG>) of the shoulder SM device.

Subsequently, <NUM> is performed where method <NUM> ends or other operations are performed. Such other operations can include, but are not limited to, returning to <NUM>, <NUM>, or <NUM> so that another iteration of some or all of method <NUM> is performed.

All of the apparatus, methods, and algorithms disclosed and claimed herein can be made and executed without undue experimentation in light of the present disclosure. While the invention has been described in terms of preferred embodiments, it will be apparent to those having ordinary skill in the art that variations may be applied to the apparatus, methods and sequence of steps of the method without departing from the scope of the invention. More specifically, it will be apparent that certain components may be added to, combined with, or substituted for the components described herein while the same or similar results would be achieved.

Claim 1:
A method for operating a shoulder Speaker Microphone, SM, device coupled to a radio, comprising:
using a speaker and a microphone of the shoulder SM device to facilitate auditory communications to and from a user of the radio;
activating a thermal imaging device integrated with the shoulder SM device when the shoulder SM device resides at a location of an incident event;
capturing thermal images by the thermal imaging device of the shoulder SM device; and
performing operations by the shoulder SM device to cause the thermal images to be streamed over a network,
characterized in that:
the thermal images show areas of varying temperatures in different colors, and
activation of the thermal imaging device is achieved autonomously based on location information generated by a location device of the shoulder SM device or radio.