Patent Description:
Statistically <NUM>% of women in the USA will be violently victimized at least once in their lifetimes. The Justice Department counted <NUM> million violent crimes involving over <NUM> million victims in <NUM>. It estimates there were over <NUM>,<NUM> firearm victims in <NUM>. Kids Fighting Chance, a children's advocacy group, reports one child is abducted or reported missing every <NUM> minutes or <NUM>,<NUM> times per year.

According to criminal deterrence theory, an attack occurs after the criminal makes a cost-benefit analysis. He will act if the benefit outweighs expected consequence. Criminals also know the chances that the police will be in earshot during an attack are low.

Calls to the police are not sufficient for deterrence. Most callers assume that law enforcement will respond before a criminal act occurs. Statistics indicate otherwise. Law enforcement rarely breaks up a street crime. More often than not, its role is pursuit, investigation and witness for prosecution of the criminal act. The present invention is in the field of personal safety and more particularly for personal protective devices, particularly as combined with cellular telephones and more particularly when a smartphone is connected to a separate personal protective device via a network.

The prior art known to Applicants takes advantage of the latest technology made available by battery powered cellular phones. This includes telephony, the ability to capture pictures, videos and audio, Global Positioning System (GPS) location capabilities, and the ability to run software applications on built-in processing units. Some prior art inventions disclose holders, attachments and cases for cellular phones that allow additional personal safety devices to be physically linked to the cellular phone. This makes the combined device bulkier, heavier and less useful as a cellular phone. Some of them provide for personal safety device activation once a panic button is pushed, but the integration is not complete. Other disclosures include voice activated panic buttons, but it is known that voices under stress cannot always be recognized, even by trained software. Finally, because cellular phone designs are not standardized, different phone implementations make a common attachment means difficult, if not impossible.

<CIT>, describes a personal safety device formed by combining a modified cellular telephone with a personal protective spray, such as pepper spray. Activation of the spray causes the cellular telephone to automatically alert emergency response personnel and provides them with cellular phone location via GPS in the phone. It requires modification of the cellular phone and does not work in conjunction with other personal safety devices over a local network.

<CIT>, also describes a cellular phone with personal protective spray and a panic button. When the button is activated, the personal protective spray is released and the phone records audio and/or video for transmission, transmits the data to emergency response personnel, and provides them with cellular phone location via GPS in the phone. It requires attaching devices to the phone or modification of the cellular phone and does not work in conjunction with other personal safety devices over a local network.

<CIT>, describes a portable device that includes the ability to biometrically identify the user. The portable device can be a cellular phone with integrated cameras, sound recorders, and/or biometric authentication mechanisms that utilizes GPS to determine geographic location. Data communication in the form of GPS location data, messages, videos, pictures, etc. can be performed over many types of networks including local area networks (LANs). LANs however, are not meant for personal area network use. Lehmann's invention does not work in conjunction with other personal safety devices over a personal area network.

<CIT>, describes a personal safety system that provides image, audio, and data capture of a perpetrator of a crime against the user. Data is stored at a secure remote location. The device alerts the perpetrator that the information has been captured, thus discouraging the crime. Remers invention does not work in conjunction with other personal safety devices over a personal area network.

<CIT>, describes a personal safety and alarm system including a siren/strobe light, and a pepper spray container in a holder. The holder can be detached. The holder can reside on a stand or be placed in a pocket. Manning's invention does not work in conjunction with other personal safety devices over a personal area network.

<CIT>, describes a method that allows a smartphone user to easily and properly share his status during distress situations with people who can better help him contextually and reliably. The Paim invention, while utilizing many network methods, does not work in conjunction with other personal safety devices over a personal area network.

<CIT>, to Finet, describes a personal alert safety system worn by a user. An accelerometer in the system detects movement and controls an alarm device. The Finet invention does not use a cellular device and does not work in conjunction with other personal safety devices over a personal area network.

<CIT>, to <CIT>, describes many of the previously described components. The cellular phone has a panic button which can activate audio and video recording, start a siren, flash lights and contact emergency personnel with GPS location data. These capabilities can also be deployed in an attachable cellular phone case. The Hagenstad invention does not work in conjunction with other personal safety devices over a personal area network.

<CIT>, describes a stun gun and irritant ejecting spray combination. The Abboud invention does not work over a personal area network.

<CIT>, <CIT>, <CIT> and <CIT>, describe a signaling system that provides an alarm for an individual in distress combined with a locating and tracking system, possibly by cellular phone, to alert and direct appropriate personnel to the needs of the individual in distress and to monitor the location of that individual. The system includes a portable signaling unit, a remote alarm switch device, a central dispatch station, and makes use of a wireless communication system. The portable signaling unit and the remote alarm switch may be adapted to be worn at different locations on the person's body. The remote alarm switch may be concealed in the form of a wristband or in the form of any other object such as a broach, pendant, or keychain. Even though a wireless remote is described that is separate from the cellular phone, nowhere is it mentioned that the wireless remote contains other personal safety devices nor do these devices work over a personal area network.

International patent application <CIT> describes a device and a system for personal protection that provides a possibility to temporarily immobilize an intruder or perpetrator by providing a flash of blinding light, spraying maze or paint, and providing a high volume siren while at the same time acquiring an image using a built in camera and transmitting this to a receiving device directly or indirectly via a mobile phone to a receiver.

The following patents are also known to Applicants: <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>, <CIT>and <CIT>. Many of these references describe various safety systems utilizing cellular networks. None disclose cellular phone based personal safety devices that work in conjunction with other personal safety devices over a personal area network. While these devices fulfill their respective, particular objectives and requirements, the aforementioned patents do not disclose the present invention.

The present invention relates to a wireless personal safety device system as defined in independent claim <NUM>. In these respects, the combination cellular phone, optical safety device and personal safety device according to the present invention substantially departs from the conventional concepts and designs of the prior art, and in so doing provides an apparatus primarily developed for the purpose of providing a means of communication and a means of self-defense in one unit.

The present invention includes the following interrelated objects, aspects and features:.

As such, it is a first object of the present invention to provide a wireless personal safety device.

It is a further object of the present invention to provide such a device which wirelessly communicates with a cell phone to enable transmission of information concerning an attack to authorities and social media.

It is a further object of the present invention to provide such a system in which a personal safety device may be equipped with a shocking mechanism.

It is a still further object of the present invention to provide a personal safety device that may be equipped with a spraying apparatus designed to spray a noxious spray onto an assailant.

It is a further object of the present invention to provide such a device which may include a panic switch allowing manual activation of notification.

It is a yet further object of the present invention to provide such a device in which a sensor can sense the spacing between a personal safety device and an associated cell phone and trigger remote notification when the spacing exceeds a pre-set distance.

It is a still further object of the present invention to provide a wireless optical safety device.

It is a yet further object of the present invention to provide a wireless optical safety device that is self-contained but, when activated, communicates with a cellular telephone while also providing assailant detection capabilities.

These and other objects, aspects and features of the present invention will be better understood from the following detailed description of the preferred embodiment when read in conjunction with the appended drawing figures.

<FIG> represents the main components of the Personal Safety System (PSS) invention. The personal safety device (PSD) <NUM> is battery powered (<NUM>) and contains self-defense mechanisms such as a shocking mechanism and a spray mechanism to subdue or discourage a would-be attacker. The PSD <NUM> is tethered to a cellular phone <NUM>, over a Bluetooth system. The optical safety device (OSD) <NUM> is battery powered (<NUM>) (<FIG>) and contains camera component used to identify and track potential assailants coming from behind. The OSD <NUM> is tethered to a cellular phone <NUM>, over a Bluetooth system <NUM>, <NUM> (<FIG>). The cellular phone <NUM> contains an internal Global Positioning System (GPS) <NUM> that provides location information of the whereabouts of the cellular phone, and therefore presumably of the cellular phone owner. The cellular phone <NUM> communicates over a cellular phone network <NUM> to provide interconnectedness to the phone network and the Internet <NUM>. The phone network <NUM> allows the user to summon help over the phone network (calling <NUM> or calling another person directly). The Internet <NUM> also has linkages to various social media for summoning help over social media, such as, for example, Facebook. Also, as is known in the art, GPS is sometimes aided by location information obtained by triangulation involving cellular phone towers. <CIT> discloses this aspect.

Referring now to the invention in more detail, in <FIG> there is shown a schematic representation of the PSD <NUM>. The PSD <NUM> has a housing <NUM> that contains a receptacle103 or other mounting arrangement such that a self-defense mechanism comprising a pepper spray package <NUM> or other equivalent noxious spray sprayer can be attached to the PSD <NUM>. Off the shelf pre-packaged units of spray <NUM> are available commercially. Alternatively, a custom version of the contained spray may be employed that integrates specifically with the PSD. An example of a custom contained spray is one in which spray activation switch <NUM> on the contained spray is designed to also engage the panic button switch <NUM>. In this way, activation of the spray via nozzle <NUM> indicates an emergency situation, alleviating the need for two separate actions. This can be instrumented mechanically, or through another sensing modality, such as optical or capacitive sensing, as is known in the art. Block <NUM> shows a power on/off switch and can be either a mechanical or software based switch and enables the PSD's Bluetooth functionality. Block <NUM>, shown as an external switch, is provided as a safety switch or trigger, and allows the stun gun to be manually enabled. A description of a stun gun is disclosed in <CIT>, incorporated herein by reference. Blocks <NUM> are the stun gun electrodes, which are placed against a perpetrator's skin in order to disable the perpetrator. Alternatively, where allowed by law, a more lethal defense mechanism may be deployed and activated.

With reference to the block diagram of <FIG>, block <NUM> schematically represents the other hardware found in PSD <NUM>. Block <NUM> is a charging circuit that allows the PSD <NUM> battery <NUM> to be charged up for use. The input to this charging circuit can be, for example, from a wall mounted transformer, USB cable or charging pad. Which input is used depends on the design of charging circuit <NUM> and, as known in the art, this can take on numerous forms, e.g., AC-DC converter using a direct or transformer coupled AC input, DC regulation using an unregulated DC input, etc. Battery <NUM> is a rechargeable type battery, preferably using lead-acid, nickel cadmium (NiCd), nickel metal hydride (NiMH), lithium ion (Li-ion), and lithium ion polymer (Li-ion polymer) technology, as is known in the art. Battery <NUM> can also be a non-chargeable type, eliminating the need for charging circuit <NUM>. Whatever battery is used, it must be sized appropriately. Battery <NUM> is used to power the Bluetooth circuitry <NUM> and the DC-DC converter <NUM> that converts the low battery voltage to a high voltage potential across electrodes <NUM> for shocking. Switches <NUM> and <NUM> are used to enable or disable the powering of the Bluetooth <NUM> and the DC-DC converter <NUM>, respectively. The antenna <NUM> facilitates transmission of wireless signals from the PSD to a cellular telephone. A separation sensor <NUM> senses separation distance from the associated cell phone by measuring signal strength. If signal strength dips below a pre-set threshold, an alarm is sent to the cell phone.

Referring now to the invention in more detail, in <FIG> there is shown a block diagram of the OSD <NUM>. The OSD <NUM> is a self-contained module that can snap onto the back of an article of clothing, can be attached with Velcro® fastener onto an article of clothing, attached onto a rear facing earpiece, etc., as is known in the art. Like many portable electronic objects it is battery <NUM> powered, where the battery technology can be chosen to optimize performance. An external power source <NUM>, such as mains power, supplies unregulated power to charger/battery-health circuitry <NUM>. Charger/battery-health circuitry <NUM> conditions the power so that the battery can be charged and also provides an indication of battery <NUM> charge. Switch <NUM> is the user power switch. When switch <NUM> is engaged battery <NUM> power is further regulated and modified by block <NUM> to power the remaining components <NUM>-<NUM>.

With further reference to <FIG>, the camera <NUM> is an infrared (IR) camera, useful for viewing in darkness and IR light. IR light is provided by IR LEDs <NUM>. This light is invisible to humans, thereby also concealing the fact that the OSD <NUM> is active. While other cameras can be used, the IR camera provides less data to process (monochromatic vs. color), simplifying the detection of a rear approaching assailant. Ambient light sensor <NUM> is a semiconductor device that senses the ambient light level. This information is incorporated in the camera interface/logic module <NUM> to control the intensity of the IR LEDs <NUM>. When daylight is sensed the IR LEDs <NUM> are turned off. As the ambient light decreases the IR LEDs <NUM> are slowly turned up in intensity so that the IR camera <NUM> always has adequate light for assailant detection. Image data from the camera <NUM>, suitably processed by interface <NUM>, is sent to Bluetooth module <NUM>, where it is transmitted to the cellular phone <NUM> for image processing and analysis. As shown by the arrows, information from the cellular phone <NUM> can also provide some control over the camera <NUM> such as update rate, aperture, etc..

Referring now to the invention in more detail, in <FIG> and <FIG> there is shown a flowchart of the software installer used to install the PSS application onto the cellular phone. Block <NUM> represents the user installing the application on the cellular phone. As is known in the art, this is accomplished by downloading the application from one of the various vendors' software repositories, such as the Apple store or Google Play. Once the application is installed, the user runs the application in Block <NUM>. The user is then prompted to set various features and options that control how the cellular phone connects with other users of the network and how the cellular phone interacts with the PSD, as denoted by Block <NUM>. Various options are now selected. In Block <NUM>, the user is asked if they would like to enter/add contact information. Such information can be a phone number, cellular and/or landline, an address, either physical and/or e-mail, etc. If the answer is yes, the user enters the desired data in Block <NUM>. In Block <NUM>, the user is next asked if they would like to enter social media contact information. Such information can be links for posting to Facebook, Twitter, and other social media sharing sites. If the answer is yes, the user enters the desired data in Block <NUM>. In Block <NUM>, the user is asked if they would like to add <NUM> emergency calling. If the answer is yes, the information is saved in Block <NUM>.

In Block <NUM>, the user is asked whether to enable the separation sensor and alarm. This alarm is triggered when the PSD and the cellular phone are separated by a certain distance. This distance is based on the received signal strength indicator (RSSI) indicator. There is no standardized relationship between range and the RSSI reading, so this can only be used as an approximate distance measure, but it is sufficient. If enabled, the approximate distance is entered in Block <NUM>. Additionally, related timing information can be entered, such as how long the devices are separated before enabling the alarm, giving the owner time to bring the PSD and cellular phone together again. In Block <NUM>, the user is asked what capture methods should be enabled to capture audio, video and location information. If selected, the user enters or checks the various methods. Block <NUM> asks the user whether location sharing should be enabled. Location sharing is a feature that allows you to let people know where you are. Both Wi-Fi positioning system and GPS are used to pinpoint the user's location as accurately as possible. If it is desired, then it is enabled in Block <NUM>. Block <NUM> is then reached where Bluetooth is enabled in the cellular phone. Once enabled, the user is asked to turn on the PSD and/or the OSD so that the cellular phone can be paired to the appropriate devices in Block <NUM>. This is a standard method of using Bluetooth as is known in the art.

Referring now to the invention in more detail, in <FIG> there is shown a flowchart of the software running on the PSD. In Block <NUM>, the user turns on the PSD using switch <NUM> (<FIG>). Once the PSD is on, Bluetooth is enabled in Block <NUM> and the PSD connects to the cellular phone in Block <NUM>. Block <NUM> shows the loop where the panic button of <FIG>, block <NUM>, is monitored. When the panic button is activated, the cellular phone is notified via Bluetooth in Block <NUM> of the button press. Next, the high voltage charging circuit is activated in Block <NUM>. This can be an automated process as shown or is accomplished by the user enabling switch <NUM> (<FIG>). This allows the stunner to charge up to a debilitating voltage using the DC-DC converter of <FIG>, Block <NUM>, from a low voltage battery source (<FIG>, Block <NUM>). The PSD stays in this state of usefulness based on Block <NUM> until the situation is clear, meaning that the user is no longer needing the protection offered by the PSD. This is accomplished by turning the unit off using the power button in <FIG>, Block <NUM>, disabling block <NUM> using switch <NUM> or other means. In some embodiments, the power switch is a soft power switch, meaning that the power is never actually off, just sitting in a quiescent state, waiting for the power switch to be activated again.

Referring now to the invention in more detail, in <FIG> there is shown a flowchart of the OSD software running on both the OSD <NUM> and the cellular phone <NUM>. In Block <NUM>, the user turns on the OSD using switch <NUM> (<FIG>). Once the OSD is on, Bluetooth is enabled in Block <NUM> and the OSD connects to the cellular phone in Block <NUM>. Block <NUM> shows where the streaming images are sent to cellular phone <NUM>. These images are from camera <NUM>, which are transmitted via Bluetooth <NUM>. This happens continuously at a fixed rate, or at least with a timestamp attached to the image. This process may also be performed in a parallel manner, such as in a separate thread, since the processing is more intensive than the rest of the PSS software, as is known in the art.

Images are first processed in block <NUM>. Block <NUM> implements a people detection algorithm, as described in "Background Subtraction for Freely Moving Cameras," incorporated herein. The method operates entirely using 2D image measurements without requiring an explicit 3D reconstruction of the scene. A sparse model of background is built by robustly estimating a compact trajectory basis from trajectories of salient features across the video, and the background is 'subtracted' by removing trajectories that lie within the space spanned by the basis. Foreground and background appearance models are then built, and an optimal pixel-wise foreground/background labeling is obtained. Other people tracking algorithms are available, as understood by those skilled in the art, such as one described in "People Tracking via a Modified CAMSHIFT Algorithm," also incorporated herein. This in turn makes use of OpenCV, an open source computer vision library, also incorporated herein to supply an implementation of the Gaussian Mixture Model. The Gaussian Mixture Model performs background subtraction. Background subtraction involves calculating a reference image, subtracting each new frame from this image and thresholding the result. What results is a binary segmentation of the image which highlights regions of non-stationary objects. Shadows are also removed in this block. There are many other ways to perform the same function as block <NUM>, including the use of facial recognition instead of people recognition. Facial recognition can be found in open CV, Facereclib (https://pypi. org/pypi/facereclib), http://www. org/algorithms/ and commercial facial recognition software (http://www. com/facesdk/).

The results from block <NUM> are then processed in block <NUM> using an optical flow algorithm such as the Lucas-Kanade Algorithm. This algorithm is a widely used differential method for optical flow estimation, a version of which can be found in openCV. It assumes that the flow is essentially constant in a local neighborhood of the pixel under consideration, and solves the basic optical flow equations for all the pixels in that neighborhood using a least squares criterion. By combining information from several nearby pixels, the Lucas-Kanade method can often overcome vagaries of the optical flow equation. Other motion detection algorithms can be used, as is known in the art, such as found at http://blog. ws/opencv-simple-motion-detection.

Referring to <FIG>, additional details of the invention are shown in a flowchart of the software running on the cellular phone. In <FIG>, the Block <NUM> signifies that the user has enabled the PSD application. This can be performed in various user-friendly ways, including double tapping an icon, using speech recognition, etc. The first thing that happens upon startup is a reminder to the user to check the level of the irritant spray in Block <NUM>. Block <NUM> signifies that the user has enabled the OSD application. This can be performed in various ways, including double tapping an icon, using speech recognition, etc. The first thing that happens upon OSD startup is a reminder to the user to check battery charge, Block <NUM>, if required. Once the reminders are cleared, a number of actions occur in Block <NUM>. This includes enabling the received signal strength indicator (used for separation determination in Block <NUM>), starting the text application for contacting purposes, starting social media applications for constant contact updates, placing on standby audio and video recording applications, enabling locations services and/or child tracking and enabling the optical tracking algorithm that runs concurrently with the other PSS systems. After enabling these processes, a loop is entered where the panic button <NUM> is constantly monitored in Block <NUM> and rear assailant approach is noted in Block <NUM>. Block <NUM> receives input from the assailant tracking algorithm described in <FIG>. While in this loop, other actions are monitored. In Block <NUM> the state of the OSD is checked. If it is turned off, the OSD application is terminated. In Block <NUM>, the state of the PSD is checked. If it is turned off, both the OSD and the PSD applications are terminated. If either Block <NUM> or <NUM> are not turned off, then a check is made on whether the user has turned the PSS application off in Block <NUM>. If so, the application stops; if not, the loop is repeated.

However, if the panic button is pressed in Block <NUM>, or someone is approaching from behind in Block <NUM>, a different set of actions is initiated. These actions form a loop that continues until the user decides that a threatening situation is over. In Block <NUM> (<FIG>), the cellular phone issues a loud audio warning to the perpetrator. This can take the form of a warning that events are being recorded; emergency personnel are being contacted, etc. The capturing and sending of the data cannot be reversed or canceled by the user or potential perpetrator. The potential perpetrator is notified using a pre-recorded message broadcast via speaker <NUM> (<FIG>) or via built in cellular phone <NUM> speaker that the potential perpetrator's data has been captured by the electronic device, thereby discouraging the potential perpetrator from further proceeding with the crime. Next, in Block <NUM> (<FIG>), a check is made concerning the received signal strength indicator (RSSI) level. If the level indicates separation (a weak signal indicates a larger than expected separation distance), as programmed in Block <NUM> for a specified time, an elevation of the threat assessment is made in Block <NUM>. All information sent to contacts, social media, etc. in Block <NUM> are tagged to indicate that the threat has progressed to a more serious level. This can be done with stressor words, numeric levels or color coding, as appropriate. Block <NUM> (<FIG>) checks if the cellular phone application is disabled or not. If so, the application exits. Otherwise Block <NUM> is executed to see if the panic button has been disabled. If so, control is returned to Block <NUM>. Otherwise the loop is closed by returning to Block <NUM>.

If someone is approaching from behind as discovered in Block <NUM>, a different set of actions is initiated. These actions are part of the loop that continues until the user decides that a threatening situation is over. With reference to <FIG>, in Block <NUM>, the cellular phone issues a loud audio warning to the user and possible assailant indicating someone is approaching. This can take the form of a warning that events are being recorded; emergency personnel are being contacted, etc. The capturing and sending of the data cannot be reversed or canceled by the user or potential perpetrator. The potential perpetrator is notified using a pre-recorded message broadcast via built in cellular phone <NUM> speaker that the potential perpetrator's data has been captured by the electronic device, thereby discouraging the potential perpetrator from further proceeding with the crime. Next, in Block <NUM>, a check is made concerning the received signal strength indicator (RSSI) level. If the level indicates separation of the OSD (a weak signal indicates a larger than expected separation distance), as programmed in Block <NUM> for a specified time, an elevation of the threat assessment is made in Block <NUM>. All information sent to contacts, social media, etc. in Block <NUM> are tagged to indicate that the threat has progressed to a more serious level. This can be done with stressor words, numeric levels or color coding, as appropriate. Block <NUM> checks if the cellular phone application is disabled or not. If so, the application exits. Otherwise the loop is closed by returning to Block <NUM>.

Claim 1:
A personal safety device system, comprising:
a self-contained personal safety device (<NUM>) having a housing and including at least one self-defense mechanism;
said personal safety device (<NUM>) including a transmitter for wirelessly transmitting first signals to a cellular telephone (<NUM>), said transmitter being activated to transmit said first signals to said cellular telephone responsive to either (i) activation of said at least one self-defense mechanism, or (ii) manual activation;
an optical safety device (<NUM>) separate from said personal safety device and comprising a camera to identify and track potential assailants coming from behind, and streaming via Bluetooth second signals to said cellular telephone (<NUM>), wherein said second signals
comprise images captured by said optical safety device (<NUM>);
comprise information to be provided to said cellular telephone (<NUM>), including that a person or persons is/are approaching said user of said personal safety device (<NUM>) and including that said user requires assistance; and wherein
said cellular telephone (<NUM>), when said personal safety device (<NUM>) is manually activated by the user or when a potential assailant is detected coming from behind, issues an audio warning audible to said user and to said person or persons.