# Patent

## Title
System, method and device to interrogate for the presence of objects

## Abstract

A system, method and device to interrogate for the presence of objects, to prevent the inadvertent separation of the objects from their owner. An owner is alerted when they are separated from the objects by determining when a trigger event occurs, such as a person leaving and/or entering a particular monitored area or location. These monitored areas can be retrofitted with an electronic interrogation device that monitors local conditions to determine whether a user is entering or leaving the monitored area to trigger an interrogation of the personal items. The interrogation device is constructed and arranged to communicate with the objects to determine whether the objects are with the owner. The interrogation device automatically determines the presence of a particular object at the monitored environment and automatically generates a notification when needed. The system further controls functionality of the objects, according to illustrative embodiments, when the object is present.

## Background
RELATED APPLICATIONS
This application is a continuation of co-pending U.S. patent application Ser. No. 12/900,471, filed Oct. 7, 2010, entitled SYSTEM, METHOD AND DEVICE TO INTERROGATE FOR THE PRESENCE OF OBJECTS, the entire disclosure of which is herein incorporated by reference, which is a nonprovisional of claims the benefit of U.S. Provisional Application Ser. No. 61/278,415, filed Oct. 8, 2009, entitled SYSTEM FOR AUTOMATICALLY VERIFYING THE PRESENCE OF SELECTED OBJECTS, the entire disclosure of which is herein incorporated by reference; U.S. Provisional Application Ser. No. 61/292,848, filed Jan. 6, 2010, entitled CONTEXT AWARE TETHERING TECHNOLOGY AND DEVICE, the entire disclosure of which is herein incorporated by reference; U.S. Provisional Application Ser. No. 61/334,561, filed May 13, 2010, entitled SYSTEM, METHOD AND DEVICE TO INTERROGATE FOR THE PRESENCE OF SELECTED ITEMS, the entire disclosure of which is herein incorporated by reference; and U.S. Provisional Application Ser. No. 61/357,521, filed Jun. 22, 2010, entitled SYSTEM, METHOD AND DEVICE TO INTERROGATE FOR THE PRESENCE OF SELECTED ITEMS, the entire disclosure of which is herein incorporated by reference.


FIELD OF THE INVENTION
The present invention relates to determining the presence of objects, and more particularly to performing certain functions based upon whether or not an object is within a monitored area or location.
BACKGROUND OF THE INVENTION
The majority of Americans own a cell phone. According to an association representing the wireless telecommunication industry, in 2007, 82.4% of Americans owned at least one portable electronic communication device, such as a cell phone or a personal digital assistant (PDA). As cell phones become more prevalent, and with these devices becoming integrated into everyday life, the chances of leaving or losing them increases. Similarly, other personal objects such as wallets and purses are even more ubiquitous, and are also prone to disadvantageously being left behind or lost.
There are many situations in which a person wants to be sure to have all their important personal items with them when entering or leaving an area or location. Usually these locations are those most often frequented by the owners of such personal items. If people could be assured of having their personal items when entering or leaving their house, office, or vehicle, the likelihood of forgetting or losing such an item becomes much less likely.
Products are in the market currently to help people find items that have been misplaced. The product FIND ONE FIND ALL® by Melbourne Designs, LLC, of Arlington, Tex., for instance, exemplifies systems using tracking devices that can be put on a cellular phone, wallet, or keys. Such systems, which include avalanche rescue modules, can track other devices or themselves be tracked by other devices. They are typically equipped with RF-emitting and perhaps RF-detecting attachments. When an object needs to be found, the user indicates such by putting one of the devices into “find” mode and using the RF-detecting means to locate the lost article that is emitting an RF signal or sound by which it can be found.
Other products in the market also try to prevent separation in the first place. They often operate by linking devices together to prevent a user from inadvertently leaving one behind. Such linked devices output an alarm when one of the paired objects is out of proximity of one another. U.S. Pat. No. 7,002,473 refers to a monitoring device, such as a cellular phone with included RFID reader that monitors objects equipped with RFID tags. The cellular phone outputs an alarm when any of the objects is not within proximity to the reader. This prior art system disadvantageously requires that the user of the system carry the interrogation device with him or herself.
Attempts have been made that pair objects to track one another, or a master device tracking a slave device. For instance, U.S. Pat. No. 6,265,974 refers to monitoring the spatial relationship between two communication devices for the purposes of preventing a child from becoming lost. The system works by producing alarm when the child is a certain distance from the parent when the device is in motion. Similarly, U.S. Pat. No. 5,781,109 relates to a paired alarm system, which would output an audible alarm when one unit is separated from one another. There is a need for a system that interrogates for a plurality of items and performs certain functions in response to whether or not the items are within range.
Other attempts, such as U.S. Pat. No. 6,967,576, relates to general location tracking with alarm output using a tracking device that communicates with objects to be tracked via electronic beacons. Alerts are sounded if the distance between the tracking device and the object to be tracked increase past a threshold and if the location of the tracking device is outside a defined area such as a house. U.S. Pat. No. 7,009,512 also relates to two devices monitoring distances between one other. In both cases, such prior art uses tracking devices for a user to carry as opposed to in a particular location or area.
SUMMARY OF THE INVENTION
The present invention overcomes several disadvantages of the prior art by providing a system that interrogates for the presence of objects and generates a notification for an undetected personal item at a monitored area or location. The system for interrogating for objects at a monitored location to generate a notification of undetected personal items comprises an interrogator device and a communication module on the personal item. The interrogator device has a range within which the interrogator device interrogates for and can detect a tracked object. The sensing device on the tracked object receives an interrogation request from the interrogator device and, when in the detectable range of the interrogator device, transmits tracked object data to the interrogator device. The interrogator device had stored therein tracked object data for a plurality of tracked objects, and generates a notification when a tracked object is not within the detectable range of the interrogator device.
The method for interrogating a tracked object initially stores data for a plurality of tracked objects on the interrogator device such that the interrogator device has a list of tracked objects that should be within the detectable range of the device. Then, the procedure determines whether the tracked objects are within the detectable range of the interrogator device when a trigger event occurs and triggers the interrogation of the tracked objects. The trigger event can be a person entering or leaving a particular area. If a tracked object is not within the detectable range, a notification is generated to the owner of the tracked object. This can be generated on the interrogator device or on the tracked object itself.
The interrogator device includes a communication module, such as Bluetooth circuit or a conventional sensor that, upon the trigger event, interrogates the tracked objects to determine if they are within the detectable range of the interrogator device. The interrogator device includes a system controller that determines whether a notification is generated based upon the input from the communication module, and also includes an output means to generate the notification of undetected tracked objects.
The interrogator device can have one or more “car-in-motion sensors” (CIMS) to detect when a car is about to be, or is put into motion. Such CIMS can include the illustrative approach of a voltage meter circuit that can discern when the car has started, an accelerometer that can sense an idling engine or moving vehicle, or circuitry that detected car engine noise coming through the cigarette lighter.
When a CIMS indicates motion or engine activity the interrogator device can establish a Bluetooth connection with the previously mated phone. If no phone is present, an alarm can be sounded in the traditional manner and in that manner, the interrogator device functions as a conventional interrogator device as described herein.
An interrogator device that is already paired with a phone, and which already contains Bluetooth technology, can readily perform the function of a hands-free unit by building in a speaker and appropriate interface buttons and software. As such, an interrogator device hands-free unit, working in conjunction with application software on the paired phone, can be used to reduce the frequency with which a phone can need to be retrieved from a pocket or purse. Such software on the handset, working in conjunction with an interrogator device or other hands-free unit, can be called a phone in place (PIP) implementation.



BRIEF DESCRIPTION OF THE DRAWINGS
The invention description below refers to the accompanying drawings, of which:
FIG. 1 is an overview block diagram for an interrogation system according to an illustrative embodiment;
FIG. 2A is a perspective front view of an interrogation device constructed and arranged to be inserted into a vehicle power port, according to a vehicle implementation of the illustrative embodiment;
FIG. 2B is a cross sectional view of the interrogation device of FIG. 2A when inserted into the vehicle power port, according to the illustrative embodiment;
FIG. 2C is an overview flow diagram for establishing communication between the interrogation device and objects according to the illustrative embodiment;
FIG. 3A is a front perspective view of the interrogator device of FIG. 2A according to the illustrative embodiment;
FIG. 3B is a back perspective view of the interrogator device of FIG. 2A according to the illustrative embodiment;
FIG. 4 is a schematic diagram of an exemplary architecture according to a vehicular implementation of the illustrative embodiment;
FIG. 5 is a flow diagram illustrating a procedure for generating a notification upon arrival of a vehicle, in accordance with the illustrative embodiment;
FIG. 6 is a flow diagram illustrating a procedure for generating a notification upon departure of a vehicle, in accordance with the illustrative embodiment;
FIG. 7 is a flow diagram of a procedure employing context aware tethering technology in accordance with the illustrative embodiment;
FIG. 8 is an overview flow diagram showing a building implementation of the interrogation system, according to the illustrative embodiment;
FIG. 9 is a front perspective view of an interrogator device for the building implementation in accordance with the illustrative embodiment;
FIG. 10 is a rear perspective view of the interrogator device for the building implementation in accordance with the illustrative embodiment;
FIG. 11 is a schematic diagram of an exemplary architecture for the building implementation according to the illustrative embodiment;
FIG. 12 is an overview block diagram of an office implementation of the interrogation system according to the illustrative embodiment;
FIG. 13 is a flowchart of a procedure for interrogation within the office implementation according to the illustrative embodiment;
FIG. 14 is a flow chart of a procedure for performing intelligent tethering according to the illustrative embodiment; and
FIG. 15 is a flow chart of a procedure for implementing a Baby Seat Positive Separation (BSPS) system, according to the illustrative embodiment.



DETAILED DESCRIPTION
A system, method and device for interrogating for the presence of certain personal items allows a user to be notified when an item is absent, has lost power, or is lacking a communications means that it previously had. When an item is present, the system, method and device can control certain functionalities of an item. FIG. 1 shows a block diagram representing an illustrative embodiment of the interrogation system as it is generally used. Interrogator device 100 can be equipped with a communication module 101 or other appropriate element constructed and arranged to communicate with personal items and objects, and more particularly communication modules (116) on these objects in an illustrative embodiment.
The interrogator device 100 can also include stored object data 102 that includes data relating to a plurality of selected or tracked objects 115. These items can include personal belongings, such as a cell phone, wallet, laptop computer, computer bag, or other item a person/user desires to keep track of or keep with them. The dotted line 110 around the interrogator device 100 represents the detectable range of the communication module 101 of the interrogator device 100. The detectable range 110 of the interrogator device 100 is highly variable depending on the particular monitored location and/or area for which selected objects are interrogated. For example, a larger area, for example up to 30 feet away from the interrogator device can be selected when in a house or large building, while a smaller area, for example up to 8 feet, can be chosen for an office space, vehicle or smaller location of interest. The detectable range is generally an area having a radius of detection a specified distance, such as a few feet and up to 30 feet or even further, from the interrogator device. The signal strength generated by any tracked object declines over distance and thus the detectable range can be adjusted by the interrogator by looking for signal strengths above specific thresholds. The signal strength and sensitivity can be set by the manufacturer of the interrogator device to come from the factory with a predetermined detectable range. In further embodiments, an interface can be provided to allow a user to specify the detectable range using conventional circuitry and RF filtering to achieve the desired range of the interrogator device.
Refer to U.S. Pat. No. 6,631,271, filed Aug. 29, 2000, entitled RULES BASED METHODS AND APPARATUS, which is herein incorporated by reference, and U.S. Pat. No. 6,996,402, filed Oct. 7, 2003, entitled RULES BASED METHODS AND APPARATUS FOR GENERATING NOTIFICATION MESSAGES BASED ON THE PROXIMITY OF ELECTRONIC DEVICES TO ONE ANOTHER, which is herein incorporated by reference, for exemplary rule based method and apparatus for relative tracking of objects.
When a trigger event occurs at the particular location equipped with the interrogator device, the event triggers the interrogation of the tracked objects 115. The triggering event can be a person entering a monitored area, or leaving a monitored area, as indicated by detecting that a car has been started or is put into motion, as described in greater detail hereinbelow. The interrogation occurs between interrogation device 100 and tracked object 115 when within the detectable range 110 via datastream 105. Tracked object 115 may also sense a trigger event through communication module 116. Tracked object 115 then transmits, via datastream 120, the tracked object data to interrogation device 100, which uses the data to trigger an interrogation of the tracked objects. The interrogation of tracked object 115 under the condition of trigger event generates a reminder from the interrogator device 100. Further, interrogator device 100 can prompt tracked object 115 for information from communication module 116 of the object 115. The interrogator device 100 can receive information available on tracked object 115 to generate a reminder. Reminders can be generated at interrogator device 100, as well as at the tracked object 115 when initialized by communication from the interrogator device 100.
As shown in FIG. 1, a tracked object 130 that is outside of the detectable range 110 of the interrogator device 100 is not detected by the interrogator device 100. The communication module 131 is thus not able to communicate with the communication module 101 of the interrogator device 100 or the signal strength is not above the threshold as mentioned above, and thus a notification is generated to alert the user that they do not have all of their objects and personal items. The notification can be a textual notification to the user or an audible or visual alarm generated by the interrogator device or a selected object that is within the detectable range. Data pertaining to the tracked objects 115 are stored in the interrogator device as stored object data 102, thereby creating a list of tracked objects within the interrogator device such that once a tracked object is recognized by the interrogator device, it need not be input again to the interrogator device. The interrogator device 100 automatically interrogates for personal items stored therein to prevent the user from leaving behind his or her personal items when such interrogator is positioned in a vehicle, or forgetting to bring them if the case where the interrogator is located in a stationary position such as a room. Once a personal item is detected, the interrogator device 100 can also be employed to control functionality of detected items, as described in greater detail hereinbelow. The system is readily applicable for tracking a single object, such as a cell phone, or a plurality of objects, as so desired.
I. Vehicle Embodiment
FIG. 2A shows the general system diagram of FIG. 1 in a vehicle scenario according to the illustrative embodiment, wherein the interrogator device 200 is a pluggable device for use with the power port 205 of a vehicle. The vehicle can be a car, truck, van, boat, ATV or any other automobile or appropriate mobile device having a power output. The interrogator device can be manually inserted into the car power port 205, such as a cigarette lighter or any other similar power port of a vehicle. In addition, the interrogator device can be plugged into the car's OBD (On-Board Diagnostics) port, which can supply both power to the device, as well as data indicating when the car has started.
FIG. 2B shows a cross-sectional view of the interrogator device of FIG. 2A when it is inserted into a vehicle power port 205. In its inserted state, interrogator device power lead 215 is in contact with vehicle power port power connection 220 and interrogator device ground lead 225 is in contact with the vehicle ground 230. Ground lead 225 is spring loaded from within interrogator device 200, providing a pressure fit when interrogator device 200 is inserted into vehicle port 205.
FIG. 2C shows the elements of the vehicle implementation for interrogating for personal items. The interrogator device 235 communicates with the personal item, electronic device 240, by interrogating the object via datastream 250 and receiving a device indicator (detected or undetected) and other communication data via datastream 252. Electronic device 240 can be a cellular phone, a smart phone, a personal digital assistant, or any device equipped with local and/or wide area communication capabilities. Communication between the electronic device 240 and the interrogator device 235 can be any communications channel, such as Bluetooth, Wi-Fi, infrared, or other radio frequency means of communication such as RFID or Zigbee. In one embodiment, when the electronic device 240 is a cell phone, the means of communication can be the periodic signal sent by such cell phone to a nearby cell phone tower, with such signal able to be received by the interrogator device. Function list 243 shows functions that reside on the electronic device 240 to control the interrogator device. These include a link-to-car device function, a link-to-personal device function, a disconnect-to-device function, an add-phone-to-monitor-list function, an add-device-to-monitor-list function, remove-phone-from-monitor-function and a remove-device-from-monitor-function, to control functionality of the overall system. This is likewise transmitted to the interrogator device via datastream 252.
The interrogator device 235 also interrogates for the selected object 245 via datastream 253, and a device indicator and other communication data is transmitted via datastream 254 back to the interrogator device. Tracked object 245 can be inserted within personal object 246, for this example, a card 245 inserted in the wallet 246. The personal object 246 can be a wallet, a purse, a bag, a keychain, or any object that the person wants to track and the tracked object 245 can include a communication module 247 or other appropriate element communicatively connected to the interrogator device. The electronic device 240 and tracked object 245 can also communicate with each other via datastream 255 as a link is established between the tracked objects via any appropriate communication channel.
Functions 243 on electronic device 240 consist of functions that electronic devices 240 performs to manage the list of devices tracked by interrogator device 235. The user can select different functions from the user interface on electronic device 240. Such functions include being able to link electronic device 240 to interrogator device 235 and unlink said devices, via datastream 255. Electronic device 240 can establish a link between itself and tracked object 245 through function list 243 and also add tracked object 245 to the list of objects being tracked by interrogator device 235. Conversely, mobile device 240 and tracked object 245 can be removed from the tracking list on interrogator device 235 through the function list 243.
The communication established between the interrogation device and the tracked objects allows the user to determine if any personal items are present or, more importantly, if any are not present. As shown, the interrogator device interrogates the tracked object via datastreams 250 and 253, for the electronic device 240 and tracked object 245, respectively. Then an indication of the state of the device, as well as additional communication data if desired, is transmitted to interrogator device 235 via datastreams 252 and 254, such that the interrogator device 235 can determine whether one of the objects under inquiry is not present. The connection between the devices also allows the electronic device 240 and objects 245 to communicate information from their on-board communication module to the interrogator device as device indicator signals via datastreams 252 and 254, respectively. In one embodiment, electronic device 240 and tracked object 245 are equipped with on-board accelerometers. In such embodiments, electronic device 240 and tracked object 245 relay movement readings sensed from their on-board accelerometers to interrogator device 235 through datastreams 252 and 254, respectively.
FIGS. 3A and 3B, respectively, show front and back views of the interrogator device according to the illustrative embodiment. The interrogator device 300 is a pluggable device that is inserted into the car power port. Device 300 has a speaker output 310 located on its side. A notch 305 is placed in the casing to provide leverage for the operator's finger allowing for easy insertion and extraction of device 300 from the car power port. The button 330 can set interrogator device 300 into a programming mode to listen for the object that is to be added to the monitoring queue. The monitoring queue is a list of tracked objects to be monitored by the interrogator device, as specified by the owner of the tracked objects. Interrogator device 300 uses the monitor queue to determine whether to generate a notification if an object in the list is missing under a circumstance of interest. Additionally, button 325 can set the interrogator device 300 into a programming mode to control the removal of objects from the monitoring queue. Light indicator 345 provides indication to the user that interrogator device 300 is on. Light indicator 340 provides indication that the interrogator device 300 is in a programming mode and it is seeking to add an object to the monitoring queue. Light indicator 335 provides indication that the interrogator device 300 is in programming mode and is seeking to remove an object from the monitoring queue. Light indicator 345, light indicator 340, and light indicator 335 are of different color to one another to provide an easy reading to the user.
FIG. 4 depicts a schematic diagram illustrating an exemplary architecture of the interrogator device according to the illustrative embodiments. System 400 has two primary controllers that interface with each other: a system controller 450 and communication (i.e. Bluetooth) controller 415. These two controllers can be separate or two sections of a single integrated circuit. The system controller 450 runs the primary software and the high-level function control of the interrogator device. It takes in all the inputs from the communication modules and determines whether a notification should be generated. Communication controller 415 manages all the networking functions on the interrogator device and generates the alert waveform to speaker 405. Digital signal processor 445, which may be part of controller 410, receives inputs from the on-board accelerometer sensor 435 and voltage sensor 465 and provides feedback to system controller 450 as to whether the activity of interest is detected. Power management circuitry 485 draws power from the vehicle power port and provides power for all the circuitry in interrogator device 400.
Communication controller 415 can be the Broadcom® BCM4325, a single chip IEEE 802.11a/b/g MAC/Baseband/Radio with integrated Bluetooth® 2.0+EDR and FM receivers or equivalent. It manages all the networking functions of the interrogator device. Communication controller 415 has a built-in baseband, media access control (MAC) address, and PHY.
Communication controller 415 can interface with system controller 450 through a four-wire serial-digital input and output (SDIO) interface using its internal universal asynchronous receiver and transmitter (UART). Communication controller 415 connects with radio frequency antennae 425 through a balun 420, which provides adjustments to the line impedance, reducing interferences from line mismatch. Balun 420 adjusts the balances and unbalances input with respect to the interrogator device ground. Located between balun 420 and RF antenna 425, radio frequency (RF) filter 430 is employed to extract the narrow band frequency component of the input signal ranging between 2.35 GHz and 2.52 GHz. Digital clock 421 provides a digital reference signal for Communication chipset 415, and has a reference clock between 12-52 MHz. Although Communication chipset 415 uses its internal random access memory (RAM) and operates its instruction stored within its read-only memory (ROM), external flash memory 422 provides a means to update its firmware and its instruction sets, which are stored internally.
Communication chipset 415 receives power from the direct current-to-direct current (DC/DC) converter 490. DC/DC converter 490 provides a voltage output of 2.5V to 5.5V to Communication chipset 415. An internal switching regulator within Communication chipset 415 generates the internal voltages necessary to operate its internal circuitries. DC/DC converter 490 is fed power from battery charger 480 or from rechargeable batteries 495. Battery 495 enables interrogator device 400 to operate even when the vehicle is off and when there is no power output from the vehicle power port. The battery charger 480 converts the 12V output of the vehicle power port to 5V.
User interfaces 455 connect directly with the controller 450 and are digital inputs and outputs that interface to the lighting indicators on the interrogator device's casing, and the buttons used for the interrogator device programming. Upon pressing the programming button, a de-bounced circuit latches the input with a dead time of 50 milliseconds, thus preventing multiple inputs from being generated and sent into controller 450.
Communication chipset 415 generates the signal to the speaker, which provides the alarm to the user, based on a digital signal from the controller 450. The internal oscillator of the Communication chipset 415 outputs the signal to pulse width modulation (PWM) circuit 410. PWM circuit 410 is supplied by a 5V power connection from DC/DC converter 490 and outputs the PWM waveform to the speaker 405, which converts the electrical signal to an audible sound with a frequency of between 20 Hz and 5 KHz. The speaker output can be varied by the operation of the controller 410 and the PWM, xxx to output sounds of variable amplitudes. The digital signal processor 445 monitors and analyzes inputs from the sensors, which are the movement readings from accelerometer sensor 435, and from the voltage reading from voltage sensor 465. Voltage sensor 465 is connected to power lead 215 and the ground lead 225. The voltage sensor readings are fed into a voltage divider 463 that s normalizes the voltage to a value within the range of the A/D converter. The signal is fed into an analog-to-digital (AD) converter 460 that can digitize the normalized voltage at 12-bit resolution sampling at 5 KHz. The signal varies in amplitude, but has a frequency range between 50 Hz to 533 Hz, which are the frequencies generated from the firing sequence of the vehicle engine at idle for a 4-cylinder engine to an 8-cylinder engine. A calibration algorithm is employed within digital signal processor 445 to normalize the signal's amplitude based on noise averages observed during typical time period of inactivity.
Voltage sensor 465 and the corresponding scaling circuitry can sense for the presence of power, for electrical noise, and for elevated voltages changes. In the event of sensing for electrical noise, the goal is to detect for frequency information within the power line. As such, analog means of detection can be utilized, such as employing an analog band pass filter sensing for a specific frequencies in the range of 50 Hz and 533 Hz. The output of the band pass filter can be integrated with an RC circuit and compared against a fixed selectable threshold. In the event of sensing for the presence of power, the simple comparator circuit whose output is fed into the controller 450 can be utilized as the substitute for the back end for the voltage sensing circuitry and signal processing function. Other means of power detection can also be employed, such as using a simple field effect transistor whose gate is fed by the power line being monitored and whose output are fed directly to controller 450. The detection can be based on current using any types of switch, such as a bipolar junction transistor. Mechanical and electronic relays can also be utilized. The goal of any circuit is to detect the presence of power. In the event of sensing for elevated voltage level indicating the vehicle has started, and thus the battery is being charged by the alternator, voltage detector means described hereinabove can be employed to sense for a voltage change from approximately 12V (the battery voltage when not being charged for a vehicle powerport having constant power) or from 0V (for a vehicle powerport with no power when the engine is on) to 14.5V (the approximate voltage when the alternator is charging the battery, which happens as soon as the car is started). A simple comparator circuit can also be utilized as a substitute to compare the input voltage with a reference voltage ranging between 11.0V and 14.6V. Prior to starting the engine, electrical signatures from the power port can be monitored and stored by the interrogator device. During this time period, little electrical activity is present in the vehicle power bus as the engine is typically the key contributor of electrical noise within the overall system. This electrical signal is referred to as the null signature. Thus, the interrogator device stores records of the determined engine status based on either the presence of the active engine's electrical activity or based the presence of the null activity from the engine. The signatures of both active and inactive engine activity can be utilized together to improve the delectability and accuracy of the engine “on” state by improving the signal to noise ratio of the incoming signals. The electrical signature can be detected based on detectors of both DC as well as AC components within the monitored signal.
Accelerometer sensor 435 in an exemplary embodiment is the Freescale MMA7260Q, a triple axis accelerometer in a chip form factor. The accelerometer sensor 435 takes a 3.3V power input from DC/DC converter 490 and has a sensing range of up to 1.5 gravitational forces with an output sensitivity of 800 milli-volt per gravitational force (mV/g). Accelerometer sensor 435 has three output channels, one for each of its three axes of movement. A vehicle may experience between 10 milli-gravitational forces to 150 milli-gravitational forces in any axis when a person enters or leaves the vehicle. The three channel outputs from accelerometer sensor 435 feeds into three amplify circuits 437, which amplify the input signals by a factor suitable to drive the following A/D converter 440. The output from amplifiers 437 are fed into a single multiplexing serial A/D converter 440, which has an input range of 0V to 1V at 12-bit resolution sampling at 1 KHz. The resolution of the A/D converter 440 is approximately 24 micro-gravitational forces. A/D converter 440 samples the input signal simultaneously using an internal front-end analog latch, and then serially converts the analog signal to its digital representation. The A/D converter 440 outputs the serial digital stream representing the three analog movement readings to digital signal processor 445.
Digital signal processor 445 operates two primary algorithms, one to process the voltage readings, and the other to process the accelerometer readings. With the accelerometer reading, digital signal processor 445 normalizes the three input readings into a single scalar value by taking the square root of the sums of the square of each of the input readings. Digital signal processor 445 decides if movement exists when the normalized reading value exceeds a calculated threshold value. The threshold value is calculated from the average values of the normalized readings taken when the vehicle is not in motion and is the average value with an offset added to it. Digital signal processor 445 signals controller 450 when such movement activity is detected.
Digital signal processor 445 determines if the engine is operating by analyzing the voltage reading from the car power port. Digital signal processor 445 performs a Fourier Transform function on the input voltage readings from voltage sensors 465. The signals, which were represented in the time domain, are transformed to the frequency domain. The engine is determined to be on if a frequency spike with at least twice the amplitude of nearby frequencies is found between the frequency of 50 Hz and 533 Hz. Digital signal processor 445 outputs the decision value for presence of movement and for engine electrical noise to controller 450, which makes the decision on whether to output an alarm to the user.
A. Sensing Signals that can Instigate an Interrogation
There are numerous sensing means that produce data that is used to initiate the interrogation device to look for objects a user wished to bring to a location or have on their person. In vehicles, these include accelerometers, voltage meter and engine noise circuits inserted into car power outlets, IR sensors and cameras to detect the presence of persons in a vehicle, sensors that register when a car door is opened from the outside or inside, sensors that register when someone is sitting in a car seat, etc.
Another sensor that can be used to instigate an interrogation is a GPS circuit, which can be part of the vehicle interrogator device. Alternatively, GPS data can be communicated to the interrogation device from another GPS circuit in the car via a wireless link, the OBD port, or other means. In any of these approaches, the GPS data can be analyzed by the interrogator and if it appears from that data that the vehicle is leaving its fixed location, after having been at rest for some period of time (as determined by using an algorithm similar to that needed by the accelerometer approach described for the vehicle-based PID) then the interrogation can begin.
B. Filtering Voltage Fluctuations and Accelerometer-Based Means of CIOD
Another feature of the interrogation device concept is that of being able to detect when the car has started. Such “CIOD” (or Car-Is-On-Detection) technology, also described herein by employing CIMS (car-in-motion-sensors), and can be accomplished by circuitry connected to the vehicle power port that looks for noise signals in the electrical system of the vehicle emanating from the engine when the engine is running, or from the increase in the voltage level in such system when the alternator kicks in. Other approaches include use of an accelerometer to detect that the car is in motion, or if sensitive enough to detect the vibration of a running motor.
There are useful, detailed algorithms behind the interrogator device's ability to detect when the car starts using voltage measurements that go beyond using a simple threshold measurement. These techniques apply to those power ports that are always on. Ports that turn on and off as the car starts and turns off don't need a special method to discern when the car has started.
As discussed herein, the primary method for determining the status of the engine is a voltage measurement circuit that looks for the rise in voltage being supplied to the power port that occurs when the car starts.
Problems with this method occur, however, because occasionally a car's voltage drops for short periods of time during a trip. This could be interpreted as the car being turned on and off if an algorithm is used that relies on a simple threshold voltage. To solve that problem, we have instituted a filter that requires the voltage to stay below the threshold for a minimum of five minutes in order to qualify as an event where the engine did actually turn off. In almost all cases, the voltage will rise back into the normal car-on voltage range within this time period.
To further separate actual car-turn-offs from simple voltage fluctuations, we have build hysteresis into the voltage measurement. Thus, the voltage must go above a certain voltage to be considered on, V1. To be considered off, however, the voltage must fall below V1-Vh, where Vh is the amount of hysteresis used. Again, as mentioned above, the voltage must stay below Vh for a minimum amount of time before the car is considered to be off.
An additional way to gather information about the status of the engine is to monitor engine noise that may be picked up and carried in the circuit supplying power to the power port. Such noise analysis can by itself be enough to determine engine status. If such analysis is ambiguous but provides probabilistic information of value, then such noise analysis can be combined with voltage readings to determine if the decline in voltage was due to the engine being turned off or because there was temporary decline in voltage while the car was still running.
A waiting period can be applied in illustrative embodiments, to discern between long stops and actual turning off of the engine. Accordingly, if no motion is detected over, for instance, a specified period, such as five minutes, it determines that the car had been turned off.
This determination could further be reinforced if the accelerometer detected motion that was generated by a person getting out of a car and closing a door. These action would produce a signature signal from the accelerometer. Such signature signals could be learned by the unit by having the user “train” it by putting the interrogator unit into training mode and then performing such actions.
C. Generic Car-is-on Detection Used for Other Devices
As GPS systems use a lot of power, they need to be powered off if connected to an always-on power port as they could drain the battery if left on too long. Today, that power-down may be handled by the system noting that the GPS indicates that the car is standing still. But using GPS information will still leave a time lag in turning the unit on and off.
The inclusion of the CIOD technology into other devices such as GPS systems, would allow such systems to automatically turn on and off as the car turns on and off when such units are plugged into car power ports that are “On-Off” ports (as opposed to “always-on” ports). According to this implementation the unit maintains a low power mode waiting for the signal from the CIOD circuitry to go into a fully operational state. The CIOD technology is implemented in a device similar to the interrogator device described herein, such as the pluggable device for a vehicle power port, as shown in FIG. 2A, but differing in structure. For example, the structure can provide technology of the interrogator device and CIOD technology while still defining a socket for use of the vehicle power port and still monitoring the power output of the vehicle. The CIOD technology-enabled device is operatively connected to the GPS system, or integrated directly therewith, to control the power (ON/OFF) for the GPS system. Thus, an “always on” (i.e. power is constantly supplied) port becomes an on/off port with the vehicle turning on or commencing motion, as monitored by the CIOD technology-enabled interrogator device.
D. Bluetooth Functions
As described in Profiles, Specification Volume 2, Specification of the Bluetooth System, V1.0B, Dec. 1, 1999, under the Generic Access Profile, two communicating devices involved in a Bluetooth communication can take the roles specified by the generic notation of the A-party (the paging device in case of link establishment, or initiator in case of another procedure on an established link) or the B-party (paged device or acceptor). The A-party is the one that, for a given procedure, initiates the establishment of the physical link or initiates a transaction on an existing link.
The Bluetooth access profile establishes the procedures between two communicating devices to discover and connect (link and connection establishment) for the case where neither of the two communicating devices has any link established as well as the case where (at least) one communicating device has a link established (possibly to a third communicating device) before starting the described procedure. The Bluetooth user should, in principle, be able to connect a Bluetooth device to any other Bluetooth device. Even if the two connected communicating devices don't share any common applications, it should be possible for the invention to operate using basic Bluetooth capabilities.
Each Bluetooth device is specified by a unique 48-bit Bluetooth Device Address and a Bluetooth Device Name, which can be up to 248 bytes long. Additionally, each Bluetooth device has an assigned Bluetooth passkey, which is used to authenticate two Bluetooth devices that have not previously exchanged link keys to each other. The trust key allows two Bluetooth devices to create a trusted relationship between each other.
Bluetooth devices are further specified by a class of Bluetooth device parameters received during the Bluetooth device discovery procedure, which broadcasts the type of Bluetooth device and the types of supported services.
Bluetooth devices are capable of performing inquiry functions to determine the identity of the Bluetooth device class of other discoverable Bluetooth devices when they are in range. Two discoverable modes exist, which are limited discoverable mode and general discoverable mode. Bluetooth devices are capable of performing different types of inquiries called a (1) general inquiry, (2) limited inquiry, (3) name inquiry, (4) Bluetooth device discovery, and (5) bonding. The purpose of general inquiry procedure is to provide the initiator with the Bluetooth device address, clock, Bluetooth device class, and used page scan mode of general discoverable Bluetooth devices. Bluetooth devices in limited discoverable mode are not discoverable using the general inquiry. General inquiry is used to discover Bluetooth devices that are made discoverable continuously or for no specific conditions. Limited inquiry procedure provides the initiator with the Bluetooth device address, clock, Bluetooth device class, and used page scan mode of limited discoverable Bluetooth devices. Limited inquiry is used to discover Bluetooth devices that are made discoverable only for a limited period of time, such as during temporary conditions or for a specific event. Name discovery provides the initiator with the Bluetooth device name of connectable Bluetooth devices using the name request procedure. The procedure uses the Device Access Code of the remote Bluetooth device as retrieved immediately beforehand. Bluetooth device discovery provides the initiator with the Bluetooth address, address clock, Bluetooth device class, used page scan mode object, and list of discoverable Bluetooth devices. During the Bluetooth device discovery procedure, an inquiry is performed, and then name discovery is done towards the Bluetooth devices that responded to the inquiry. Bluetooth devices have a built-in ability to detect the presence and identity of other Bluetooth devices, which are within its range, and may be used to provide location information to generate useful notification messages to the user.
E. Multi-Pairing, Multi-Tracking
The interrogator device can be programmed to allow pairing for two or more objects, such as two different phones. With a multi-tracking feature, the interrogator device is constructed and arranged to monitor for either phone A or phone B (or even more phones). This is be particularly useful if two people shared a car.
Alternatively, an interrogator device paired to two (or more) phones could also be set up to alert the user(s) if both phones were not there. This could particularly useful when two people always rode together, for instance, two workers in a truck.
This feature can be implemented at the OEM level by linking the interrogation function to one or more sensors built into seats. If the sensor detects the presence of a person in a particular seat, then the interrogator device searches for that person's paired phone. For example, the interrogator device can be paired to both a husband's and wife's phone. If the seat sensor determined the presence of a second person in the car, then The interrogation device would search for both phones and sound an alert if not found. Such a sensor would be most value if it conveyed weight information which would increase the probability that the assumption that the extra passenger was the spouse was correct.
Another sensor available for the seat sensor include infrared sensors, for example, as discussed herein, that convey to the interrogation device information about the presence of another user.
For car poolers, a multi-tracking feature is highly desirable during weekday trips in the morning and evening. Thus, an interrogation system can be enabled with the ability to tell time and day. Such information can be programmed into the interrogation device and maintained with a battery or other constant source of power. Additionally, time and calendar information can be continuously fed to the interrogation device via applications running on one or more phones that are being tracked by the interrogation device.
Another feature is the ability of a multi-paired interrogator device to “boot-strap” its way into “multi-tracking” mode. For example, an interrogator device that is used by a driver who drives alone most of the time but also handles a car pool occasionally. The riders in the car pool often have multiple cell phones, iPads, and other objects. Once the interrogation device detects at least one of these extra devices, it can deduce that that trip consists of a car pool trip and therefore continues to search for all the items in its list of items. It is unlikely that all of the items on the non-driver search list are missing at any one time. Therefore, the presence of any of them can provide the signal that a non-driver-item search is needed.
F. Notification Generation Procedure—Starting a Vehicle
FIG. 5 shows the flow diagram for an interrogation procedure 500 of an exemplary embodiment of the invention for generating an alarm if selected items are not detected upon a person starting a vehicle. Upon power-up at procedure step 501, the interrogator device scans the vehicle's 12V output port for electrical noise at step 505. The interrogator device controller transforms the sensor reading from the time domain to the frequency domain to determine if certain frequency components exist within the 12V output port at decision step 510. If the certain frequency component exists, then the interrogator device establishes that the vehicle's engine is on. Then at step 515, the interrogator device scans for tracked objects that are in list of tracked objects to be interrogated upon entry into the vehicle. If a network connection is established between the interrogator device and the objects at decision step 520, the presence of the tracked object in the vehicle is confirmed and an alarm is not generated, and the procedure ends. However, if the network connection is not established between the interrogator device and the objects at decision step 520, the interrogator device outputs an alarm at step 525 to notify the user that a tracked object is missing from the vehicle. In an exemplary embodiment, the tracked object are scanned for a predetermined amount of time, such as 30 seconds, to ensure adequate time in establishing the connection, thus reducing the likelihood of false notification. The user has the option within the program menu to reduce or to increase the wait time before a notification is given.
In another embodiment of the invention, the interrogator device is equipped with a microphone system. When the user instructs the interrogator device to add a personal object to the list of tracked objects to be interrogated, a custom message can be recorded and stored to correspond to the tracked objects. For example, if the user programmed his cellular phone to the list, he can save the message, “cell phone”. Thus, when the interrogator device searches for the cellular phone and does not find it, it can notify the user with the user's custom-recorded message. Alternatively, such object-specific names can be selected from a list. This feature is useful when multiples objects are tracked by the interrogator device. Alternatively, the method of programming customizable alerts can also be implemented through an interface on an application on the user's cellular phone and such alerts thereafter transferred to the interrogator for storage and later use, or by connecting the interrogator to a PC via a port such as a USB port and using software on the PC to download such audio files to persistent storage on the interrogator.
In another embodiment of the invention, a user interface provides a display of selectable objects to be added to the list of devices to be monitored. To add an object, the user presses the add object button. The interrogator device enters the programming mode and listens for a Bluetooth broadcast from other communicating objects. A lighted indicator signals to the user the status of the programming sequence. Once a tracked object is found and a link is established, it is added to the list of tracked objects to be interrogated, where the alarm will sound if the tracked object is not located within the proximity of the vehicle when the vehicle is started.
G. Notification Generation Procedure Upon Vehicle Exit
FIG. 6 is a flow diagram showing the procedure for generating a notification based on a trigger event during the exiting of a vehicle. The scenario begins with the vehicle in an “on” state with the engine running, and a communication link 603 established between interrogator device 601 (located within the vehicle) and tracked object 650, such as a smart phone device in the illustrative embodiment. A list of tracked objects present within the vehicle is maintained by the interrogator device 601 and is shown in step 600. A link is maintained with the tracked object 600 in step 651. When leaving a vehicle, an operator would typically shut down the vehicle's engine first. In sequence 605, the interrogator device 601 monitors for such engine's power down by monitoring the vehicle power port for the electrical noise representing the operation of the engine. When the electrical noise disappears, the interrogator device 601 receives the first indication that the operator is about to exit the vehicle.
The interrogator device 601, if powered by a vehicle power port that supplies power whether the engine is on or off, or if it if has a battery to supplement the power that comes from a port that shuts off when the car turns off, can determine if the engine is shutting down based on either the disappearance of certain electrical signatures representing the engine's firing sequence or the appearance of other electrical signatures indicative of the engine being off. Upon recognizing that the engine has shut down, the interrogator can wait for a short time period and then produce a sound or phrase reminding the user to take the tracked phone or other tracked objects when they leave the vehicle. Such a system would prevent the common scenario whereby a user uses their cell phone while driving and then forgets to take it with them when they leave the vehicle.
Another embodiment of such an exiting notification system would not issue an audio notification each time the engine was shut off but only provide such an audio reminder if it appeared probable that the user was leaving the vehicle without their phone or other tracked object. In such an embodiment, once the engine's changed state is detected, the interrogator device 601 listens for additional data that would indicate that phone was being moved, and thus most likely be taken from the car upon exit.
Upon engine-shutoff, the interrogator device 601 can transmit a message to the phone or tracked object 650 requesting it to relay sensor readings from its own on-board motion sensors. To illustrate this operation, at step 613, the interrogator device 601 transmits a message 653 to the tracked object 650. In this scenario, the interrogator device 601 transmits the message 653 to a mobile device requesting the mobile device to initiate transmission of its on-board accelerometer readings. The tracked object 650 remains at step 655 waiting for such a signal 653 from the interrogator device 601. Once the signal is received at step 660, it initiates the recording of its on-board accelerometer readings at step 665. The tracked object 650 processes the reading locally and transmits the processed readings 623 or it can send raw sensor readings 623 directly to the interrogator device 601 at step 670. If the interrogator device 601 receives a message from the tracked object 650 indicating it has sensed active physical movement, characteristic of the movement of the tracked object itself and not of general car motion, from the tracked object's accelerometer sensor, it would output a signal to disable any forthcoming alarms related to the lack of removal of the tracked object at step 620. In addition, a disable message 628 can be sent to the tracked object 650 which would disable any forthcoming alarm from the tracked object 650 concerning a lack of its own removal from the vehicle if it has such alarm capabilities. If message 628 was received, the tracked object disables the notification from being made. If no such message is received within a short time period of the engine being shut off, then an alarm would sound to remind the user to take their phone or other tracked object.
An alternative method for discerning motion of the phone or other tracked objects, particularly those without accelerometers, would require the interrogator to monitor the Bluetooth signal strength coming from the tracked devices. If such signal strength started to change after engine shut off the interrogator can assume that the tracked object is being moved, and can therefore ensure that no alarm is issued by either the interrogator itself or the tracked object. If no such change in signal strength is discerned within a short time period of the engine being shut off, then an alarm would sound to remind the user to take their phone or other tracked object.
Merely monitoring for movements of tracked objects after the engine is shut off can lead to false alarms if the user is merely sitting in the car, perhaps waiting for someone to arrive. Thus, an improved embodiment includes a sensor to inform the interrogator that the user was actually leaving the vehicle. In one embodiment, the interrogator uses accelerometer sensors, either in the interrogator itself or in the tracked object, to monitor for specific physical movement signatures that are characteristic of the driver exiting the vehicle. Such an exit, preceded by opening the car door, will typically cause the vehicle to rock or move and such characteristic motions can be discerned by the accelerometers. Other sensors that can indicate that a user was leaving a vehicle include a sensor that determined if a door had opened, a pressure sensor under a seat indicating that a user had gotten out of a seat, or a capacitive sensor that indicated that a person had moved away from such sensor. Once such an exit-sensing sensor had established that a user was likely to be leaving the vehicle, the interrogator can then determine if any tracked-object-motion had occurred. If no such motion had been detected then the interrogator or tracked object itself would issue an alarm.
Such an interrogation and exiting-detection system embodiment can advantageously be implemented by the original car manufacturer with the particular advantage that sensors to determine that doors are opening or a person is getting up from a seat are already installed in many cars, as are Bluetooth systems. In addition, power to a built-in interrogator device can be supplied without requiring a stand-alone battery. Thus, an OEM-supplied interrogator, using built-in Bluetooth functionality, can use the techniques described above to determine that the car's engine had been shut off, or gather such information directly from the vehicle's data bus. At such time, the interrogator can communicate with software installed on a cell phone requesting accelerometer data or such accelerometer data can be supplied in a continuous manner. Alternatively, or in addition to monitoring the accelerometer data, the interrogator can begin to monitor the Bluetooth signal coming from the phone or tracked object. In either case, the interrogator would be looking for signal changes indicating that the phone had been moved in the time since the engine had been turned off.
Additionally, the interrogator can use data from car-door-open sensors or seat sensors to determine the time at which a user was beginning to exit the vehicle. If the car door sensor indicated a user-exit but no motion by the phone had been detected in the time period between the engine being shut off and the door opening, the interrogator would produce an alarm.
In both the OEM embodiment and the non-OEM embodiment, the alarm can continue to be active until the interrogator received accelerometer data that indicated phone movement, or until a change in the Bluetooth signal indicated that the phone had been moved. Alternatively, the alarm can merely time out.
In the scenario where the user does not hear the alarm and does not go back to retrieve the phone, the phone or other tracked device can use its communications function to send an email or text message to the user informing such user that the phone is still in the car. The user is likely to see such email on a PC or other device that receives email or text message.
In the scenario where the link 603 is severed, for example when the tracked object is removed from an office, the tracked object 650 and the interrogator device 601 do not enable its notification sequence. This prevents the inadvertent false alarm of when the tracked object 650 is removed from the office. In such a scenario, the interrogator device 601 broadcasts messages to try to establish link 603 with the tracked object 650.
In another embodiment of the invention, signal strength of the network connection 603 between the interrogator device and the tracked object 650 can be used as a cue to indicate whether the tracked object has been moved as the user is exiting the vehicle. In such embodiments, the communication controller outputs the wireless signal strength and the controller uses the information to evaluate whether to provide a notification. The signal strength information can be used in unison with the on-board accelerometer readings from either tracked objects 601 and 650 based on the availability of such sensors to improve the likelihood of false notification.
H. OEM Interrogation Technology Built into a Vehicle
A further implementation of this technology for a FOB-based interrogator device includes OEM provided signals that correspond to the fob device, to interrogate for the presence of items. The vehicle itself is OEM-provided with the technology to interrogate for the presence of personal items. From below: Note, that some cars have built-in Bluetooth technology to power hands-free capabilities and some cars can have hands-free units with persistent Bluetooth signals or signals that are activated upon the car being turned on.
I. Interrogator as In-Vehicle Phone Controller
In addition to interrogating for the presence of tracked objects, the interrogator device can also perform various functions described herein relating to the object that is being interrogated or tracked by the interrogating device.
The location of an item determines whether the item is within detectable range of the interrogation device (for example in a vehicle), and the same technology used to determine presence is also used to monitor and restrict the use of a particular object that is found proximate the interrogator device. For example, an interrogator device can interrogate for the presence of a cell phone, and can restrict the use of the cell phone so that a user cannot be distracted by the use of the phone while they are driving a vehicle. Alternatively, instead of precluding such restricted activities, the interrogator device can be programmed to produce a warning sound if such features are being used inappropriately.
a. Precluded Features
If a Bluetooth link is established between the interrogator device and the selected object, for example to a teenager's phone, a phone-resident software program (the PSP) can be activated that disables specific “precluded” features on the phone. Such precluded features can be configured beforehand and selected from a list that can include any of the following, as well as other conventional functionality of the cell phone:

    
    
        No text messages received or sent
        No text messages sent but the receipt and display of messages is allowed
        No phone calls to made or received
        No Internet access
        No phone activity at all
    
    


Some CIMS (car-in-motion sensors), such as accelerometers or other appropriate sensors, can detect that a car is in use and also discern whether the car is standing still or moving. For instance, the accelerometer can sense the vibration of an idling engine versus the motion of a moving vehicle. Alternatively, the CIMS that monitored engine noise as received through the vehicle power port can distinguish noise from an idling engine versus noise from an engine driving at a certain speed. The voltage-change approach to interrogation where changes in the voltage level are used to instigate interrogations, however, can not be able to detect that the car was just idling or standing still, however, and by this token can be the most stringent technology to use as phone usage can be restricted whether the car is in motion or not. In addition to using data from a CIMS, the fact that a car was stationary can be determined by monitoring the GPS or other location data generated by the cell phone itself. With knowledge, therefore, about whether the vehicle is moving or not, the rules for precluding features can be modified such that any given feature can be re-activated if the car was standing still or traveling at a low enough speed to allow the features to be used. Because the interrogator device is installed in the car per se, it controls behavior related to the teenager's cell phone when in that car only. Thus, it does not effect behavior on public transportation or when riding as a passenger in another car.
b. In-Vehicle Phone Controller Procedure
Reference is now made to FIG. 7, showing a flow diagram for a context aware technology procedure 700 according to an illustrative embodiment. The procedure 700 begins at step 710 where an interrogator device is provided proximate a vehicle (or other mobile unit in which a person and selected objects are monitored). At step 712 the device monitors for the vehicle to commence motion. The vehicle continues to check if the vehicle is about to commence motion at decision step 714, and if it is not, continues to monitor at step 712. If the vehicle is detected that it is about to commence motion, the procedure advances to step 716 and a connection with the tracked object, such as a cell phone, is established.
The procedure then restricts the use of the tracked object when the vehicle is in motion at step 718. Then at decision step 720 the interrogator device determines if the vehicle is still in motion. If it is still in motion, the use of the tracked object continues to be restricted. If the vehicle is no longer in motion, the procedure advances to step 722 and the normal use of the tracked object is restored. Once the use of the tracked object is restricted, there are a plurality of precluded features for the tracked object, such as a cell phone according to an illustrative embodiment. The use can also be restricted to change the routing of calls, text messages, and emails while the phone is in use. This is described in greater detail hereinbelow with reference to the PIP (Phone in Place) embodiment. This allows a particular person to manage their cell phone by having calls directed through a particular place, such as their car system, using existing Bluetooth technology in the vehicle, or by monitoring the particular calls, messages, or other alerts that the driver receives.
c. Discouraging Avoidance Behavior—
Naturally, teenagers will try to disable the interrogator device. The most obvious way to do this is to try to unplug the device from its power source, (i.e. the cigarette lighter).
To address this issue, the device can include the addition of a conventional mechanical switch that can discern when the device is being pulled from the cigarette lighter receptacle. Ideally, such a switch can register this action, and record the removal event. (Thus, the device would include a battery or equivalent capacitor so that this data can be record even after losing power from the car power port.) Additionally, the act of plugging the device back in, and activating the switch at that time, can be registered and recorded. Such recorded removal information, including the time, date, and duration of such disconnection, can thus be recorded in a non-volatile memory. Such instances of removal are distinguished from merely being deprived of power when the car engine is shut off (as many cars will turn off power to their cigarette lighter when the ignition is off) by virtue of the switch being activated. Additionally, the PSP would prevent the user from disabling the Bluetooth feature on the phone as such disablement would allow the user to perform precluded actions. If such disablement was not possible, then the fact that Bluetooth was turned off would be recorded and reported.
GPS information from the tracked phone concerning location and travel speeds in the period before disconnect can also be recorded and stored by the PSP. Also captured can be data as to whether the teenager cell phone had established a Bluetooth connection to the device when the device was disconnected.
Once the interrogator device was operative again after being plugged back in it may have lost track of the actual date and time, if such information is not being generated via a battery-operated time circuit. Therefore the newly operative device tracks the elapsed time during which it is newly operating. Later, synching with a mated cell phone provides updated date and time information that can then be combined with the aforementioned elapsed time information to reconstruct the running log with absolute date and time information.
In a related manner, the PSP on the teenager's phone can maintain a continuous log of metadata concerning the performance of all possibly precluded activities. That is, a perpetual diary can be kept of activities such as texting and making and receiving phone calls. Differing levels of metadata detail can be maintained ranging from just the time and date of text messages and phone calls to the actual names of parties who are texted or called. GPS data, including speed of travel, can also be associated with any precluded activities. Potentially, the device software can access and store the content of text messages, as well.
Whenever the teenager's phone was synched to the interrogator device, data can be exchanged between the device and the PSP indicating any interruptions in operation. This data can be matched by the PSP to the use of precluded features. If there had been precluded activities on the cell phone during the time period that the interrogator device was unplugged, the PSP can note such a “coincidence”, including the time and date and which precluded features had been accessed. Such coincidence information can be stored on either or both devices.
Coincidence information, if recorded by the PSP, can be sent via an email through the cell phone to the email account of a parent of the teenager or other monitoring party such as an employer. If the cell phone or PSP did not have that ability, parents can collect such information locally on their cell phones if such phones are also able to communicate with the interrogator device. Such communication can require the phone to be relatively close to the device when it was plugged in and supplied with power, however. Such local communication can be quite natural, however, if the car was being shared by teenager and one or more parents.
Note that because parents' phones can be able to communicate with the interrogator device at the same time as the teenager's phone, the teenager's PSP can be notified if a parent is in the car with the teenager. Under those situations, no features can be precluded by the PSP.
The interrogator device can also be used to collect data as to which other passengers might be in the vehicle with the teenager by listening for other persistent Bluetooth signals, such persistent presumably coming from another passenger if the vehicle moved any distance.
Metadata about such signals can be collected and recorded in the log. If carrying passengers are a precluded activity, such activities can be reported to the parent in either of the two methods described above. Passengers can always turn off their Bluetooth in such a situation, of course, but it is possible for the interrogator device to still be able to record that it was turned off while the car was in motion.
In some cases users may wish to modify their own behavior of texting while driving or otherwise using their mobile phone in an inappropriate manner. For this type of user, the interrogator device can construct a careful log of such usage and email it to the user or a concerned party, be it a spouse or employer.
Additionally, the PSP software, perhaps in combination with server software, can automatically donate a fixed amount of money to a charity, or to a spouse, upon the performance of any precluded action as determined by the PSP.
Maintaining a Log of Inoperative Time Periods
Naturally, teenagers will try to disable the interrogator device. The most obvious way to do this is to try to unplug the device from its power source, (i.e. the cigarette lighter).
To address this issue, the device can include the addition of a conventional mechanical switch that can discern when the device is being pulled from the cigarette lighter receptacle. Ideally, such a switch can register this action, and record the event. (Thus, the device would include a battery or equivalent capacitor.) Additionally, the act of plugging the device back in, and activating the switch at that time, can be registered and recorded. Such recorded removal information, including the time, date, and duration of such disconnection, can thus be recorded in a non-volatile memory. Such instances of removal are distinguished from merely being deprived of power when the car engine is shut off (as many cars will turn off power to their cigarette lighter when the ignition is off) by virtue of the switch being activated. Additionally, the PSP would prevent the user from disabling the Bluetooth feature on the phone as such disablement would allow the user to perform precluded actions. If such disablement was not possible, then the fact that Bluetooth was turned off would be recorded and reported.
GPS information from the tracked phone concerning location and travel speeds can also be communicated from the phone to the interrogator device and recorded in a log allowing information to be obtained and recorded in non-volatile memory concerning the location and speed of the vehicle in the period before disconnect. Also captured can be data as to whether the teenager cell phone had established a Bluetooth connection to the device when the device was disconnected.
Once the interrogator device was operative again after being plugged back in it may have lost track of the actual date and time, if such information is not being generated via a battery-operated time circuit. Therefore the newly operative device tracks the elapsed time during which it is newly operating. Later, synching with a mated cell phone provides updated date and time information that can then be combined with the aforementioned elapsed time information to reconstruct the running log with absolute date and time information.
Maintaining a Log of Precluded Events
In a related manner, the PSP on the teenager's phone can maintain a continuous log of metadata concerning the performance of all possibly precluded activities. That is, a perpetual diary can be kept of activities such as texting and making and receiving phone calls. Differing levels of metadata detail can be maintained ranging from just the time and date of text messages and phone calls to the actual names of parties who are texted or called. GPS data, including speed of travel, can also be associated with any precluded activities. Potentially, the device software can access and store the content of text messages, as well.
Matching Inoperative Time Periods with Precluded Events
Whenever the teenager's phone was synched to the interrogator device, data can be exchanged between the device and the PSP indicating any interruptions in operation. This data can be matched by the PSP to the use of precluded features. If there had been precluded activities on the cell phone during the time period that the interrogator device was unplugged, the PSP can note such a “coincidence”, including the time and date and which precluded features had been accessed. Such coincidence information can be stored on either or both devices.
Coincidence information, if resident in the PSP can be sent via an email through the cell phone to the email account of a parent of the teenager or other monitoring party such as an employer. If the cell phone or PSP did not have that ability, parents can collect such information locally on their cell phones if such phones are also able to communicate with the interrogator device. Such communication can require the phone to be relatively close to the device when it was plugged in and supplied with power, however. Such local communication can be quite natural, however, if the car was being shared by teenager and one or more parents.
Note that because parents' phones can be able to communicate with the interrogator device at the same time as the teenager's phone, the teenager's PSP can be notified if a parent is in the car with the teenager. Under those situations, no features can be precluded by the PSP.
Tracking Passenger Information
The interrogator device can also be used to collect data as to which other passengers might be in the vehicle with the teenager by listening for other persistent Bluetooth signals, such persistent presumably coming from another passenger if the vehicle moved any distance.
Metadata about such signals can be collected and recorded in the log. If carrying passengers are a precluded activity, such activities can be reported to the parent in either of the two methods described above. Passengers can always turn off their Bluetooth in such a situation, of course, but it is possible for the interrogator device to still be able to record that it was turned off while the car was in motion.
Voluntary Functionality Control
In some cases users may wish to modify their own behavior of texting while driving or otherwise using their mobile phone in an inappropriate manner. For this type of user, the interrogator device can construct a careful log of such usage and email it to the user or a concerned party, be it a spouse or employer.
Additionally, the PSP software, perhaps in combination with server software, can automatically donate a fixed amount of money to a charity, or to a spouse, upon the performance of any precluded action as determined by the PSP.
II. Building Embodiment
FIG. 8 shows a particular implementation of the generic system architecture shown in the block diagram of FIG. 1 according to a building and wherein the interrogator device is a pluggable wall socket adapter. As shown in FIG. 8, the wall adapter 800 is inserted into the wall socket 805 located within the interior of the building structure. It should be understood that the interrogator device can function in any building, enclosed or open, so long as it is plugged into a power receptacle that is powered. In its inserted state, the power lead 820 is in contact with the building power connection 825 and the neutral lead 830 is in contact with the building's neutral lead 835. Appliances 840 can be directly or indirectly coupled via link 836 to the wall socket receptacle.
Wall adapter 800 interrogates for the presence of personal items 850 and 860 via datastreams 870 and 880, respectively. Wall adapter 800 monitors for cues from activities of appliances 840 within the building as conditions to determine whether a person is in the building and thus the tracked objects are present and to thereafter establish whether a notification is generated. The items can also be linked via 875 to provide a communication channel therebetween.
FIGS. 9 and 10, respectively, show front and rear views of the wall adapter interrogator device 800 of FIG. 8. The interrogator device 800 includes a speaker output 930 to provide an audible alarm if and when so desired. The neutral lead 830 is in contact with the building's neutral line and the power lead 820 is in contact with the building's power line. A button 920 is provided that sets the interrogator device 900 into a programming mode to listen for another tracked object that is to be added to the monitoring queue. Another button 925 is provided that can set the interrogator device 900 into a programming mode to listen for tracked objects that are to be removed from the monitoring queue. Display indicator 915 provides indication to the user that interrogator device 900 is on, and indication that interrogator device 900 is in a programming mode and seeking to add or remove a tracked object to the monitoring queue.
FIG. 11 depicts a schematic diagram illustrating an exemplary system architecture of the interrogator device for usage in a building. The system 1100 has two primary controllers that interface with each other: a system controller 1135 and Bluetooth controller 1115. The system controller 1135 runs the primary software and the high-level function controls of the interrogator device. It takes in all the inputs from the sensors and determines whether a notification should be generated. The Bluetooth 1115 manages the networking functions and generates the waveform to create the alarm sound from speaker 1105. Digital signal processor 1130 analyzes inputs from current sensor 565 and provides feedback to controller 1135 as to whether the activity of interest is detected. The power management circuitry 1190 draws power from the wall socket receptacle and provides power for all the circuitries in interrogator device 1100. At the wall socket interface, the power lead 1172 and neutral lead 1171 are connected to the appliance 1180. When the appliance 1180 operates, its motor 1181 generates electrical noise within the building power line 1177. A current detection circuit 1155 picks up the noise through pickup coils 1170, which are wrapped adjacent to the building power line near the power lead 1171.
Bluetooth controller 1115 can be the Broadcom® BCM4325, a single chip IEEE 802.11a/b/g MAC/Baseband/Radio with integrated Bluetooth® 2.0+EDR and FM receiver and manages all the networking function of the interrogator device. Bluetooth controller 1115 can also include a built in baseband, media access control (MAC) address, and PHY.
In building electrical wiring systems, appliances are typically added in parallel with the AC source 1176 from the building's transformer. Within the building, the wirings are divided into subdivisions at the fuse box for a room or combination of rooms. Within each subdivision, power line 1178 runs to the power lead 1172 in the wall receptacle of each room. The neutral lead 1171 in the wall receptacle returns the electrical connection through power line 1177. When an appliance 1180 is plugged into the wall receptacle, it completes the circuit and current flows 1175 through the power line. In a large appliance, there is a motor 1181 inside, and the circuit is not closed until a normally open switch inside the appliance is closed.
Bluetooth controller 1115 interfaces to controller 1135 through a four-wire serial-digital input and output (SDIO) interface using its internal universal asynchronous receiver and transmitter (UART). Bluetooth controller 1115 connects with RF antennae 1125 through a balun 1120, which provides adjustment to line impedance to reduce interferences from line mismatch. Balun 1120 adjusts the balances and unbalances input with respect to the interrogator device ground. Between the balun 1120 and the RF antennae 1125, radio frequency (RF) filter 1120 extracts the narrow band frequency component of the input signal ranging between 2.35 GHz and 2.52 GHz. Digital clock 1117 provides a digital reference signal for Bluetooth chipset 1115, and has a reference clock between 12-52 MHz. Although Bluetooth chipset 1115 uses its internal random access memory (RAM) and runs the instruction set stored within its read-only memory (ROM), external flash memory 1118 provides a means to update such firmware and instruction sets.
Bluetooth chipset 1115 receives power from the direct current-to-direct current (DC/DC) converter 1196. DC/DC converter 1196 provides a voltage output between 2.5V to 5.5V to Bluetooth chipset 1115. An internal switching regulator within Bluetooth Chipset 515 generates the internal voltages necessary to operate Bluetooth chipset 1115's internal circuitries.
User interfaces 1140 are digital inputs and outputs that interface to the lighting indicators on the interrogator device's casing, or the buttons used for the interrogator device programming and connect directly with the controller 1135. Upon pressing the button, a de-bounced circuit latches the input with a dead time of 50 milliseconds, thus preventing multiple inputs from being generated and sent into controller 1135.
Bluetooth chipset 1115 generates the signal to the speaker, which provides the alarm to the user. The signal to enable the oscillator to generate the alarm is triggered from the controller 1135. The internal oscillator of Bluetooth chipset 1115 outputs signals to pulse width modulation (PWM) circuit 1110 with a frequency between 10K Hz and 50 KHz. The PWM circuit 1110 is supplied by a 12V power connection from DC/DC converter 1196 and outputs the PWM waveform to the speaker 1105, which converts the electrical signal to an audible sound with a frequency of between 20 Hz and 5 KHz. The speaker can be varied by the operation to output between 50 decibels to 70 decibels.
When power circuit is closed, appliance 1180 is running motor 1181. From its operation, the motor generates perturbation within the current flow 1175. The winded pickup coil 1170 is wound near the neutral return lead 1171 of the power line and is thus inductively coupled to it. An alternating voltage source creates an alternating current flow through pickup coil 1170. The alternating current in the pickup coil 1170 is affected due to its inductive coupling with appliance motor 1180. The pickup coil 1170 thus observes the perturbation in current 1175 in the building's power line.
Alternating voltage is applied to the pick-up coil through an oscillation circuit 1155. An oscillation circuit consists of an oscillator 1160, which generates a fixed frequency between 1 kHz and 1 MHz at 50 mV peaks. The oscillator 1160 feeds its output into amplifier 1161, which amplifies the waveform by signal by a magnitude of 100. The amplifier 1161 feeds its output into a unity gain buffer 1162 that provides isolation from a return flow from the pickup coil 1170.
A differential output is run into a buffer circuit with one lead from positive lead 1165 connected at the beginning of pickup coil 1170 and the other lead from negative lead 1166 connected to the end of pickup coil 1170. The differential signal contains the perturbed current from the building current 1175, but does not have the alternating current signal along with it.
Analog-to-digital (A/D) convertor 1145 is fed to the output from buffer 1150. A/D converter 1145 is a single channel serial AD converter with an input range of 0V to 5V at 12-bit resolution sampling at 1 KHz. The AD converter 1145 outputs the serial digital stream representing the perturbed current to the digital signal processor 1130.
The digital signal processor 1130 processes the differential current readings and compares the current signature it has stored with the current signature it is observing. If a sufficient match is found, digital signal processor 1130 concludes that the appliance 1180 is operating and signals controller 1135 of its determination.
Interrogator device 1100 can be plugged into a wall socket receptacle and offers a female connector into which the appliance 1180 can plug; however, the invention still operates even if the appliance was plugged into a separate wall socket receptacle. When the appliance 1180 operates, the current signature of the appliance 1180 is still observable by pick-up coil 1170 due to its inductive coupling to the wires in the wall socket receptacle. The inductive coupling makes it act as a radio receiver with the building power line connected to it acting as a radio antenna. Thus, even though current might not necessarily flow in power line 1178, the power line is still coupled to the other power line where the appliance 1180 is operating. This coupling generates the current signature on the power line 1178 which can be detected by the pickup coil 1170.
An example of the application is illustrated in a coffee shop embodiment. If the last thing the user does each night before leaving is to shut down the coffee maker, the user can program the electrical flow to the coffeemaker as a signal that is monitored by the interrogator device. Thus, the interrogator, instigated by a signal that such electrical flow had ceased would generate a notification if it does not receive a message from the mobile phone within a certain time period stating it is in motion after the coffeemaker is turned off.
Hotel Wall Chargers
Another function that an intelligent wall charger could perform would be to insure that it is not left behind in a hotel room. This apparently is a major problem. The solution to this problem would to have a simple app on the phone that could take note of when the expected checkout date and time was. (Time could be optional.)
When checkout day and time came, the Bluetooth connection between phone and the charger becomes a tether, tying the two together. If the connection is lost, the phone (presumably with the user) would signal an alarm or alert.
If the wall charger is pulled out of the wall, the BT connection is also lost, however, there will be no gradual diminishment of the signal as there would be if the user walked away with their phone leaving the wall charger behind. Therefore, an instant termination of the Bluetooth signal would indicate that the unit has been unplugged and is now being packed away. The app could assume that the wall charger was safely packed away at that point and could cease looking for its Bluetooth signal.
Alternatively, the wall charger could have a small battery or capacitor allowing it to send out a brief signal signifying that it had been unplugged and that all was well.
Such a battery could also be used to ensure that the Bluetooth connection remained intact for some period of time. This delayed tether would prevent the wall charger from being unplugged but left on a table, for instant. But such a delayed tether would prevent the user from leaving the room without the unit (to go to breakfast, for instance). Therefore an on-off switch on the charger would be desirable to allow the tether to be broken as needed.
III. PC Embodiment
FIG. 12 shows an illustrative embodiment of the general system diagram of FIG. 1 in an office implementation 1200 where the interrogator device is a personal computer operating within the office. The personal computer 1205 serves as the interrogator device by undergoing a set of computer instructions 1220. The computer 1205 operates together with a mobile device 1210 via an established link 1235. Instruction set 1220 consists of two instruction sets, one set of computer instructions 1225, which resides on the personal computer (PC) or a laptop 1205 and the other set of computer instructions 1230 on a mobile phone 1210.
FIG. 13 shows a flowchart of a procedure of an office-based object tracking system according to a system such as that shown in FIG. 12. When arriving at the office, the interrogator device detects a mobile phone indicating that the user has arrived, and if tracked objects are not present, instruction set 1301 generates a notification through the interrogator device 1300 indicating tracked objects 1350 are not present within the office. Interrogator device 1300 can be a computer, a laptop, or any computing platform with networking capabilities to establish communications with tracked objects. In leaving the office, instruction set 1351 generates a notification through mobile device 1350 to alert the user that tracked object 1350 was left behind. Mobile device 1350 can be a cellular phone or other object with the appropriate communications ability. Instruction set 1351 only generates the notification once interrogator device 1300 shuts down and mobile device 1350 does not detect any movement from its on board accelerometer or gyroscopic readings.
Instruction set 1301 is a typical executable application that is initiated by the interrogator device 1300 operating system. Upon execution at step 1305, instruction set 1301 records the time of execution and stores the time in the interrogator device's 1300 persistent memory. Then at step 1310, instruction set 1301 searches the system hardware list for existing communication ports and enables the Bluetooth communication port if one is found. Then at step 1315, instruction set 1301 configures the Bluetooth port with a specific port number. Then at step 1320, instruction set 1301 enables the Bluetooth port to broadcast its Bluetooth ID along with a request to link message. It does so continuously every 10 seconds for 120 seconds or until it is told to stop by the user.
Corresponding instruction set 1351 operates on mobile device 1350 as a standard executable application that executes within mobile device 1350 operating system. Upon execution at step 1355, instruction set 1351 searches the system hardware list for existing communication ports and enables the Bluetooth communication port if one is found. Then at step 1360, instruction set 1355 configures the Bluetooth port with a specific port number. Then at step 1365, the instruction set 1301 enables the Bluetooth port to listen for a unique broadcasted message from interrogator device 1300. Then at step 1370, if interrogator device 1300 is found, a network link is established between the computer 1300 and the cellular phone 1350. Then at step 1375, mobile device 1350 stores the network identifier of interrogator device 1300 locally within its non-persistent memory. Then at step 1380, interrogator device 1300 and mobile device 1350 maintain a communication link 1330 between each other through intermittent broadcasted messages. Upon shut down at step 1325, instruction set 1301 sends a message to mobile device 1350 indicating it is shutting down. Instruction set 1351 receives message 1335 at procedure step 1383 providing the cue that the person is about to leave the office. As an alternative, instruction set 1350 resides on the mobile device within non-volatile memory as well as volatile memory.
Instruction set 1351 generates a notification at step 1385 if two scenarios occur, the first being if it does not detect movement from mobile device 1350 on-board accelerometer sensors after receiving broadcast message 1335 from interrogator device 1300 indicating it is shutting down. The second scenario is if instruction set 1351 does not receive a broadcast message from mobile device 1350 for a period of time. In either instance, instruction set 1351 generates a notification to the user through mobile device 1350 in the form of an audible alarm. Notification can also be sent as an email message to a user specified email account.
The intermittency period of broadcast messages 1330 typically occurs every 10 seconds, but is configurable by the user within the programming menu on interrogator device 1300. Message 1330 not only provide an indication of the presence of mobile device 1350, but also provides its relative distance from interrogator device 1300 based on the signal strength and direction.
Several use-cases exist: (1) the person starts up interrogator device 1300 and mobile device 1350 is present, (2) the person starts up interrogator device 1300 and mobile device is not present, (3) the person reboots interrogator device 1300, (4) the person walks out of the room with mobile device 1350, (5) the person walks out of his room without mobile device 1350, (6) the person shuts down interrogator device 1300 and walks away without mobile device 1350, and (7) the person shuts down interrogator device 1300 and walks away without mobile device 1350. Table 1 shows the decision for the instruction set 1351 to generate a notification under such use-cases.









TABLE 1







1
Person starts up his computer with his phone
No notification


2
Person starts up his computer without his phone
Notification




generated


3
Person reboots his computer
No notification


4
Person walks out the room with his phone
No notification


5
Person walks out the room without his phone
No notification


6
Person shuts down computer and walks out of the
No notification



room with his phone


7
Person shuts down computer and walks out of the
Notification



room without his phone
generated









According to this particular embodiment, there are only two scenarios when a notification would be generated. The first, when the person starts up his computer or begins to use it as determined from software that monitors for keyboard and/or mouse, tablet, or touch screen usage, and the phone is not present (2 in Table 1 above). The second, when the person shuts down the computer and the phone has not reported any movement characteristic of being picked up and taken with the user (7 in Table 1 above).
Similarly, when the person walks out of the room with the cell phone, or even without the cell phone, the invention does not take any action, as the triggering event is based upon the power on status of the computer system, not the person leaving the room.
A button exists on the user interface of instruction set 1301. When pressed, it puts instruction set 1301 into a programming mode to listen for tracked objects that are to be added to the monitoring queue. Correspondingly, a button exists on the user interface that puts instruction set 1301 into a programming mode to remove tracked objects from the monitoring queue.
In another embodiment of the invention for use in an office, the instruction set generates the alert in the form of an audible sound as well as some kind of visual alert based on the user settings. The visual alert would be displayed when the computer is turned on. The objective of the notification is to notify the user that an object that is supposed to be present within the area and the given circumstances, is not, and thus alert him to retrace his steps to discover where the tracked object was left. For example, if the user had left his cell phone in another room, upon returning to his computer, there would be a notification on the computer screen telling him that his phone was not present. In addition to simply alerting the user of the presence or absence of his cell phone, the notification can also display important metadata from the phone, including but not limited to: remaining battery life, presence of an unread text message, or a new voicemail, which can be transmitted in the notification from the cell phone to the computer.
IV. Portable Embodiments
A. Cell Phones and Dongles as Interrogator Devices
There are products that use wireless technology to help user keep cell phones in close proximity with dongle-equipped devices. These systems create a “virtual leash” between the cell phone and the tethered device, typically a dongle attached to a keychain. Note that there can be two or more interrogator devices in such systems. A “dongle” is a small piece of hardware that is connected to an object for communication with the interrogator device. That is, the phone can check for the presence of the dongle and the dongle can check for the presence of the phone. Accordingly, the dongle, as well as both the phone and the dongle, can sound an alarm when the pair is separated. Such alarms can be generated when the separation is as little as 30 feet when Bluetooth is used as the communications means.
It is desirable to provide technology to intelligently perform the interrogations without creating false alarms (eg., warnings that the paired devices have separated or can no longer communicate when the user doesn't care or need to know of such occurrences.) For instance, users who tether their phone to their keychain may inconvenience co-workers at an office if they keep their phone on their person but leave their keys in a coat pocket that stays in their cubicle when they go to meetings. The key chain dongle will sound an alarm each time the user leaves the vicinity. The solution to this problem of false alarms is an “intelligent tether”.
A flow chart is shown in FIG. 14, detailing a procedure 1400 for performing intelligent tethering. The interrogator device technology described herein can be applied to make a cell phone into a component of such an effective intelligent tether at step 1410. A cell phone typically already has Bluetooth capability and components that generate alerts. It is advantageous to provide signals to the phone at step 1412, suggesting the appropriate parameters during which to initiate interrogations for paired objects the user wishes to keep close by. For example, appropriate date, time or location parameters for initiating interrogation. Unfortunately, such a phone-based interrogator device cannot practically check for the presence of itself but it can assure the user that wallets, PCs, eyeglass cases or purses are nearby. On the other hand, a dongle that performed as a portable interrogator device can also serve as one end of an intelligent virtual tether system that can keep two or more tracked objects (including the dongle) together as a set.
The signals for such intelligent interrogations that would minimize false alarms can come from a number of sensors that can communicate with the phone or portable dongle. GPS data from the phone or the dongle, for instance, can inform the interrogator devices in the system that the user was leaving a house or office, a point in time when it can be natural to collect all of one's important objects. At step 1414 interrogator devices can check for the presence of each other and other tracked devices. Another signal can come from a Bluetooth device in the vicinity. For instance, a wall socket-based interrogator can emit a steady Bluetooth signal just for the purpose of notifying one or more of the interrogator devices that it was now located in a certain room in a building. Or one or more of the interrogator devices can be paired with a naturally occurring Bluetooth signal originating from such a location or alternatively, a unique combination of Wifi signals that only occurred in a specific location can be used as the instigating signal when such signal was sensed by one or more interrogator devices in the system.
Or a phone can sense that it was recharging and at that point reach out and look for paired objects via an interrogation, as such charging locations can represent logical places from which to perform interrogations. Thereafter, notifications can be generated at procedure step 1416, according to techniques described herein, if objects are not detected.
B. Interrogator Device Integrated as a Key Fob
The interrogator device can be implemented and integrated into the car fob, the small accessory offered by car manufacturers that can perform may functions such as lock and unlock car doors, start the engine, etc. In this embodiment, when the user presses the fob button to open the door lock, the interrogator device's Bluetooth circuit can be activated and look for the phone and other devices. Such a system is passive as the user doesn't have to remember to do anything in addition to the normal behavior of opening the car door. But it has the drawback of not being useful if the car is not locked (and thus not in need of the lock being opened with the FOB).
To rectify that last issue, an alternative key-based implementation can have a fob connected to a key in such a way that can detect that the key was being used. Such a system can use a capacitive sensor that can read the unique capacitive load when the key is in the keyhole. Another retrofit approach can be to use a sheath. When the key was unsheathed, it can trigger the interrogation.
If the car has its own Bluetooth circuit that is activated when the car is started, the fob can be paired to that, as well as the phone. If the fob senses it was close to or in the car, by virtue of detecting the car's Bluetooth signal, it can interrogate for the presence of the phone.
Another implementation of the technology for a fob-based interrogation device can include the addition an accelerometer to the FOB. The microprocessor in the interrogation device's circuit can read data from the accelerometer and can detect the data signature created when the car is in motion. Such signature would include the rhythmic motion of the fob as it dangles from the steering wheel when the car was moving. When such a signature was detected, the interrogative function can begin. The fob can be trained to understand what motions represented car motion by having the owner press a button during such a period of motion.
C. The Portable Interrogation Device
The Portable Interrogation Device (PID) is equivalent to a battery-powered, and thus portable, interrogator device that can be attached to a backpack, pocketbook, or computer bag or other similar object that might carry a user's tracked objects. Preferably it can be built in the form of a dongle that can be attached to the outside of such a bag. It can be able to use its Bluetooth circuit to look for other Bluetooth objects with which it had been paired with such object likely to be carried in the bag. Its alert mechanism can preferably be sound-based, although light, vibration and other alert mechanisms can be used, as well. The device can come with a strap allowing it to dangle on the outside of the bag thus allowing for clearer alerts. If mounted on the bottom of the bag, the vibrator can make an audible sound on a table or other hard surface.
The key to a useful PID is a sensing mechanism to inform the interrogator that the bag is moving and is in some sort of “trip” mode, where a trip would be movements larger than merely walking across a room or office with the PID or moving it off a table, for instance. One such means can be the inclusion of an accelerometer circuit. The accelerometer can detect when the PID was being moved and thereby instigate an interrogation for paired objects at that time. A software filter can be applied against the accelerometer data to ascertain whether the movements seemed to indicate a trip was beginning.
In one embodiment of the vehicle interrogator device, the user does not have to necessarily manually turn off the alarm if a device is missing. This is because the alarm can be programmed to turn off after a short period of time and not sound again until the next time the car was started. The PID, on the other hand, can usefully employ an alarm “Off” button. This is due to the fact that if a paired object is missing, and it is not possible or there was no need to get it, then the alarm can keep going off each time the bag was moved. A parameter can be set, however, that would turn off the alarm for a certain time period when the alarm-off button was pressed. Alternatively, instead of turning the alarm function back on after a certain period of time, the alarm function can be set (via an interface or by programming of the interrogator via another connected device) to turn back on again after the PID had been at rest for a certain period of time. Such ending of a “resting period” would indicate that a new “trip” had begun and a new interrogation should begin. Alternatively, GPS data collected by the PID can be used to ascertain whether the user is actually starting a new trip
Multiple sensing means can be used to instigate the interrogation.
Some users may not have an available cigarette lighter port through which to power a vehicle interrogator device. In this situation, the interrogation function can be handled by a PID, which can function as a vehicle interrogator device. Such PID can be mounted on the dashboard or other convenient location. It can use initial vehicle motion as sensed by an accelerometer as a trigger to start the interrogation.
One embodiment of such an accelerometer-based vehicle interrogator device can employ a software algorithm that can perform interrogations only after the vehicle had been at rest for a specified time period. Using such a time interval can it make it more likely that the initial motion sensed corresponded to the beginning of a new trip for which object presence-checking was required. This can reduce repeated interrogations alarms generated each time the vehicle started and stopped. Such mid-trip interrogations can have little user-value if they just continued to repeat the same alert status.
D. Intelligent Tethering
Under the Intelligent Tethering concept, the PID does not interrogate while known signals are present. These known signals can include a house Wi-Fi signal or Bluetooth signals in an office. Thus, a user whose phone was tethered to a PID need not keep the two devices together when in a home or office, where one or both of the two devices could detect familiar local signals. Once such a signal was recognized, either device could turn off the tethering.
When the user departs from the office or house, however, the PID (or the other device if it were a two-way tether) immediately knows of that departure by virtue of the known signals being lost. The PID or other elements of the tether thus monitors for the paired device(s).
The recognition of missing known signals is faster than if GPS signals are used to signify that a trip had started. Further, employing known signals is applicable in situations such as in a large building where GPS signals do not penetrate. This method also is applicable once the user moves a short distance, such as 30 feet, from a Bluetooth signal—resolution that not all GPS systems have. The battery drain on constantly checking GPS locations can be a major concern, as well.
E. Forms of Alerts
When a trip first starts, be it a vehicle trip or moving a backpack, the interrogator device, be it a PID or vehicle interrogator device, will perform an interrogation. It can then produce an alert if all tracked objects are not present and an affirmative tone if such objects are present (and such affirmative tones are desired).
Despite the undesirability of repeating alarms or affirmative tones, there can be utility in alerting a user to a change in the “present” state. Following the initial interrogation, then, the interrogator device will continue to monitor the Bluetooth signal or signals from present objects. If any of these signals goes away during the course of the trip an alert will sound—one possibly different from the “Not Present” alert. Such an alert can signify that the object had been present but is not now. The user can assume that the battery for the object has gone dead, although other reasons can account for the change in status such as the fact that the user had turned off the Bluetooth function.
F. Baby Car Seat Alarm
Unfortunately each year a number of babies die in automobiles because they were inadvertently left in cars. The technology described herein can be applied to address this problem using “Baby Seat Positive Separation” (BSPS) technology.
Reference is now made to FIG. 15 showing a flow chart of a procedure 1500 for implementing a BSPS system. To implement a BSPS system, baby seats are equipped with the BSPS technology at step 1510 and include a Bluetooth enabled sensor that detects the presence of a baby in the baby seat. For example, the manufacturer can build-in a circuit that could detect that the seatbelt was closed. Further, a sensor that detects weight in the seat or the capacitive load of a baby can also be used. Those methods are subject to false positives, however, if something else (like groceries) was placed in the seat or if the capacitive load could not be detected due to, for example, heavy clothing separating the baby from the sensor. Such false positives are reduced using a seat belt-based system. An exemplary sensor, whether it OEM-supplied or added to an existing baby seat, can be battery powered, solar-powered, or powered via a hard-wired connection to the car's power system, according to the various illustrative embodiments.
In addition to the sensor, the other major component of a BSPS system is a communication device, such as a phone, which is provided at step 1512 and paired to the Bluetooth enabled sensor in the car seat. An application on the phone manages the BSPS system in an illustrative embodiment. When the sensor senses the presence of a baby in the seat at step 1514, the Bluetooth signaling commences and the phone recognizes the signal and determine that the seat is occupied.
The separation monitoring technique is similar to that described hereinabove for a hotel wall charger. The procedure 1500 continues to monitor the sensor at step 1516 to determine if the baby is still in the car seat. If the seat sensor detects that the baby has been removed at step 1518, the Bluetooth signal is abruptly cut off and the phone application determines that the baby has been removed. This indicates that the baby is safe and there is no need to generate a notification. However, if the baby is not present, at step 1520 the seat Bluetooth signal fades out gradually, it indicates that the user has walked away from the car, leaving the baby behind. Accordingly, appropriate notifications can be generated by the communication device at step 1522.
In further embodiments, a battery operated or continuously powered baby seat communicates to the phone via Bluetooth when the baby is removed, as indicated by the sensor. Thus, in this scenario, if the phone lost the Bluetooth signal, without having received a previous “baby removed” signal, then it is clear that the user has walked away from the car leaving the baby behind. Accordingly, appropriate notifications can be generated.
If the vehicle is equipped with CIOD or CIMS technology as described herein, the BSPS system allows the phone to lose the Bluetooth connection with the baby seat without generating an alarm if the car is running. This lack of an alarm would be desirable in those situations where the baby was loaded in the car first while the parent was gathering other items for the trip.
Another method for suppressing the alarm in such a scenario would use the GPS data from the user's phone. If the phone's GPS showed that the trip had not started yet, no alarm would sound if the phone lost the baby seat signal. By the same token, if the trip had ended, some leeway can be afforded before an alert is generated.
In the case where a trip had commenced, the alarm might still be suppressed if the user does not go a measured distance from the vehicle. Moreover, time measurements can be used to suppress the alarm. The application would note the time that the baby seat signal was lost. If the parent's phone did not reconnect with that signal within a certain amount of time, then an alarm might sound. Such timing information could be used in conjunction could be distance to produce a suppression algorithm utilizing both parameters.
A baby seat employing both a seat-belt-closed sensor and a baby-present sensor (for instance using weight) could offer the added benefit of sounding an alarm if the baby was present but the seatbelt was not fastened.
V. Dongle Embodiment
An interrogator device can offer the ability to look for additional items, besides a phone or other already-enabled Bluetooth devices, through the use of dongles—small, Bluetooth devices that can be attached to other objects. Related interrogation methods are also discussed below.
A. PC Dongle as a Tracked Device
The PC dongle can persistently reside in the USB port or a similar port, of a computer be it a notebook, desktop, netbook, tablet or other portable, USB-equipped computer device. The Dongle system resembles the system shown in FIG. 12, but includes a dongle attached to the computer (not shown) To accommodate such a dongle-equipped portable device being put into a carrying bag, the design of the dongle can be as flat as possible. Specifically, the dongle can bend sideways after exiting the USB port so that the dongle extended as little as possible from the side of the computer.
The first function of such a dongle can be to allow the computer, if portable, to be monitored by an interrogator device. Thus, if the user wanted to bring a notebook along on a commute each day, the interrogator device can search for this device upon starting the car. The dongle, therefore, needs to be battery-powered in order to provide a continuous Bluetooth signal when the computer is off. The battery can be recharged via the USB port when the computer is on.
In many ways, the PC Dongle can also function in a manner similar to a vehicle interrogator device and monitor for the presence of tracked objects. To instigate such an interrogation, the dongle it can look for the presence of the user as indicated by the use of the computing device to which the dongle is attached. Such presence can by the fact that power is going to the USB port, indicating the PC was in a working state, or getting signals from software on the PC indicating that at the unit was being used at the time (see below for software details). Such an interrogation function might be easier done using the Bluetooth-equipped computer itself, however.
B. Positive Separation
A user may have a stationary computing device, such as a desktop PC, with PC interrogator software installed that ensured a paired cell phone was always nearby when the computer was being used (as determined, for instance, by the software's monitoring of the keyboard and mouse input). When the user left such a workstation for the day, however, it can be advantageous to be sure that the cell phone, and other tracked devices were taken.
With a PC dongle installed on the stationary computing device such a scenario can occur. When that computer is turned off at the end of the day, the PC dongle can sense that the computer has been powered down, as described below. The user is then expected to leave the area where the computing device is located and take any tracked devices at that time. Such removal, the Positive Separation (or PS), should occur within a pre-defined and appropriate time interval, the Positive Separation Time (or PST).
Bluetooth signals that the now-battery-operated dongle had been previously receiving from near-by tracked devices such as a cell phone should start to change and eventually diminish upon the beginning of PS. Alternatively, such attenuation-of-signal information can be supplemented or supplanted by information from the cell phone, whose accelerometer, working in conjunction with background software, can produce data indicating that the phone was in motion and thus likely to be in the process of being taken away by the user.
The battery-operated PC dongle can be able to sense that the power had gone off on the PC to which it was connected by reading voltage levels in the USB port if these typically changed when the computer powered down or went into sleep mode. Alternatively, there can be resident software on the machine that continuously communicated with the dongle letting the dongle know that the machine was still operating. When this software ceased to operate and send such communications upon shutdown, the dongle can then know that the computer had been turned off. This moment when the PC is turned off is the beginning of the PST.
If PS was not detected within the PST time period, then the PC dongle can sound an alarm before the user walked too far away. In this scenario, the dongle can need to be equipped with a sound-emitting component. In the preferred embodiment, however, the phone itself, using software that communicated with the PC Dongle, can sound such an alert with the notification means it already had.
In an alternative to the use of a PC Dongle to sense power-down and PS, the computing device itself can be programmed to offer Delayed Shutoff (DS). With DS, the user would power down the computer or put it to sleep, however, the computing device would continue to operate long enough after such shut-down command to monitor for PS using it interrogation capabilities. If indications of PS were not discerned during the PST, an alarm would follow at the end of the PST.
A vehicle-implemented interrogator device can also be advantageously equipped to monitor PS. Such a system can ensure that the user took paired phones and other objects when leaving the vehicle. Similarly, the wall-socket device can be equipped with similar functionality.
Each of these two interrogator device forms can have unique sensing means for determining the beginning of the PST at which time it can then check for diminishing Bluetooth signals or accelerometer data indicating movement away from the interrogator device and thus PS. In the case of the vehicle implementation, the signal can be when the engine was turned off. In the case of the wall socket device, the beginning of the PST can be indicated by the user leaving the room, perhaps indicated by a motion sensor, or the shutting off of an appliance connected to the wall-socket device as indicated by the cessation of power flowing to the connected device.
C. Wallet Dongle
A wallet dongle can be a battery-powered, credit card-sized, Bluetooth-equipped device that can fit into a wallet. The simple version can emit a periodic Bluetooth signal and be paired with, and used with a vehicle interrogation device, or other interrogation systems described herein, to ensure the wallet is present when needed and taken when needed. For example, a wallet dongle resembles the personal item 850 of FIG. 8 which conveniently fits in a wallet for tacking and other purposes.
A more sophisticated version can have a mechanical clip built-in into which a credit card can slip. If the credit card is removed, an electrical switch can be allowed to close alerting the microprocessor on the dongle to the fact that the credit card had just been removed. The dongle can then use a timing circuit to wait for the credit card to be reinserted. If the card is not returned within a certain time period, an alert can be given to the user. Alternatives to a mechanical switch could include a magnetic sensor on the dongle that can detect a magnetic element placed on the credit card, or a set of contacts on the dongle that can inter-connect with conductive material placed on the credit card to form a circuit, or a capacitive sensor on the dongle that can detect the capacitance of an element of the credit card.
Such alerts can take the form of audio from a sound-generating component of the dongle such as a speaker or transducer and/or via vibrations generated by the dongle that can be felt by the user through the wallet. The user, however, might not perceive these alerts if the dongle was in the wallet and the wallet suppressed the sound or vibration. To address such issues, the data concerning the missing credit card can be relayed to the cell phone via the Bluetooth connection built into the wallet dongle. The cell phone can then issue an alert to the user that the credit card was missing using the notification systems already built into the phone.
The phone-to-dongle communication channel can also be used to program the dongle. For instance, using the robust interface on the cell phone, the parameter controlling the elapsed time required before sounding an alarm is issued can be set. All such parameters can also be set with the use of buttons or other interface devices on the dongle itself.
The wallet dongle can have a connector allowing the internal battery to be recharged and one or more LEDs or other visual indicators to show the power level of the battery.
The dongle's battery can have a secondary purpose of being used as emergency power for the user's cell phone or other portable device. To do so, the dongle system can have a short connecting cable that can be used to connect the dongle's battery to the phone's recharging port. Such connector can snap into a recess built into the dongle thus minimizing an any extra thickness attributed to the connecting cable and allowing the connecting cable to be comfortably carried on the user's person at all times.
Additionally, the wallet dongle can be combined with the power-me-up technology described herein to request power when near a Bluetooth charger. In this manner, it provides a power boost for the phone in the wallet while further ensuring that a wallet is not inadvertently left behind. Thus, the battery of the dongle can be used in an emergency for a phone or other similar object.
D. Voltage Pump
The wallet dongle can be programmed to reserve power to be used for emergency phone recharging. For instance, if the dongle's battery held a maximum of 1200 millamp hours of power the user can have the ability, via the interface described above, to specify that the Bluetooth interrogation feature will cease when the battery level drops to 300 millamp hours thus ensuring that there is always some power left for emergency purposes.
E. Dongle Battery Management
Dongles can suffer from the inevitable need to recharge the battery periodically unless they reside in a power port, such as the PC Dongel described above. The Wallet Dongle can have the ability, however, to communicate its power needs to the user via its built-in Bluetooth functionality. To do so, the user can set a threshold level of battery charge, which when reached, can cause the dongle to communicate its charge level to an interrogator, cell phone, or PC to which it has been paired. Such device can then alert the user to the battery charge level via an alarm, notification, or alert.
Alternatively, such interrogator, cell phone, or PC can deduce an approximate charge level by keeping track of the history of communications that have been emitted by the device over time and considering the power needed for such communications. Upon computing such estimated charge level, the device monitoring the dongle can alert the user as described above when the approximated battery level reaches a predetermined level.
Despite the ability of a dongle to communicate its power needs, it can be desirable to extend the battery life if doing so would not adversely affect the functioning of the dongle. The dongle, therefore, can be programmed to send out only intermittent Bluetooth signals, going into a low-power state between signals, and thereby conserve battery power.
The spacing of such signals, however, might result in the user traveling some distance before the vehicle interrogator device produced notification of a missing tracked object. The time period between Bluetooth signals, however, can be controlled by the user via an interface on another device that communicated with the dongle or via buttons or other interface means on the dongle itself. Such means would allow the user to make the tradeoff between the speed of missing-device notification and the frequency with which the dongle's battery has to be recharged. Such an interface can also be used to set the threshold battery level described above.
The dongle can also be programmed such that the rate of pinging is a function of battery level. Thus, the lower the battery charge is, the less frequent is the communication between the dongle and the interrogator unit, thus preserving battery life until a recharge can occur.
The dongle circuit can include a clock, and preferably a calendar, and can be programmed to reduce or stop its generation of Bluetooth signals at certain times of day or on certain days in order to preserve its battery. Such programming and calibration of the clock can best be done on the user's cell phone using special software on the phone and a Bluetooth connection to the dongle.
The dongle can also have a GPS circuit, or more practically, obtain GPS data from the user's cell phone. With such data, the wallet dongle can know if it was at home or at the office—places where a lost wallet can be very unlikely—or traveling at vehicle speed during which the devices would be unlikely to be separated. If the dongle is at either of these locations, or other “safe” locations, or in a vehicle, it can go into a low battery-use mode reducing or ceasing its Bluetooth pinging frequency and waiting for a signal to return to normal operation. In addition, the dongle, if it were running low on battery power, can relay such information to a paired device and such device can provide notification to the user.
F. Time-Based Dongle
For instance a user might wish to ensure that a passport was taken on a trip. In this scenario the dongle is paired with the item that needed to travel. The user utilizes an application, such as a phone application or other web-based application, to program in a trigger event. For example, the fact that on a certain date (and possibly after a specific time on that date) a certain item needed to be added to the interrogator device tracked item list.
When the trigger event occurs (i.e. travel day arrives), and the Bluetooth connection between the phone and the interrogator device is established (signifying that the user is proximate the vehicle) either the phone or interrogator device monitors for a Bluetooth signal from the dongle and alert the user if not found.
Likewise, the system (including the interrogator device, a phone, and other objects being tracked and monitored) can function in a “reverse” manner. As described herein, according to “Positive Separation” embodiments, the system ensures that the item being tracked by the dongle is not proximate the vehicle at the end of the trip. This prevents an item from being inadvertently left behind.
To ensure that a tracked item (other than the phone) leaves the car a tether approach can be employed. That is, the phone can institute a tether with a dongle that is interrogated upon the trigger event of losing the interrogator device signal. If the phone does not detect the interrogator device it determines the interrogator device is not proximate the vehicle. Accordingly, the signal of the dongle remains detectable if the item is also removed from the car. Thus, if no signal is continually received upon loss of the signal from the interrogator device, the phone is constructed and arranged to generate a notification, such as an alert or alarm.
This is applicable, for example, when the tracking of a dongle is temporary in nature. If it is a permanent tracking then the phone and dongle can form a permanent tether. But instances where there is a time-based need to track a dongle, the time-based alert from the interrogator device verifies that the item is proximate the car. And the positive separation tether verifies the item is not proximate the car and thus has exited the vehicle. Such a tether can be programmed to last for a variable length of time, or be active within specific GPS-defined areas, or areas defined by other radio signals such as Wi-Fi signals.
VI. PIP (Phone In Place) Operation
An interrogator device that is already paired with a phone, and which already contains Bluetooth technology, can readily perform the function of a hands-free unit by building in a speaker and appropriate interface buttons and software. As such, an interrogator device hands-free unit, working in conjunction with application software on the paired phone, can be used to reduce the frequency with which a phone needs to be retrieved from a pocket or purse. Such software on the handset, working in conjunction with an interrogator can be called PIP (Phone in Place).
The basic interrogation system uses sensor-based input to determine that a user is in the car and getting set to drive, and then instigates a search for the Bluetooth signal of the paired phone. PIP software, resident on the handset, however, can conversely detect the new presence of the interrogator device Bluetooth signal and can receive a signal from the interrogator that the car started. The PIP software can then use the knowledge that the user was now in the car and about to start driving in order to modify how the paired phone behaved. Such modified behavior can lead to safer driving by reducing the amount of direct physical interaction with the phone. That is, certain activities can be curtailed, some added, and others done differently.
Note, that some cars have built-in Bluetooth technology to power hands-free capabilities and some cars can have hands-free units with persistent Bluetooth signals or signals that are activated upon the car being turned on. In both cases, the PIP-enabled handset can use the initial detection of such Bluetooth signals to invoke the use of the PIP functions described below.
A. PIP Notifications
Upon learning that the user was in a driving state, the PIP software can proceed to filter its normal notifications (of phone calls, text messages, voicemails, and notifications generated by phone applications such as weather alerts) to the user according to rules previously established by such user. For instance, the user can program the PIP software to only notify the user of a SMS text message or MMS message if it was from a particular set of senders. Similarly, voice calls and email notifications can be screened in the same manner.
Key words and phrases, or semantic analysis that can infer meanings similar to key words or phrases, can also be used to filter incoming text messages. Voicemails can be transcribed using voice recognition software and analyzed for key words and phrases in the same manner. If certain key words or phrases are present then notifications can be generated.
When a message (SMS, MMS, voice call, voicemail, or app notification) is screened the notification can be eliminated or done in a manner that conveys information to the user. For instance, text messages from family members could generate a specific type of sound on the hands-free device. With such information, the user can make a decision in real-time whether to deal with the message then or later.
In addition to tones and sounds, text-to-speech technology can be employed to announce, for instance, who is calling if the caller is not on a previously set up white list. Stored or streamed audio files, for instance of the calling party's name, can also provide the information that the user might need in order to decide whether to take the call.
Often when a user starts a trip, notifications that are already on the phone may have been forgotten or not attended to in the rush to get out the door. Therefore, the PIP software can also be configured by the user to announce, at the appropriate time relative to the start of the trip, the presence of these notifications on the phone. Thus, a user may rush out and drive off to a meeting forgetting that there are several unviewed Missed Calls. The PIP software can generate special tones for these and other types of notifications (be they un-listened-to voicemails, weather alerts, or new Facebook posting) and/or can use well-known text-to-speech technology to produce audio renditions of such notifications.
The PIP software can also be configured to allow the original notifications to be left in place on the phone's UI (for Missed Calls, for instance) or to have them be deleted under the assumption that the notifications have served their purpose having been delivered to the user in audio form.
In addition to bringing the user up to date regarding the status of notifications, the PIP software can also advise the user as to what state their phone is in. Thus, if the phone was in vibrate mode, this fact could be communicated to the user via audio signals or a verbal announcement.
In addition to just announcing the state of such phone settings to the user, the PIP software can be configured to have the phone's settings change each time the user is in the vehicle as indicated by the phone's detection of the car's Bluetooth signal (be it from a interrogator, an installed hands-free device, or a Bluetooth-enabled GPS system). In addition to just sensing the presence of the Bluetooth signal, more refined context-setting information can be communicated to the phone, via the Bluetooth signal for instance, specifically information that the phone has been started.
There are several ways that the phone can adapt, under user control, to the environment of the car once given unambiguous information that the phone is in such a setting. Thus the user can configure the PIP software such that when the phone has been informed that the user's car has started, the phone's volume is increased to a maximum setting and taken off vibrate mode at the beginning of each trip. In addition, the interface of the phone's visual display can become optimized for vehicle in several ways. For instance, the applications displayed on the screen can be rearranged to show those most applicable to vehicular use, such as the GPS app. The text size on the screen can be increased, as well, to allow for easier reading.
B. PIP Content Announcements
This PIP application, having received communications signals from the interrogator, has knowledge that the user is in the car and has just started the trip. This time and place information makes it probable that the user is receptive to receiving certain types of information, and therefore the PIP software can proceed to generate audio information of useful to the driver.
One such class of such information is calendar and time-based. Such a time-based application can be invoked when a user gets into a car and the interrogator device indicates the user is getting set to drive off. At a time after such indication is given to the PIP software (such time delay, if any, being programmable by the user) the phone can announce all of that day's coming appointments (based on the time of day at that moment) as noted in the phone's calendar using text-to-talk technology. Alarms, such as those commonly available with calendar software and able to be associated with specific appointments or events, can be programmed into the handset using PIP software and can be announced in audible form at the start of the trip or at predetermined times later in the trip.
Semantic technology can be applied to the text of calendar entries to discern if travel is involved, and if so, such entries can be selected for announcement, reminding the user where the vehicle should be going to next.
Other forms of content can also be conveyed in the same manner. Such content can be the sort that a user might wish to hear upon starting a trip. This can include weather, sports or other news, or a lists of To-Do items applicable to that day.
The PIP software can also allow for the creation of specific content to be played at a time related to when the user starts a trip, such content's sold purpose being to be used in this playback manner. An example of such content might be reminders of things to do during the trip.
Music is another content-type that can benefit from the technology employed by PIP software. For instance, a user can set up their music playlist such that it automatically starts up where it left off when the PIP software understood that a trip was starting or resuming.
C. GPS Means to Establish Context for PIP Functionality
An alternative to using context data from an interrogator device (data that implies that the user was now in the car and beginning a trip), PIP software can deduce similar context information by analyzing GPS data obtained from the phone or another source in the car, such as a Bluetooth enabled GPS dashboard system.
For instance if GPS started to show that the phone was traveling at vehicle-like speeds, and starting from a known location from home, then PIP can assume the user had just started to drive from home. Assuming the Bluetooth connection to a hands-free unit was already established, the Calendar Announcements and other PIP functions can commence. As GPS functions can consume significant battery power, such use of the cell phone's GPS can be limited to situations where the battery charge was above a certain threshold or the cell phone was already plugged into a charger.
D. Other Context Settings
As described above in the PC and Building embodiments, other settings or locations can contain sensors or other communication modules that can establish that a user had arrived in a particular location or was beginning a specific action (such as using a PC keyboard or mouse or entering a room) and such information can be used to look for the presence of the paired phone via Bluetooth. PIP software installed on such a phone, however, can allow the phone to now behave in any of the ways described in PIP functions above.
For instance, if a student did not want to be distracted by extraneous text messages while studying at a computer, the paired phone, using PIP software, can filter text message notifications.
The non-car setting, however, might not necessarily be only a computer desk if the user was employing the wall-socket model of the device described above. For instance, in a workshop, the user might have a lamp plugged into a wall-socket device. When the user turned on the lamp, the current-draw can instigate an interrogation from the device. At that point, content programmed by PIP can begin play through speakers on the phone or device or streamed to another speaker or speaker set.
E. PC-Based PIP Software
In the embodiments described above the PIP software produced information and communicated with the user in audio form in order to reach users for whom it may have been inconvenient to look at their handset. But when PIP software is used in conjunction with software on a PC, the PC can communicate with the user in a visual manner to accomplish many of these same functions.
When using PIP software in a desktop setting with a PC involved, it is advantageous to have software on the PC that interplays with PIP software resident on the phone, such combined software being the PC-PIP software. An important component of such a PC-PIP system is a communications link established over Bluetooth between the two devices that can pass information from the phone to the PC for display on the PC.
For instance, consider the scenario whereby a user's cell phone and computer were both on a desk and such user stepped away from the desk for a period of time. During that time period a phone call comes in to the mobile phone. The user might not see the notification associated with such a call if the user came back to the desk after the phone had gone back into sleep mode. Significant time could elapse before the user had occasion to use the phone for another purpose and happened upon the notification.
Another scenario involves the situation where a user is receiving a stream of text messages and has to turn away from a PC screen to pick up the phone and view this second screen.
Problems associated with such scenarios are addressed by the PC-PIP software when the software on the phone passes the notification information to software on the PC. The PC then displays the relevant information pertaining to the notification on the PC's screen. Such display can be in the form of a pop-up that overlays on top of any other information being displayed on the screen. The user can click away the pop-up or it can go away automatically if the user starts to interact with another program on the screen indicating that the information displayed in the pop-up has been seen.
The PC-PIP system can be configured such that notifications seen on the PC's screen would no longer been seen on the phone's screen when that device was next turned on.
Such notifications passed from phone to computer can include text messages or even entire MMS messages, voicemail notifications, missed call information, weather alerts and other similar notifications that have been set up for phone consumption.
As in the vehicle embodiment described above, the user can configure the PC-PIP software such that certain types of notifications or those related to certain types or specific persons can be precluded from display on the secondary screen—the PC's screen. Such screening could keep distractions to a minimum if the user were trying to perform work on the PC.
The Bluetooth connection between phone and PC in the PC-PIP system can also be usefully employed to enhance computer security. Many users when they step away from their computer would prefer that others, whether they be children, co-workers, or spouses, not be able to use their computer. Password solutions can take time to use and can be off-putting to others who might feel offended that they are being used.
Many such password systems are based on screen savers that don't kick in until a certain amount of time has elapsed since the last user action taken at the PC (keyboard input, for instance). But such action-based timers can leave the system unprotected until the time-out is over, or leaves the user inconvenienced if the screen saver pops up while the user was working on a paper-based task before returning to the computer.
The PC-PIP system can offer PC protection in a much more fluid fashion. When the user leaves the vicinity of the PC, taking their phone and related Bluetooth signal with it, the PC-PIP software will proceed to disable the user's PC. This can be done by freezing the PC's input devices including mouse, touchpad, and keyboard. Alternatively, the screen can be frozen or the hard drive temporarily disabled. When the user's Bluetooth signal comes back into range, such proximity is noted by the PC-PIP software and all capabilities are restored.
The signal strength of the Bluetooth signal able to be detected by the PC is able to be controlled by the PC-PIP software. Such a setting would allow the user to employ a sensitive setting thus allowing them to leave their phone in a coat pocket (where they won't forget it when they leave) across a large room and still have the signal picked up, or a low-sensitivity setting that would mandate that the phone be left right beside the computer.
If the user forgets their phone and needs access to the computer, an alternative means to access the system can be provided. Such a system would entail the use of password or other input means to override the limitations placed on the PC by the PC-PIP software.
VII. Phone Charger Embodiment
A. Automatic Power Requests
A procedure can be implemented according to a plurality of embodiments to determine whether or not an item is present and also, whether the item is being charged. Alarms can be produced to ensure that all tracked objects are present and that some or all are being charged. Five exemplary embodiments of the Automatic Power Requests (APR) idea can be used with any set of Bluetooth-enabled tracked objects paired to a Bluetooth-enabled charging device. Such charging devices can be a charging mat, a wall-socket-type charger, a PC used to charge one or more devices, a car charger, or similar devices.
In the first APR embodiment, the charging device such as a charging mat or simple wall charger is Bluetooth-enabled. The charging device is also equipped with a means to sense whether one or more devices are connected to it and charging. If the charging device senses the presence of the Bluetooth signal from the phone, it generates an alarm after a delay period (which allows the user time to put devices to be charged on the mat or connect them to the charger), gently reminding the user to plug the charge-able devices in the charger, or in the case of the charging mat, place the phone, and/or other registered and charge-able objects, on the mat. Note that in the case of the mat or other charging device that can charge more than one device at a time, only one device among the set to be charged need be Bluetooth-enabled. The presence of that Bluetooth device, assuming it was present when the other devices were, would trigger the charging device to monitor its charging activities to be sure the entire set then gets charged. The other devices merely need to be compatible with the charging device. Such an embodiment would be most advantageous when the user wished to always charge multiple devices at the same time.
Regarding the APR function, the alarm or reminder generated can be an audible sound or light or combination of both. This first embodiment does not require any software per se on the phone and would just require a pairing-type setup. The request to charge the phone can be made regardless of the battery level of the phone at that time.
In the second exemplary APR embodiment, a sensor is used by the charging device to infer that the user was in a room or proximate to the charger. If the sensor sensed the user entered the room, and no charging activity had begun within a certain time, the charging device can produce an alarm or reminder to charge. In the case of a car charger, such proximity detection can include detecting an increase in voltage in the power port. Note that this embodiment does not require any of the devices for which the user wished to be charged, to be Bluetooth-enabled. Thus, the vehicle-based APR device can use a power-port voltage reading to note that the car had started and if the user's cell phone was not plugged in after a certain time period, an alarm would go off. Such a system would ensure that a user's phone was both in the car and being charged. Neither software, nor Bluetooth capability on the phone would be needed.
In a third exemplary APR embodiment, the charging device can communicate with the user's PC, cell phone, tablet computer, or other device with a visual display, which presumably is close by. When the user started to use the PC, for instance, (which can also be the charging device), as noted by any keyboard or other input activity, a utility on the PC checks to see if the phone or other objects of interest are being charged. If not, the PC or the charging device can generate an alarm or notification to charge the phone. An advantage of this embodiment is that the alarm can be visual in nature, and thus quiet, with a high likelihood of being seen as the user presumably is using the device with the display. (Such an alarm, of course, can also serve to notify users that their phones were lost or missing if that was the reason that there was no charging activity.) Again, no Bluetooth signal from the devices to be charged would be needed, nor software on the phone.
In a fourth exemplary APR embodiment, the user has a list of devices to be charged. The “sensor” input comes from the detection of at least one device that is connected to the charging device. Once one device is set up to be charged, all devices are to put in a charging state as well, in order to preclude an alarm state. Thus, if a user put their iPhone on a charging mat, but not their iPod within a few seconds, an alarm (visual or audible) initiates. Note that this embodiment can be software that is added to an existing charger product and doesn't necessarily require new hardware except that needed for an alarm.
Finally, a fifth exemplary APR embodiment utilizes the “constant alarm” concept. The charging device generates an alarm during any time period for which all registered devices re not being charged. Such an alarm can be as simple as a blinking red light that will only cease blinking when all the registered devices are being charged.
Note that in the case where an APR embodiment involves a PC, such PC must be kept powered on in order for the system to be operable when registered devices come into range.
B. Smart APR (SAPR)
Until recently, many cell phones had a standard feature whereby the phone chirps when its battery started to get low. The offering of this feature as the default setting on many phones has been phased out in many cases due to the annoyance such a notification can cause, particularly when the phone doesn't have any clues as to context, or the situation the user is in, when such notification was given. (Having one's phone begin chirping in the middle of a meeting or on a night-stand was not necessarily desirable even if the battery was running low.) The “Smart” APR (or SAPR) embodiment corrects that problem by making sure that the circumstances or context associated with the device whose battery is running low are appropriate for an alarm. When the alarm for a SAPR goes off the charging means will likely be close by and/or the venue probably means an alert would not be bothersome.
The first APR embodiment (utilizing Bluetooth as a sensing means for presence) can also be implemented with an intelligence feature that reflects the battery power level of the phone or other device to be charged. This SAPR embodiment uses software on the phone to communicate with the charging device, which would also be Bluetooth-enabled.
The SAPR system includes an “app” or similar software functionality that is installed on the portable device to be charged. The portable device, such as a phone, as well as the charging device, both have a communication means such as Bluetooth to communicate with each other. When the phone gets into proximity to the charging device it can recognize the Bluetooth signal of the SAPR-enabled charging device. The presence of such a signal provides the location-based context that deems it acceptable to sound an alarm if necessary to warn the user to charge the phone. For instance, if the power level of the device to be charged, for example an iPad, is below a certain threshold, such threshold either being set by the user or previously set as a default standard, then the device, or the charging device, sounds an alarm if the iPad is not connected to the required charging device within a set time period once the Bluetooth connection has been made.
The SAPR can produce a visible or audible alarm, while alternatively, the iPad or other device to be charged can use one of its normal notification means. Such alarms can alert the user to place the iPad upon the mat for charging or connect to another type of charging device.
The SAPR embodiment can be implemented by any type of charging device working in tandem with the device to be charged via a communications means. A vehicle-based interrogator configured to function as a phone charger, for instance, could also perform SAPR functions. A PC or other display-enabled device, if a charging function is part of such a device or the PC communicates with a charging device, could be part of an SAPR system and provide visual notification about the need to charge.
C. Single-Device SAPR Embodiment
A SAPR system can also rely on information solely from the phone, and not require information from a separate device (such as the presence-signaling information generated by a Bluetooth-enabled wall charger) to determine if the circumstances for generating a low-battery level alarm are warranted. Such an embodiment can work with input provided by standard sensors on the phone working in conjunction with parameters supplied by a user.
Thus, a user can specify through the phone's interface various allowable locations where the charge notification or alarm (that the battery level had fallen below a threshold) can be sounded. The phone can supply GPS data to its alarm-control software module preventing alarms from occurring in undesired locations and allowing them in preferred locations.
The preference for allowed locations to sound a battery-charge alarm can be narrow, for instance only being allowed in a particular room. As GPS signals can be weak and indeterminate indoors, Bluetooth and Wifi signals and combinations thereof, can also be used as location determining proxies, to determine indoor location.
By the same token, the user can specify times of day, days of the week, and other time-based information that further can control the issuance of such alarms. Such time-based parameters can work in conjunction with location-based parameters to allow for refined user-generated alarm rules such as: “Sound a battery alarm only if I'm home and it is between 8 a.m. and 8 p.m.”
Another problem with previous battery-level alarm systems is that the owner of the phone may not have been nearby when the alarm went off and continuous alarming would further hasten the draining of the battery or annoy more people close to the phone. Thus, another feature of the SAPR is that the battery-level notification can be programmed to be initiated when the phone detects that the owner is nearby. The phone can use its accelerometer data to detect when it is in motion to make that determination.
In addition to having the crossing of a simple battery threshold level trigger the alarm or battery-level notification the SAPR software on the phone can utilize time-based information, as well as calendar entries, including historical data of battery usage over time and during certain types of events, to make forecasts of upcoming battery usage needs and thus make the threshold level dynamic. Thus, if it was Sunday night, and the calendar showed a day of meetings out of the office on Monday, the SAPR software on the phone could decide the user needed a full charge before Monday morning. Thus the battery threshold would be increased under such circumstances.
The battery threshold level can also be made dynamic by incorporating data regarding when the battery has been totally drained in the past. Times, dates, and circumstances surrounding such battery-down times can be used to build more buffer into the battery reserve by increasing the threshold level.
D. The Collection Plate
Many consumers have a habit of placing all their valuables (phone, wallet, keys, etc.) in one particular place at night or when they come home or arrive at the office. Given that this “down time” is a perfect time to charge a user's phone, a charging mat is therefore an ideal candidate to be turned into a “collection plate”, a location on which all personal items may be collected.
The Collection Plate (CP) embodiment can work with most objects and not just devices with Bluetooth connections and those needing charging. The goal of the CP system, then, is to collect all registered objects on the mat when desired, and charge the chargeable devices while on the mat.
Such an embodiment includes a mechanism for of detecting the presence of, and identity of, non-charging objects placed on the mat. One such method would equip the mat with one or more sensors that allows the mat to serve as a weighing scale, as well as, a charging device.
The weight of each item can be previously registered to the mat. If items are place on the mat one by one, the mat can register the presence of each new item by measuring the incremental weight as such object is placed on the mat and matching such weight against the list of registered objects with their known weights.
Alternatively, the total weight of all the registered objects can be known by the mat and the mat can merely compare the total weight after all objects had been collected against the nominal total. The item-by-item approach would be advantageous when there was some day-to-day variation in the weight of an object (such as a wallet after payday), with such variation being in the same range as the weight of another object, for instance, a ring.
The instigation of the collection process for a CP system is similar to the methods outlined above for the APR system that instigate interrogations. For instance, if a motion sensor is used to detect a user's presence, an alarm is generated if all registered objects are not placed on the mat to be weighed within a certain time period. As is the case with the other systems discussed above, a constant alarm method can be used in place of a sensor-based method that instigated interrogations.
In a weighing-based CP embodiment, weight information replaces the connection information generated when a device in connected to a charging device (be it an electrical or inductive charge connection), or the Bluetooth connection made when an interrogator device and a tracked object are in close proximity, as the means by which presence is detected. As all objects have weight, this allows the mat to be able to detect the presence of items that do not have a Bluetooth circuit or a charging element such as keys or rings.
The mat can be calibrated by simply pressing a calibration or registration button when an item is first placed on the mat, for the item-by-item approach. If the item varies in weight, the minimum and maximum weights can be registered by manipulating a simple button interface on the mat. Such an interface can be used to select the collection method, as well, such as item-by-item placement or total weight. Alternative detection means can also be used for discerning which items were on the mat. For instance, one or more low-cost cameras can be built into the side of the mat. The CP system can then use image recognition technology to detect presence. Capacitance sensors built into the surface of the mat can also be utilized to detect and identify objects that vary in their capacitance.
VIII. Time-Based Alarms
Many of the embodiments above can potentially benefit from adding a dimension of time, such as time-of-day and/or day-of-week, to the algorithm controlling alarm generation. For instance, the CP system might be most productively employed on certain days of the week when it would be most important that the user “round up” all the registered devices.
In cases where the constant alarm mode is used, such time-based systems can be used to minimize the disadvantages posed by such an approach (annoying constant alarms and energy inefficiency) by concentrating the constant alarms to particular times of day and days of the week.
The benefits and advantages of the interrogation system, method and device described herein should not be apparent, as well as other features. The system provides a device to ensure that objects and personal items are not inadvertently misplaced or left behind.
The foregoing has been a detailed description of illustrative embodiments of the invention. Various modifications and additions can be made without departing from the spirit and scope of this invention. Each of the various embodiments described above may be combined with other described embodiments in order to provide multiple features. Furthermore, while the foregoing describes a number of separate embodiments of the apparatus and method of the present invention, what has been described herein is merely illustrative of the application of the principles of the present invention. For example, the interrogator device can be any device capable of communicating with a plurality of personal items, and the personal items capable of being tracked is also highly variable. The interrogator device can be a device that is pluggable into a vehicle power port or an outlet in a building. The objects being tracked by the interrogator device can include cell phones, other portable devices, wallets, purses, portable computers, and other personal items. Additionally, although Bluetooth is the protocol described herein for illustrative purposes, alternate protocols can be employed and adapted for use with the system, method and device described herein, and still remain within the scope of the invention. Accordingly, this description is meant to be taken only by way of example, and not to otherwise limit the scope of this invention.

## Claims

1. An interrogator device for detecting a presence of a tracked object, comprising:
a housing having a pluggable vehicle cigarette adapter portion to power the device in a vehicle; and
a controller with a memory containing object data located within the housing electrically connected to a communicator or sensor module located within the housing for communicating or sensing the tracked object corresponding to the data stored in the memory about the tracked object whenever the controller detects that the vehicle has started by monitoring the power seen in the cigarette adaptor portion.

2. The interrogator device of claim 1, wherein the sensing of the tracked object includes a radius of detection of approximately one to thirty feet away from the device.

3. The interrogator device of claim 1, wherein the tracked object includes a communicator or sensor module that is able to communicate with the communicator or sensor of the device.

4. The interrogator device of claim 1, wherein the communicating between the object and device is standard Bluetooth communication protocols.

5. The interrogator device of claim 1, further including a message displayed on the device indicating that the object is located within or outside the detection range of the sensor.

6. The interrogator device of claim 1, further including a message displayed on the device about the object is selected from a group consisting of date, time, location or any combination thereof.

7. The interrogator device of claim 1 wherein the tracked object is a phone.

8. The interrogator device of claim 7 wherein a function of said phone is disabled when the interrogator device detects that the vehicle is started.

9. The interrogator device of claim 7 wherein the interrogator device further includes a speaker.

10. The interrogator device of claim 9 wherein audio information is communicated from said phone to the interrogator device.

11. The interrogator device of claim 10 wherein the audio information from said phone is announced using said speaker on the interrogator device.

12. The interrogator device of claim 10 wherein the tracked object detects that the interrogator device no longer has power.

13. The interrogator device of claim 12 wherein the tracked object announces that the interrogator device no longer has power.

14. The interrogator device of claim 13 wherein the tracked object announces that the interrogator device has no power based on an algorithm based on time or movement.

15. A method for monitoring the presence of an object, comprising:
plugging an interrogation device with a memory of stored object data into a cigarette lighter port or a power port of a vehicle to power the interrogation device;
sensing for the object upon when the interrogation device detects that the vehicle has started by monitoring the power seen in the cigarette adaptor port or the power port;
communicating between the sensed object and the interrogation device whenever the object is within sensing range; and
providing a message of the presence or absence of the object upon applying power to the interrogation device.

16. The method of claim 15, wherein the sensing range between the object and the device is approximately a radius of one to thirty feet therebetween.

17. The method of claim 15, wherein the communicating is done through local Bluetooth pairing between the sensed object and the device.

18. The method of claim 15, wherein the generated message about the object is selected from a group consisting of date, time, location or any combination thereof.

19. The method of claim 15 wherein the object is a phone.

20. The method of claim 15 further including the step of disabling a function of said phone when the interrogator device detects that the vehicle is started.

21. The method of claim 15 wherein the interrogator device further includes a speaker.

22. The method of claim 21 further including the step of communicating audio information from said phone to the interrogator device.

23. The method of claim 22 further including the step of announcing on the speaker of the interrogator device the audio information from said phone.

24. The method of claim 15 further including the step of detecting, on the tracked object, that the interrogator device no longer has power.

25. The method of claim 24 further including the step of announcing, on the tracked object, that the interrogator device no longer has power.

26. The method of claim 25 wherein the tracked object announces based on an algorithm based on time or movement.