# Patent

## Title
System and method for remote home monitoring utilizing a VoIP phone

## Abstract

A system and method for remote monitoring through a voice over Internet Protocol phone. An indicator configured to activate a video interface of the VoIP phone is received. A determination is made whether the indicator authorizes the video interface. The video interface of the VoIP phone is activated in response to determining the indicator authorizes the video interface. Video communications are sent and received between the VoIP phone utilized by a receiving party and a communications device utilized by a calling party. An action is performed in response to recognizing a response from the receiving party.

## Background
CROSS REFERENCE TO RELATED APPLICATION
This application is a continuation of U.S. Patent Application No. 12/044,792, filed Mar. 7, 2008 by Johnny D. Hawkins and entitled, “System and Method for Remote Home Monitoring Utilizing a VOIP Phone”, which is hereby incorporated by reference in its entirety.


BACKGROUND
The use of and development of communications has grown nearly exponentially in recent years. The growth is fueled by larger networks with more reliable protocols and better communications hardware available to service providers and consumers. Users have similarly grown to expect better communications from home, work, and on the go. For example, users now expect faster connection speeds, increased bandwidth, better reliability, and greater availability from all types of communications networks. In many cases, the growth is driven by people looking to give up traditional communications schemes for the efficiency, effectiveness, and availability of new networks.
For example options for communications with a phone have not significantly improved with changing technology. Most communications with family members at home, assisted living centers, and senior centers are limited to legacy systems, such as answering machines and speaker phones. Many individuals would warmly embrace technologies and features that enhance communication with aging parents and other family members to ensure well being, security, and peace of mind. There is a need for enhanced features for Voice over Internet Protocol (VoIP), standard telephones, wireless data and voice networks, and other communications devices, mediums, and networks.
SUMMARY
One embodiment provides a system and method for remote monitoring through a voice over Internet Protocol phone. An indicator configured to activate a video interface of the VoIP phone may be received. A determination may be made whether the indicator authorizes the video interface. The video interface of the VoIP phone may be activated in response to determining the indicator authorizes the video interface. Video communications may be sent and received between the VoIP phone utilized by a receiving party and a communications device utilized by a calling party. An action may be performed in response to recognizing a response from the receiving party.
Another embodiment provides a VoIP monitoring system. The VoIP monitoring system may include a function trigger for intercepting an incoming call destined for the VoIP monitoring system. The function trigger may be configured to receive a user selection to enable an video interface of the VoIP monitoring system. The VoIP monitoring system may further include logic configured to determine whether a pass code entered by the calling party authorizes video communications with the VoIP monitoring system. The logic may enable the video interface to perform the video communications based on the user selection. The logic may perform an action in response to recognizing a response from a receiving party.
Yet another embodiment provides a VoIP phone. The VoIP phone may include a processing unit for processing a set of instructions and a memory configured to store the set of instructions. The set of instructions may receive an indicator configured to activate a video interface of the VoIP phone, determines whether the indicator authorizes the video interface, activates the video interface of the VoIP phone in response to determining the indicator authorizes the video interface, sends and receives video communications between the VoIP phone utilized by a receiving party and a communications device utilized by a calling party, and performs an action in response to recognizing a response from the receiving party.



BRIEF DESCRIPTION OF THE DRAWINGS
Illustrative embodiments of the present invention are described in detail below with reference to the attached drawing figures, which are incorporated by reference herein and wherein:
FIG. 1 is a perspective drawing of a communication system in accordance with an illustrative embodiment;
FIG. 2 is a perspective drawing of a video enabled VoIP system in accordance with an illustrative embodiment;
FIG. 3 is a block diagram of a home communication system in accordance with an illustrative embodiment;
FIG. 4 is a flowchart of a process for remote monitoring in accordance with an illustrative embodiment; and
FIG. 5 is a flowchart of a process for home monitoring and using a home intercom in accordance with an illustrative embodiment.



DETAILED DESCRIPTION OF THE DRAWINGS
Illustrative embodiments provide a system and method for Voice over Internet Protocol (VoIP) monitoring. The monitoring may be performed for aging parents, children, or a specified location. The VoIP phone may be video-enabled. The VoIP is a telephonic device configured to send and receive voice communications, video, images, and other data through a network connection. The user may be required to receive an authorization or present a pass code that authorizes the user to monitor or carry on a two-way conversation with the VoIP telephone remotely. As a result, the user may receive voice signals and/or video from the VoIP phone. Alternatively, the user may carry on an intercom or video conversation with a user that is unable to answer calls using traditional methods.
One or more VoIP phones or other communications devices may also be configured to send automated messages to one or more receiving parties. The automated messages may remind the receiving party to take a medicine, feed the dog, or perform other tasks. The automated message may require an acknowledgement such as a voice command, gesture, facial recognition, number input, or other information to acknowledge that the message was received and/or performed. For example, the message may determine whether an aging parent is doing well in an assisted living center. An automated call may play an audio file from the aging parent's child, such as “How are you doing mother?”. No messages are sent if the parent responds “Good”, “I am fine”, or any other pre-programmed response. If however, the aging parent responds “not well”, “bad”, or another response that is not an affirmative response, the VoIP phone may send a message, call, or otherwise communicate to a user specified by user preferences. The VoIP phone may be configured to take any number of actions based on the affirmative or negative responses of the user.
FIG. 1 is a pictorial representation of a communications system in accordance with an illustrative embodiment. The communication system 100 of FIG. 1 includes various elements used for wireless and wired communication including remote monitoring. The communications system 100 may include a mobile switching center (MSG 102, a local exchange 104, voicemail systems 106 and 108, a database 110, wireless devices 112 and 114, a transmission tower 116, a wired network 118, a center 120, phones 122 and 124, and a client 126. In one embodiment, the different elements and components of the communications system 100 communicate using wireless communications including satellite connections or hardwired connections, such as fiber optics, T1, cable, DSL, high speed trunks, and telephone lines.
The wireless devices 112 and 114 may communicate with the transmission tower 116 using communications protocols, such as time division multiple access (TDMA), code division multiple access (CDMA), global systems for mobile (GSM) communications, personal communications systems (PCS), WLAN, WiMAX, or other frequently used cellular and data communications protocols and standards. The wireless devices 112 and 114 may include cellular phones, Blackberry®, personal digital assistances (PDA), mp3 players, laptops, evolution data optimized (EDO) cards, multi-mode devices, and other wireless communication devices and elements.
Communications within the communications system 100 may occur on any number of networks which may include wireless networks, data or packet networks, private networks, publicly switched telephone networks (PSTN), and the wired network 118. The networks of the communications system 100 may represent the hardware, software, and services of a single communication service provider or multiple communications services providers. The features of the embodiments may be implemented by one or more elements of the communications system 100 independently or as a networked implementation.
In one embodiment, the MSC 102, voicemail system 106, and transmission tower 116 are part of a wireless network that is operated by a wireless service provider. For example, the control signals and operational features may be performed by the MSC 102 and the wireless signals may be broadcast from the transmission tower 116 to the wireless devices 112 and 114. The wireless network may include any number of systems, towers, servers, and other network and communications devices for implementing the features and performing the methods herein described. For example, a user may monitor a VoIP phone from a cell phone enabled to send and receive live video.
The MSC 102 may be a switch used for wireless call control and processing. The MSC 102 may also serve as a point of access to the local exchange 104. The MSC 102 is a telephone exchange that provides circuit switched calling and mobility management and may also provide GSM or PCS services to the wireless devices 112 and 114 located within the area the MSC 102 serves. The MSC 102 may include a home location register (IALR) and visitor location register (VLR) that may be used to implement different features of the illustrative embodiments. The voicemail system 106 may be an integrated part of the MSC 102 or alternatively may be an externally connected device.
In one embodiment, the voicemail system 106 may include an integrated database for storing customer and usage information and data. The user may communicate, interact, or send and receive data, information, and commands to the voicemail system 106 through the telephones 122 and 124, wireless devices 112 and 114, or the client 126. The MSC 102 and voicemail system 106 may include any number of hardware and software components.
The local exchange 104, the MSC 102, and/or other elements of the communications system 100 may communicate using a signal control protocol, such as a signaling system number 7 (SS7) protocol. The SS7 protocol is used in publicly switched networks for establishing connections between switches, performing out-of-band signaling in support of the call-establishment, billing, routing, and implementing information-exchange functions of the wired network 118. The local exchange 104 may be owned and operated by a local exchange carrier that provides standard telephone service to any number of users. In one embodiment, the local exchange 104 may be a class 5 switch that is part of the network systems of the local carrier. The local exchange 104 may include or may be connected to the voicemail system 106. However, the local exchange 104 may also be a Digital Subscriber Line Access Multiplexer (DSLAM), Internet Protocol (IP) gateway, base station, or any other suitable network access point.
The local exchange 104 may be a wire-line switch or public exchange using time domain multiplexing to provide telecommunications services to a particular subscriber or groups of subscribers. The local exchange 104 may be located at a local telephone company's central office, or at a business location serving as a private branch exchange. The local exchange 104 may provide dial-tone, calling features, and additional digital and data services to subscribers, such as home phones 122 and 124. In one embodiment, the local exchange 104 enables VoIP communication of the phones 122 and 124 through a data network. VoIP works by sending voice information in digital form, such as packets, rather than using the traditional circuit-committed protocols of the publicly switched network. The local exchange 104 may be or include a feature server, a call control agent, or an IP gateway for implementing VoIP communications.
The communications system 100 may further include any number of hardware and software elements that may not be shown in the example of FIG. 1. For example, in order to facilitate VoIP communications, the communications system and the MSC 102 and local exchange 104 in particular, may include additional application servers, media servers, service brokers, call agents, edge routers, gateways (signaling, trunking, access, sub, etc.), IP network service providers, adapters, exchanges, switches, users, and networks. The voicemail system 108 is similar to the voicemail system 106 except that it is equipped to handle voicemail for landline customers rather than wireless customers. The local exchange 104 or other components of a wire line network, such as a data, PSTN, VoIP, or other wired network may transfer the data and information utilized to perform the methods herein described.
The MSC 102 and the local exchange 104 may include an authentication space. The authentication space may be a partition, module, or other storage or memory of the server designated by the communications service provider. The authentication space may validate that a user or device, such as client 126, is allowed to authorize the MSC 102, local exchange 104, or corresponding voicemail systems 106 and 108 to enable monitoring, set preferences, implement changes, configure automated messages and settings, review information, or perform other updates. For example, a user may be first required to provide a secure identifier, such as a user name, password, pass code, or other authentication code or hardware interface, to verify the user is authorized to make changes within the authentication space.
The authentication information may be used to create a secure connection between the client and the MSC 102 or the local exchange 104. The secure connection may be a virtual private network tunnel, an encrypted connection, firewall, or other form of secured communications link. The MSC 102 and local exchange 104 may use any number of gateways, proxies, applications, or interfaces for allowing the client 126 to the MSC 102 and local exchange 104 through the wired network 118. Alternatively, the client 126 may use a wireless network or other network to access the MSC 102 and local exchange 104. The MSC 102 and local exchange 104 may use a host client application for communicating with numerous clients.
The center 120 is an example of an assisted living facility, dwelling, nursing home, apartment, residence, senior center, business, or location of a person or group that may utilize any number of communications services. The center 120 is shown as a residence in the illustrated example, however, the center 120 may also be an office, business, or other structure wired or otherwise suitably equipped to provide telephone, data, and other communication services to one or more customers. In one embodiment, the center 120 is equipped with multiple communication devices, including phones 122 and 124 and client 126. The phones 122 and 124 may be standard devices that provide dialing and voice conversation capabilities. Phone 122 may be integrated in any number of other devices or may be used in different forms. For example, the phone 122 may be part of a refrigerator or intercom system. In another embodiment, the phone 124 may be integrated with a personal computer, such as client 126.
The communications services accessible from the phones 122 and 124 may include standard telephone service or VoIP telephone service. The phones 122 and 124 may be VoIP telephones or may be standard telephones that include a modem and/or VoIP adapters for enabling VoIP communications. In one embodiment, a special dial tone, message, web alert, or other feedback may specify once or repeatedly that the phones 122 and 124 are going off-hook or performing monitoring. For example, the phones 122 and 124 may sound a double chirp when the video is automatically enabled for the phone 122. In another embodiment, the phones 122 and 124 give no indication that the monitoring is being performed. The phones 122 and 124 may be silent in order not to wake or disturb a person in the center 120 or in order to more securely determine the surroundings, settings, and security of the center 120 and any occupants. The user may cancel use of any features by reentering the feature command, hanging up, or entering a cancellation command.
The client 126 may be a personal computer for performing and executing programs and instructions and accessing the wired network 118. However, the client 126 may be any computing devices suitable for communicating with the wired network 118 through a network connection. The wired network 118 may be a fiber optic, cable, or telephone network or other wired network suitable for communication over a hard wired connection with the client 126. In one embodiment, the center 120 may include a wireless router, adapter, switch, hub, or other suitable interface that allows the client 126 to communicate with the wired network 118. Alternatively, the client 126 may communicate with the wired network 118 through a wireless connection. The MSC 102 and local exchange 104 may use a graphical user interface (GUI), such as website or program accessible from the client 126 in order to enter and receive input preferences for performing the remote monitoring or setting automatic calling preferences.
In an illustrative embodiment, the user may provide user input, view content, make a video enhanced call, or otherwise make selections and communicate commands using devices, such as or similar to wireless devices 112 and 114, phones 122 and 124, and client 126.
At any time, a user may select to enable, order, initiate, configure, reconfigure, cancel, or otherwise configure the way the remote monitoring is performed. For example, the user may use a command that informs a function trigger of a device or the device itself, such as the MSC 102, local exchange 104, voicemail systems 106 and 108, wireless devices 112 and 114, phones 122 and 124, or client 126, to begin remote monitoring. In one example, the user may submit a command to activate the remote monitoring by dialing *2 on the phone 122 and then entering a pass code, account code, password, pin number, or other identifier. In another embodiment, a user may activate the feature by dialing *79 on the wireless device 112. The command may also be a password, voice activated, time activated, preset by user selection or any other suitable option, setting, command, or user input. In another embodiment, the various features may be implemented using tactile commands.
FIG. 2 shows examples of communications devices in accordance with an embodiment of the present invention. FIG. 2 includes a VoIP telephone 202 and a cordless telephone 204. The VoIP phone 202 and the cordless phone 204 may include a video camera 206 and a display 208 in addition to the standard hardware, software, and features.
The video camera 206 is a visual recording device. The video camera 206 may allow the VoIP phone 202 and the cordless phone 204 to record or stream live video images through a telephone or network connection of the VoIP phone 202. The display 208 is a graphical representation device. The display 208 may show text, video, images, graphics, or other data and information. The VoIP phone 202 and cordless phone 204 may include any number of interface elements.
In one embodiment, the VoIP phone 202 and the cordless phone 204 may include a feature button. The feature button may be an interface that allows the user to send a signal or command to a class 5 switch, mobile switching center, or voicemail system or other component of the communication system 100 of FIG. 1 to activate remote monitoring. Alternatively, the feature button may activate the individual device to perform the requested service.
The feature button may be a dedicated button, programmable or otherwise assignable graphical user interface, touch screen, microphone, scroll wheel, or other input device that generates the command signal that activates the feature for the VoIP phone 202 and the cordless telephone 204. The VoIP telephone 202 and cordless phone 204 are particular implementations of the phones 122 or 124 of FIG. 1. The interfaces of the VoIP phone 202 and the cordless phone 204 may be utilized to activate any of the methods, services, and features herein described in addition to features available for standard VoIP phones and cordless phones.
The VoIP phone 202 and cordless phone 204 are telephonic devices that operate in conjunction with a data or packet network and/or VoIP network elements. The telephone 202 and cordless telephone 204 are provided dial tone connectivity through a data or network connection for a home, business or other location in which the VoIP phone 202 and cordless phone 204 are located. In another embodiment, the VoIP telephone 202 may be a plain old telephone service (POTS) phone that functions using an analog connection.
In one embodiment, the VoIP phone 202 may operate as a cordless base station for the cordless phone 204. For example, the two devices may share a single phone number. The VoIP phone may establish a radio frequency link with the cordless phone 204 over a small distance, such as five hundred feet or less. The wireless frequency between the cordless phone 204 and VoIP phone 202 may be any frequency commonly used for short range communications including, but not limited to 1.7 MHz, 27 MHz, 43-50 MHz, 900 MHz, 1.9 GHz, 2.4 GHz, 5.8 GHz, Bluetooth®, WiFi® All voice, streaming video, data, and other information that are received during a phone call are channeled through the VoIP phone 202 to a user operating the cordless phone 204.
As a result, the VoIP phone 202 or the cordless phone 204 may be utilized to monitor or be remotely monitored. For example, a user may position the cordless phone 204 so that the phone may be automatically activated during a call to monitor one or more individuals in a room. For example, the cordless phone 204 may be positioned on a bedroom table to monitor a bed-ridden family member throughout the day. The VoIP phone 202 and the cordless phone 204 may be enabled to receive audio and visual feedback from a caller or receiving party. In particular, the VoIP phone 202 and the cordless phone 204 may recognize any number of responses inclduing frames, actions, gestures, or content received by the video camera 206. For example, the VoIP phone 202 and the cordless phone 204 may recognize responses which may include voice input, facial gestures, body position, motions, hand gestures, or other feedback that a receiving party may be capable of performing.
FIG. 3 is a block diagram of a VoIP system in accordance with an illustrative embodiment. VoIP system 300 is a particular implementation of the VoIP phone 202 and/or cordless phone 204 of FIG. 2. The VoIP system 300 may be one or more telephonic devices, software modules and/or other devices configured to both make and receive a call for monitoring purposes.
In one embodiment, the VoIP system 300 includes a processor 302, a memory 304, a function trigger 306, call monitoring logic 308, monitoring preferences 310, and automated settings 312. The VoIP system 300 may communicate with a telephonic device 314. In one embodiment, the telephonic device may be another VoIP phone which may include the elements of the VoIP system 300.
The processor 302, memory 304, function trigger 306, call monitoring logic 308, monitoring preferences 310, and automated settings 312 may be implemented individually, or collectively in a single element, device, or software component to provide the features herein described. The user input that is used by the function trigger 306 to enable the features described may be received directly by the VoIP system 300 through an interface, touch screen, buttons, dials, or indicators or from the telephonic device 314 or other computing or communications devices.
The processor 302 is circuitry or logic enabled to control execution of a set of instructions. The processor 302 may be a microprocessor, digital signal processor, central processing unit, or other device suitable for controlling an electronic device including one or more hardware and software elements, executing software, instructions, programs, and applications, converting and processing signals and information, and performing other related tasks. The processor 302 may be a single chip or integrated with other computing or communications elements. The processor 302 may process voice signals which may include decoding and reassembling as well as packetizing outgoing voice signals for transmission. The processor 302 may also execute a set of software modules to execute video monitoring.
The memory 304 is a hardware element, device, or recording media configured to store data for subsequent retrieval or access at a later time. The memory 304 may be static or dynamic memory. The memory 304 may include a hard disk, random access memory, cache, removable media drive, mass storage, or other storage suitable for recording data, instructions, and information. In one embodiment, the memory 304 and processor 302 may be integrated. The memory may use any type of volatile or non-volatile storage techniques and mediums. The VoIP system 300 or the memory 304 may include hardware or software for implementing voice commands and voice recognition. For example, utilizing voice recognition a user may access the VoIP system 300 or enter a message for delivery to any number of other VoIP devices.
In one embodiment, the function trigger 302 may be a software module triggered to implement monitoring using the VoIP system 300. The function trigger 302 activates the call monitoring logic 308 in response to receiving a pass code, password, or other designated identifier. For example, after calling the VoIP system 300, a user may enter a code, such as *882 that the function trigger 306 receives and utilizes to activate the call monitoring logic 308.
In one embodiment, when an incoming call is received, the function trigger 306 may play a prompt to the calling party. This prompt may only be recognizable by the calling party for security purposes. Once the function trigger 306 has played the prompt or sent the prompt signal to the calling party, the function trigger 306 listens for a user selection. Once the function trigger receives the user selection, the function trigger prompts the calling party to enter a pass code. The pass code may be an identifier, password, authorization voice queue, or other authentication message that ensures that the calling party is authorized to activate call monitoring or intercom communication. Next the function trigger 306 determines whether the pass code is correct. If the pass code is correct, the function trigger 306 activates the call monitoring logic 308 based on the previous user selection.
In one embodiment, the memory 304 of the VoIP system 300 may allow a calling party to record the intercom conversation or monitored conversation. This may be particularly useful if there is a dramatic event occurring during the time the VoIP system 300 is being used to monitor a telephone, such as phones 122 and 124 of FIG. 1.
Call monitoring logic 308 is the digital logic, instructions, circuits or other elements that activate the VoIP system 300 to perform monitoring. The call monitoring logic 308 may be connected to a video camera, such as video camera 206 of FIG. 2, for streaming or recording video for transmission through a network connection. The call monitoring logic 308 may capture both audio and video content. The monitoring preferences 310 are the operational and procedural settings that define how and when the call monitoring logic 308 may be utilized. The monitoring preferences 310 may be established utilizing a user interface of the VoIP system 300 or externally through another device or interface. In one embodiment, the user may utilize a client device and a graphical user interface or a wireless device to set the preferences for the call monitoring logic 308.
The call monitoring logic 308 may be remotely or locally activated. For example, a child calling a parent at an assisted living facility may have previously agreed with the parent to enable the call monitoring logic 308 to be activated by the child remotely entering a pass code. As a result, the child is able to see how the parent is doing at any time without requiring user interaction of the parent.
In another embodiment, the call monitoring logic 308 may be configured to be activated only if the person called grants authorization through direct input, voice command, facial or bodily gesture, or other programmed input. For example, a parent may grant authorization for the function trigger 306 to activate the call monitoring logic 308 by saying “video”. The monitoring preferences 310 establish how and when the monitoring may be utilized. The receiving party may use a do-not-disturb feature to specify that incoming calls are not allowed to monitor the VoIP system 300 regardless of whether they have a pass code or not. In addition to storing remote access preferences, the monitoring preferences 310 may specify times of day that the call monitoring logic 308 may or may not be activated. In another example, a couple out on a date may be able to easily determine whether the babysitter has their children in bed for the night or determine whether the babysitter is still acting responsibly based on the streaming audio and video.
Additionally, the call monitoring logic 308 may be used to visually communicate with children, pets, disabled or handicapped family members, or other individuals that are incapable of answering the VoIP system 300. For example, a wheelchair bound person may be able to speak but may be unable to reach the phone. As a result, the call monitoring logic 308 may activate a video camera or a speaker function of the VoIP system 300 or a linked handset so that the calling party may communicate with the disabled person in the room without the disabled person being required to perform any tasks. The call monitoring logic 308 may be referred to as logic or an audio interface for implementing the monitoring communication described herein. The call monitoring logic 308 may establish whether an alert, prompt, or indicator is played to the user indicating that the VoIP is off-hook in video and/or audio monitoring mode.
The automated settings 312 are instructions for automatically contacting one or more parties. As previously described, the VoIP system 300 may be the calling device that may communicate with an identical or different VoIP enabled-system. The automated settings 312 may include instructions for automatically contact a party or for conveying a message. In one embodiment, the automated settings 312 may be configured to call a party at specified intervals. The call may request a desired input from the receiving party, such as a voice response, facial gesture, or button input. In the event the desired input is not entered, another action may be taken. For example, the VoIP system 300 may be configured to call another VoIP phone in the room of an assisted living facility to check on a user's brother. The call monitoring logic 308 may call the user's brother every four hours during the day or twice a day and play an recorded audio message stating “How are you doing David?” If the user's brother provides a reply that is determined to be fine, the call ends. If however, the user's brother does not respond or responds in the negative that he is not doing well, the VoIP system 300 may take further action. For example, the VoIP system 300 may send an email, text, or video message. Alternatively, the VoIP system 300 may automatically call the user on a specified number or device and then link or bridge the calls so that the user may personally speak or attempt to speak with the user's brother.
The automated settings 312 may store pre-recorded messages or files that are to be played directly to the receiving party or that are to be converted to speech and then played. The automated settings 312 may also store potential responses of a receiving party and actions to take based on the type of response. For example, if no answer is received at the time the user calls, the VoIP system 300 may link with an intercom system of the center or facility and repeat the message or try back at specified intervals to determine the status of the receiving party. The automated settings 312 may store contact information which may include phone numbers, Internet Protocol (IP) addresses, account numbers, email addresses, user names, and other similar communications information.
In another embodiment, the automated settings 312 may be configured to retrieve, lookup, or synchronize schedules, tasks, messages or other information from outside servers, devices, or applications, such as Outlook, Goggle Calendar, and Microsoft Project Manager. For example, the user may enter a message and delivery times using a client device to be synchronized with the automated settings 312 of the VoIP system 300.
In one embodiment, the calling party may configure the automated settings 312 to call the receiving party three times a day at 9:00 a.m., 12:30 p.m., and 5:30 p.m. to remind the receiving party to take medications and to determine how the receiving party is responding to the medications. If the response indicates that the receiving party is not responding well, the automated settings 312 may be configured to send a text message to a wireless device of the calling party and bridge the call to the receiving party's doctor or pharmacist.
The call monitoring logic 308 may control other communications systems within the home. In one embodiment, the VoIP system 300 may be integrated with a specialized bed providing services to a disabled individual. The VoIP system 3008 may also communicate with a home security system or media system. For example, the speakers and microphones of the home security system may be used to further monitor the home and perform intercom communication.
The call monitoring logic 308 may be configured to recognize voice input, motions, gestures, or other input through a video camera or microphone of the VoIP system 300. The user and/or a receiving party may program a library of gestures, motions, or other commands that are to be associated with a specified action. The call monitoring logic 308 may include an algorithm configured to search for and recognize the response and perform an associated action. For example, if the receiving party waves in her hand in a specified manner, the call may be terminated. If however, the user raises both fists, the call monitoring logic 308 may recognize that this image, subject matter, or content as captured by the video camera indicates that the VoIP system 300 is to call 911 immediately and sound an alert. The call monitoring logic 308 may allow a user to pre-record a response in order to recognize responses utilizing comparison, video analysis, facial analysis, or other similar searching, or recognition logic.
FIG. 4 is a flowchart of a process for configuring messages for remote monitoring in accordance with an illustrative embodiment. The process of FIG. 4 may be implemented by one or more VoIP phones or systems. The process may begin by receiving a phone number for a receiving party (step 402). The receiving party may be the party the calling party is calling, such as a child or aging parent. The phone number may alternatively be an IP address, account number, nickname, or other calling or communication information.
The VoIP phone prompts a calling party to enter a message for automatic delivery (step 404). The message may be any type of message for the receiving party. The message may also encompass a question, such as how are you doing today or have you taken your medicine yet today. The use of a message that provides comfort or an inquiry may be especially useful in the event that the user is unable to personally call the receiving party multiple times through out the day, week, or month.
Next, the VoIP records the message from the calling party and receive actions to take based on potential responses (step 406). In one embodiment, the calling party may record the message using the VoIP phone. In another embodiment, the message may be imported, downloaded, or otherwise received by the VoIP phone in the form of a file or other electronic media. The message may be an audio or video message recorded to make the message more personal. In another embodiment, the calling party may enter text that is converted to a voice message using text-to-speech applications utilized by the VoIP phone.
The calling party may also specify any number of expected or desired responses to the message in step 406. In one embodiment, the calling party may agree with the receiving party about potential responses and how they should be dealt with. For example, if the receiving party indicates that she is having a negative response to some new medications, a phone call may be bridged to a wireless device of the calling party and the receiving party's pharmacist.
The responses may also be recorded from the receiving party or the calling party. The response may be any number of actions that may be received or recorded by the VoIP phone. The responses may include voice responses, selections made utilizing the VoIP phone or a wireless device linked with the VoIP phone, bodily, motions, or facial, gestures, or other video-based responses. The response may be based on the physical abilities or capacity of the receiving party. For example, the receiving party maybe temporarily incapacitated and only able to give responses by blinking. The VoIP phone may use a video camera to receive the blinking response and make a determination what the response means or how it is to be categorized for taking an action. In one embodiment, a library of potential responses may be linked with any number of actions.
The responses may then be linked with any number of actions that are to be taken by the VoIP phone. The actions may include sending additional text, voicemail, email, or voice messages to a designated number or device, bridging a phone call, changing the interval of the call, engaging an intercom, activating an alarm or other networked system, or reattempting the automated message. In some cases, there may be no response to the message because the user is away from the phone, sleeping, unconscious, or otherwise unavailable. The actions may also indicate an action to take when no response is received, such as attempting the call and automated message again at a shortened interval of fifteen minutes instead of four hours.
Next, the VoIP phone receives monitoring preferences (step 408). The monitoring preferences may specify further details regarding how the call is made or implemented. For example, the monitoring preferences may specify whether the response is recorded, whether audio and video are available and other elements for implementing the remote monitoring or automated message.
FIG. 5 is a flowchart of a process for remote monitoring in accordance with an illustrative embodiment. The process of FIG. 5 describes a remote monitoring for a caller 502 and a VoIP phone 504. The caller 502 may be utilizing a VoIP system or phone to perform the monitoring as described in FIG. 5. Alternatively, the caller 502 may use any number of devices enabled for video communication.
The process begins with the caller 502 dialing a VoIP phone (step 506). In another embodiment, a secondary VoIP phone may automatically call the VoIP phone 504 as a pre-programmed function or setting.
The VoIP phone 504 prompts the caller for a pass code (step 508). In one embodiment, during step 508, the VoIP phone 504 may play a prompt, alert, or indicator that informs the caller 502 that remote monitoring may be available. The prompt of step 508 may be played or activated during the ring back period for allowing the caller 502 to enter a selection. In another embodiment, the VoIP phone 504 may not play a prompt in order to enhance security and the privacy of a receiving party utilizing the VoIP phone 504.
Next, the caller 502 enters the pass code (step 510). The pass code may be a button sequence, voice signal, command, or other information that authorizes the caller 502 to perform a monitoring feature. Next, the VoIP phone 504 determines whether the pass code is correct (step 512). If the pass code is not correct, the process terminates. The pass code ensures that unauthorized parties are not able to monitor the home to avoid privacy and security issues.
If the pass code is correct in step 512, the VoIP phone 504 plays a monitor alert (step 514). The monitor alert may indicate to any individuals in the home that the phone is about to enter a monitor mode. The monitor alert may or may not be played based on the preferences, permissions, or other authorizations of a receiving party.
Next, the VoIP phone 504 enters a video monitoring mode (step 516). During the video monitoring mode of step 516, the VoIP phone 504 may send and receive regular phone communications or video communications. The caller 502 may be enabled to see or hear anything within range of the VoIP phone 504. In another embodiment, the VoIP phone 504 may also communicate with a handset or other monitoring devices through a Bluetooth, WiFi, or other wireless or wired connection. Monitoring may be terminated when the caller 502 enters user input to terminate the call.
In another embodiment, the pass code may be automatically entered by a VoIP device pre-programmed by the caller 502 to send an automated message. Once, the video monitoring mode is activated, the VoIP device may play an automated message to the VoIP phone 504. The automated message may be a comment, message of encouragement, information, or an inquiry? In one example, the message asks how an elderly family member is doing. The response may be received by the VoIP phone 504 and transmitted back to the VoIP system or device. The response may be analyzed by the VoIP phone 504 or the VoIP device linked with the caller 502 to determine whether a pre-defined action linked with the response should be taken. For example, if a sequential blinking response indicates that the elderly family member in proximity to the VoIP is not doing well, the call may be linked or transferred to a registered work number utilized by the caller 502 so that the caller 502 may personally talk to the user. Alternatively, an email or text message may be sent to the caller 502 utilizing one or more alternative forms of communication.
The features of the present invention may be used independently or in combination to provide improved communications options and security for a user from a VoIP telephone or other similar communications device. The features and services herein described may be implemented as a baby monitor, to monitor remote properties, or for other similar uses or purposes. The previous detailed description is of a small number of embodiments for implementing the invention and is not intended to be limiting in scope. The following claims set forth a number of the embodiments of the invention disclosed with greater particularity.

## Claims

1. A method for remote monitoring a premises through a voice over Internet Protocol (VoIP) phone, the method comprising:
receiving, at the VoIP phone, a telephone call from a calling party remote from the premises;
receiving, at the VoIP phone and through the telephone call, an indicator from the calling party, the indicator configured to activate a video interface of the VoIP phone; determining, at the VoIP phone, whether the indicator authorizes the video interface; activating the video interface of the VoIP phone in response to determining the indicator authorizes the video interface, without interaction from any person at the premises; playing, with the VoIP phone, a monitor alert to indicate that the VoIP phone is monitoring the premises; and
sending video communications over the telephone call for monitoring by the calling party remote from the premises, without interaction from any person at the premises; receiving, via the VoIP phone, one or more automated settings defining an at least one automated event;
executing, with the VoIP phone, the at least one automated event as defined by the one or more automated settings;
determining, with the VoIP phone, whether the at least one action requires an acknowledgment from a person at the premises; in response to determining that the at least one action requires the acknowledgment, determining, at the VoIP phone, whether the acknowledgment is an affirmative response or a negative response;
performing, with the VoIP phone, a first action in response to determining that the acknowledgment is an affirmative response, as defined in the one or more automated settings; and performing, with the VoIP phone, a second action in response to determining that the acknowledgment is a negative response, as defined in the one or more automated settings; wherein at least one of the first or second action is to call 911 and sound an emergency alert; and wherein at least one of the first or second action is to call one or more recipients via the VoIP phone.

2. The method according to claim 1, wherein the indicator is a pass code and wherein the method further comprises: prompting the calling party for the pass code; determining whether the pass code is correct.

3. The method according to claim 1, wherein the VoIP phone provides no indication that monitoring is being performed.

4. The method according to claim 1, further comprising: recording, with the VoIP phone, the monitored video communications.

5. The method according to claim 1, wherein the acknowledgment directly specifies at least one of the first or second action to be performed.

6. The method according to claim 1, wherein at least one of the first or second action is a message sent to one or more recipients.

7. A VolP phone comprising: a processing unit; and a memory configured to store a non-transitory set of instructions executable by the processing unit, the set of instructions comprising: instructions to receive, at the VolP phone, a telephone call from a calling party remote from the premises; instructions to receive, at the VolP phone and through the telephone call, an indicator from the calling party, the indicator configured to activate a video interface of the VolP phone; instructions to determine, at the VolP phone, whether the indicator authorizes the video interface; instructions to activate the video interface of the VolP phone in response to determining the indicator authorizes the video interface, without interaction from any person at the premises; instructions to play a monitor alert to indicate that the VolP phone is monitoring the premises; and instructions to send video communications over the telephone call for viewing by the calling party remote from the premises, without interaction from any person at the premises; instructions to receive one or more automated settings defining an at least one automated event; instructions to execute the at least one automated event as defined by the one or more automated settings; instructions to determine whether the at least one action requires an acknowledgment from a person at the premises; instructions to determine, in response to determining that the at least one action requires the acknowledgment, whether the acknowledgment is an affirmative response or a negative response; instructions to perform a first action in response to determining that the acknowledgment is an affirmative response, as defined in the one or more automated settings; and instructions to perform a second action in response to determining that the acknowledgment is a negative response, as defined in the one or more automated settings; wherein at least one of the first or second action is to call 911 and sound an emergency alert; and wherein at least one of the first or second action is to call one or more recipients via the VoIP phone.

8. The VoIP phone according to claim 7, wherein the indicator is a pass code and wherein the set of instructions further comprises: instructions to prompt the calling party for the pass code; instructions to determine whether the pass code is correct.

9. The VoIP phone according to claim 7, wherein the VoIP phone provides no indication that monitoring is being performed.

10. The VoIP phone according to claim 7, wherein the set of instructions further comprises: instructions to record, with the VoIP phone, the monitored video communications.

11. The VoIP phone according to claim 7, wherein the acknowledgment directly specifies at least one of the first or second action to be performed.

12. The VolP phone according to claim 7, wherein at least one of the first or second action is a message sent to one or more recipients.