Enhanced incoming call notifications

Methods and systems are provided for providing enhanced incoming call notifications for users who utilized a relay application designed for those with speech, visual, or hearing impairments or disabilities. An indication that a calling party is attempting to initiate an incoming call intended for a receiving party that utilizes a relay application that assists users having hearing, visual, or speech disabilities is received by an intermediate party. A chat session is established utilizing the relay application between the intermediate party and the calling party. Additionally, a Voice over Internet Protocol (VoIP) session is established that does not include a voice session. Upon the chat session being terminated from within the relay application, the VoIP session is terminated.

SUMMARY

The present disclosure is directed, in part, to providing enhanced and improved notifications to users who utilize a relay application intended for those with speech, hearing, and vision disabilities. When a calling party initiates a call to a receiving party, an intermediate party, typically associated with a carrier, receiving the incoming call and identifies the receiving party, or the party to whom the call is intended. A Voice over Internet Protocol (VoIP) session is them established between the calling party and the receiving party. The use of a VoIP session causes an improved and enhanced notification to be displayed on the user device of the receiving party as the receiving party is being notified of an incoming call. Additionally, a priority-based notification may be used, such as through a server of the user device's operating system, so that the receiving party receives the incoming call notification in real-time or near real-time. Once the receiving party accepts the call, a chat session is initiated through the relay application used by the receiving party or the calling party. While the VoIP session continues until the chat session has been terminated, a voice or audio session is not established, as communications between the parties occur through the chat session.

DETAILED DESCRIPTION

Generally, aspects are provided herein for enhancing and improving notifications displayed on a user device of a user who utilizes and/or subscribes to a relay application, such as an application designed for those with a hearing, speech, and/or visual disability. Relay applications allow for a user with one or more of these disabilities to effectively communicate with others, whether or not the other person utilizes or subscribes to the relay application.

Typically, relay applications use standard notification systems such that the notifications provided to the receiving party of a call, where that receiving party utilizes the relay application, provided only a short period of time for the receiving party to accept or decline the call. In these scenarios, once the user has accepted, declined, or not answered the incoming call, an indication of the call is not displayed in the user device's call log, but instead may be provided as a notification, such as within a notification center of the user device. As such, the call is treated only as a call that is received through the relay application, and the provided notifications can easily be missed by the user. Because a standard notification system is used, the receiving party may not even be presented with an incoming call notification until after the call has been terminated, such as for the receiving party not answering the call within the allotted time. This is because priority notifications are prioritized by the server, and other notifications from applications, such as those through a relay application, are handled after the priority notifications.

To improve on the current notifications, aspects include utilizing a priority-based notification system, which, through a server associated with the operating system of the receiving party's user device, ensures that incoming call notifications are received in real-time or near real-time. Additionally, VoIP technology is utilized. While we refer to the enhanced call notifications as being used for the receiving party, similar types of notifications would be displayed if the calling party instead was the party using the relay application for a speech, hearing, and/or vision disability. Instead of simply establishing a chat session between the calling and receiving parties, where one of the parties utilizes a relay application, here, a VoIP session is additionally created to provide enhanced and improved incoming call and other notifications to the user. Even more than the incoming call notifications, a call log, such as a missed call log, incoming call log, etc., of the user device would now include an indication of the call, which is now possible since a VoIP session has been established. Even though a VoIP session is established, it is noted that an audio or voice session is not established, as communications between the calling and receiving parties in aspects provided herein take place through the chat session, which is hosted within the relay application. Once the chat session is terminated, the VoIP session is also terminated. But the VoIP session persists throughout the call between the calling and receiving parties. Another reason for utilizing a VoIP session is that if a second or otherwise subsequent call is received by the receiving party while the receiving party is in a chat and VoIP session with the first calling party, the receiving party would have the option to continue with the current call, or switch to the new call, as would be the case if one of the parties were not utilizing the relay application, as described herein.

In a first aspect, one or more computer-readable media having computer-executable instructions embodied thereon are provided that, when executed, perform a method for enhancing notifications associated with an incoming call. The method includes receiving, from an intermediate party, an indication that a calling party is attempting to initiate an incoming call intended for a receiving party that utilizes a relay application that assists users having hearing, visual, or speech disabilities, and establishing a chat session utilizing the relay application between the intermediate party and the calling party. The method further includes establishing a Voice over Internet Protocol (VoIP) session that does not include a voice session, and upon the chat session being terminated from within the relay application, disconnecting the VoIP session.

In a second aspect, a method is provided for enhancing notifications associated with an incoming call. The method includes receiving, at an intermediate party, an indication that a calling party is attempting to call a receiving party; and subsequent to receiving the indication, establishing a VoIP session between the calling party and the receiving party, wherein the VoIP session includes a chat session but does not include a voice session, and wherein the chat session is established using a relay application for users with a hearing, vision, or speech disability. Further, the method includes receiving an indication that the calling party has accepted an incoming call associated with the VoIP session, and continuing the VoIP session until the chat session has been disconnected.

In a third aspect, a system is provided for enhancing notifications associated with an incoming call. The system includes a processor and one or more computer storage hardware devices storing computer-usable instructions that, when used by the processor, cause the processor to perform a method. The method includes, upon receiving an indication from a calling party to establish a chat session with a receiving party, establishing a VoIP session between the calling party and the receiving party, wherein the VoIP session includes a chat session but does not include a voice session, and wherein the chat session is established using a relay application for users with a hearing, vision, or speech disability. Further, the method includes receiving an indication that the receiving party has declined an incoming call associated with the VoIP session or a threshold of time for the notification to appear on a user device associated with the receiving party has expired, and disconnecting the chat session between the calling party and the receiving party.

Throughout the description herein, several acronyms and shorthand notations are used to aid the understanding of certain concepts pertaining to the associated methods, systems, and computer-readable media. These acronyms and shorthand notations are solely intended for the purpose of providing an easy methodology of communicating the ideas expressed herein and are in no way meant to limit the scope of the present invention.

Further, various technical terms are used throughout this description. An illustrative resource that fleshes out various aspects of these terms can be found in Newton's Telecom Dictionary, 31st Edition (2018).

Referring toFIG. 1, an exemplary network environment is provided in which implementations of the present disclosure may be employed. Such a network environment is illustrated and designated generally as network environment100. Network environment100is but one example of a suitable network environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the network environment be interpreted as having any dependency or requirement relating to any one or combination of components illustrated.

FIG. 1illustrates a calling party102, which may initiate a call with receiving party112. In aspects, calling party102communicates through a wireless communications network, through cell site104, to an intermediate party106. Intermediate party106is typically associated with the wireless communications network, and may be a network operator, for example. Intermediate party106is generally responsible for establishing a VoIP session and a chat session. The chat session is initiated within relay application110, which, in the aspect of thisFIG. 1, is being utilized by receiving party112. Intermediate party106communicates with the device operating system server108, also termed a second intermediate party herein, to provide a notification to receiving party112of the incoming call. The notifications used herein are priority-based notifications instead of regular push notifications, meaning that the receiving party112will receive incoming call notifications in real-time or near real-time. In some aspects, device operating system server108is associated with the operating system (e.g., iOS, Android) of receiving party's112device.

As shown, calling party102includes a communication link to the cell site104. Communications links, such as the wireless telecommunication links shown inFIG. 1between user device and cell site104, may be a short-range connection, a long-range connection, or a combination of both a short-range and a long-range wireless telecommunications connection. When we refer to “short” and “long” types of connections, we do not mean to refer to the spatial relation between two devices. Instead, we are generally referring to short-range and long-range as different categories, or types, of connections (i.e., a primary connection and a secondary connection). A short-range connection may include a Wi-Fi connection to a device (e.g., mobile hotspot) that provides access to a communications network, such as a WLAN connection using 802.11 protocol. A short-range connection may also utilize mobile broadband, which provides wireless Internet access using a mobile broadband router. One example of mobile broadband technology is Evolution Data Optimized, or EVDO. EVDO relies on a signal from a wireless tower rather than a physical connection like a phone line or cable. An EVDO modem receives the signal and allows a user to connect to the Internet. Another example of mobile broadband is HSPA. A long-range connection may include a connection using one or more of CDMA, GPRS, GSM, TDMA, 802.16, and the like.

In network environment100, user devices may take on a variety of forms, such as a personal computer (PC), a user device, a smart phone, a smart watch, a laptop computer, a mobile phone, a mobile device, a tablet computer, a wearable computer, a personal digital assistant (PDA), a server, a CD player, an MP3 player, a global positioning system (GPS) device, a video player, a handheld communications device, a workstation, a router, an access point, and any combination of these delineated devices. In some aspects, user devices102and112can correspond to computing device800inFIG. 8. Thus, a user device can include, for example, a display(s), a power source(s) (e.g., a battery), a data store(s), a speaker(s), memory, a buffer(s), a radio(s), and the like. In some implementations, calling party102or receiving party112may comprise a wireless or mobile device with which a wireless telecommunication network(s) can be utilized for communication (e.g., voice and/or data communication). In this regard, the user device can be any mobile computing device that communicates by way of a wireless network, for example, a 3G, 4G, 5G, LTE, CDMA, or any other type of network.

FIGS. 2-7are screenshots of users utilizing the relay application. Starting initially withFIG. 2,FIG. 2illustrates a screenshot200of an incoming call notification, such as when a phone is unlocked, as may be received by a receiving party. As discussed, this enhanced notification of an incoming call is available because a VoIP session has been established between the parties, even though for communications purposes, only a chat session is utilized. Without the use of VoIP and a priority-based notification system, this incoming call notification may not be provided to the user device in real-time, and could even not be displayed until after the call has ended. While the incoming call notification ofFIG. 2may look like a standard notification to some, when a relay application is utilized to connect a calling party and a receiving party (who may utilize the relay application because of a vision, hearing, and/or speech disability), there would typically not be a need for a voice/audio session, and as such, this type of notification would not be presented to the receiving party to accept or decline a call. Instead of being initiated by a device operating system server (e.g., Android, iOS), as is the case with the notification ofFIG. 2, the standard call notification would come from the relay application, and does not look like a call notification when voice/audio is being utilized between the parties. Another advantage of establishing a VoIP session even though the parties do not communicate using a voice/audio session is that the party utilizing the relay application is able to minimize the call window, which then causes a ribbon or bar on the display that allows the user to go back to the call screen at any time.

FIG. 3illustrates a screen shot300of an initial chat session between the calling party and the intermediate party, which, as shown here, indicates to the calling party that the operator is attempting to connect with the receiving party. In some aspects, the calling party, to initiate a call with the receiving party, does not actually call a phone number associated with the receiving party if the receiving party is the one using the relay application, but instead calls a number associated with the relay application/system. Then, the system/operator calls the number associated with the receiving party.

Turning now toFIG. 4,FIG. 4illustrates a screen shot400of an ongoing VoIP session simultaneous to the chat session. The VoIP session persists until the chat session has been terminated, even though the VoIP session is not used for communications between the parties. As mentioned, the parties communicate through the chat session, which is established through the relay application, as a voice/audio session is not established through the VoIP session. Aspects herein thus allow the user of the relay application to move between the call interface and the chat session.

FIG. 5illustrates a screen shot500of an exemplary call log which includes multiple calls to/from another party using a relay application. For example, for a recent call that took place, the call would be identified in this list. It can be included here, as a VoIP session has been established, where otherwise it would not have. Previously, when a relay application was used, the call, such as a missed call, may have been shown in a notification center where notifications from other applications are displayed. However, since a VoIP session is established, the call actually shows as a missed call in the device's call log.

FIG. 6illustrates a screen shot600of an exemplary incoming call notification, which may be displayed when the user's device is locked. The rationale for how the enhanced call notification is displayed on the user's device is the same as inFIG. 2, which, in short, is that a VoIP session is established, even though it isn't used for the actual communications between the users.

Referring toFIG. 7,FIG. 7illustrates a screen shot700of an interface as a call is taking place. Again, the “call,” once the VoIP session is established, is a chat session between the parties within the relay application, whether one or more of the parties communicates via speech/voice, text using a keyboard of a device, a keyboard that accepts braille inputs, and outputs braille, etc. Although the VoIP session persists until the chat session is terminated, the VoIP session does not include a voice/audio session, and thus is not substantively used for communications between the parties.

Referring toFIG. 8, a diagram is depicted of an exemplary computing environment suitable for use in implementations of the present disclosure. In particular, the exemplary computer environment is shown and designated generally as computing device800. Computing device800is but one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should computing device800be interpreted as having any dependency or requirement relating to any one or combination of components illustrated.

With continued reference toFIG. 8, computing device800includes bus802that directly or indirectly couples the following devices: memory804, one or more processors806, one or more presentation components808, input/output (I/O) ports810, I/O components812, and power supply814. Bus802represents what may be one or more busses (such as an address bus, data bus, or combination thereof). Although the devices ofFIG. 8are shown with lines for the sake of clarity, in reality, delineating various components is not so clear, and metaphorically, the lines would more accurately be grey and fuzzy. For example, one may consider a presentation component such as a display device to be one of I/O components812. Also, processors, such as one or more processors806, have memory. The present disclosure hereof recognizes that such is the nature of the art, and reiterates thatFIG. 8is merely illustrative of an exemplary computing environment that can be used in connection with one or more implementations of the present disclosure. Distinction is not made between such categories as “workstation,” “server,” “laptop,” “handheld device,” etc., as all are contemplated within the scope ofFIG. 8and refer to “computer” or “computing device.”

Memory804includes computer-storage media in the form of volatile and/or nonvolatile memory. Memory804may be removable, nonremovable, or a combination thereof. Exemplary memory includes solid-state memory, hard drives, optical-disc drives, etc. Computing device800includes one or more processors806that read data from various entities such as bus802, memory804or I/O components812. One or more presentation components808presents data indications to a person or other device. Exemplary one or more presentation components808include a display device, speaker, printing component, vibrating component, etc. I/O ports810allow computing device800to be logically coupled to other devices including I/O components812, some of which may be built in computing device800. Illustrative I/O components812include a microphone, joystick, game pad, satellite dish, scanner, printer, wireless device, etc.

Radio816represents a radio that facilitates communication with a wireless telecommunications network. Illustrative wireless telecommunications technologies include CDMA, GPRS, TDMA, GSM, and the like. Radio816might additionally or alternatively facilitate other types of wireless communications including Wi-Fi, WiMAX, LTE, or other VoIP communications. As can be appreciated, in various embodiments, radio816can be configured to support multiple technologies and/or multiple radios can be utilized to support multiple technologies. A wireless telecommunications network might include an array of devices, which are not shown so as to not obscure more relevant aspects of the invention. Components such as a base station, a communications tower, or even access points (as well as other components) can provide wireless connectivity in some embodiments.