Method and system for electronic communication with the hearing impaired

A system and method for electronic communication with the hearing impaired is disclosed, which includes a video relay service having a video relay service application configured to receive the called party number over the first connection and request interpretive services. The video relay service application, initiates when interpretive services are available. The video relay service times a duration of concurrent connection of the first and second connections.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to telecommunication services between a deaf or hearing-impaired person and a nonhearing-impaired or hearing-capable person. More particularly, the invention relates to the establishment of a communication session between a hearing-impaired and a hearing-capable user that enables the hearing-impaired user to communicate using efficient communicative techniques, such as through the use of sign language.

2. State of the Art

Text-based communication devices (e.g., TTY devices) have been used to facilitate the flow of conversation between a hearing-impaired party and a hearing-capable party. However, even with the best technology implemented, such a solution does not convey the emotion or visual cues that are vital to human communication. Additionally, while text-based messaging is convenient and easy to implement, such a method of communication is a more inefficient means of communication for the hearing impaired.

Under the guidance of Title IV of the Americans with Disabilities Act of 1990, telecommunication services were mandated to provide hearing-and speech-impaired parties with functional equivalents of the telecommunication services of hearing-and speech-capable parties. Accordingly, various approaches were implemented with one being a Video Relay Service (VRS). The VRS was developed to allow hearing-impaired users to converse in sign language over an imaging device with hearing-capable users that utilize standard telecommunication services, such as the Public Switched Telephone Network (PSTN). Various implementations of establishing a communication session between a hearing-impaired party and a hearing-capable party have been proposed and implemented. To present, the establishment of such a communication channel has required significant human intervention and a significant amount of time to establish a communication session that is facilitated by an intermediary, such as an interpreter.

BRIEF SUMMARY OF THE INVENTION

The present invention is directed to a method and system for electronic communication with the hearing impaired. In one embodiment of the present invention, a video relay service is provided. The video relay service includes a video relay service application configured to receive the called party number over the first connection and request interpretive services. The video relay service application is further configured to be responsive to the availability of the interpretive services and to initiate in response thereto a second connection with a hearing-capable user according to the called party number. The video relay service times a duration of concurrent connection of the first and second connections. The video relay service further includes interpretive services including an interpretive terminal configured to effectuate the interpretive services between the hearing-impaired user of the first connection and the hearing-capable user of the second connection.

In another embodiment of the present invention, a method for electronic communication with a hearing-impaired user is provided. The method includes receiving a called party number at a video relay service in response to a first connection with a video phone of the hearing-impaired user, the called party number designating a voice phone of a hearing-capable user. Furthermore, in response to receiving the called party number, the method further includes requesting an interpreter terminal to effectuate interpretive services during a communication session between the hearing-impaired user and the hearing-capable user. The interpreter terminal initiates a second connection with the voice phone according to the called party number and when the second connection is established, timing a duration of time when the first connection and the second connection are concurrent.

In yet another embodiment of the present invention, a method for electronic communication with a hearing-impaired user is provided. The method includes receiving a called party number at a video relay service in response to a first connection with the hearing-capable user, the called party number designating a telephone of a hearing-impaired user. Furthermore, in response to receiving the called party number, the method further includes requesting an interpreter terminal to effectuate interpretive services during a communication session between the hearing-capable user and the hearing-impaired user. Thereafter, the interpreter terminal initiates a second connection with a hearing-impaired user according to the called party number and when the second connection is established, a duration of time is measured during concurrent connection between the first connection and the second connection.

In yet a further embodiment of the present invention, a method for communicating between a hearing-impaired user and a hearing-capable user is provided. The method includes establishing a first communication connection between a video phone and a video relay service and forwarding a called party phone number to the video relay service. The method further includes establishing according to the called party number a second communication connection between the video relay service and the voice phone and interpreting between video and audio information for receipt and delivery to the video phone and the voice phone, respectively.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1illustrates a hearing-impaired communication system configured to facilitate a communication session between a hearing-impaired user and a hearing-capable user, in accordance with an embodiment of the present invention. A hearing-impaired communication system10enables a hearing-impaired user14to engage in conversation through a communication system with a hearing-capable user16. A communication session between the users is facilitated through the use of various equipments, which are preferably coupled together using various networks, including a telephone network, such as the Public Switch Telephone Network (PSTN).

To interface a hearing-impaired user into a generally voiced-based communication system, interpretive services are employed, which allow hearing-impaired users to communicate with an interpreter, namely through sign language. The sign language images are then translated by video relay service20and when translated into voice information, are then forwarded over a voice-based communication connection to a hearing-capable user. One means for relaying the communicative expressions of a hearing-impaired user14within hearing-impaired communication system10incorporates a video phone12for capturing and displaying the communicative expressions exhibited by hearing-impaired user14and for displaying interpreted voice information originating from the hearing-capable user. The expressions, such as sign language and/or body language, may be interpreted or translated by video relay service20. Hearing-capable user16interacts in a conventional manner with video relay service20through the use of a voice-based dialogue conveyed over a conventional telephone or voice phone22. The various devices, such as video phone12and voice phone22, are coupled to video relay service20using one or more networks17,18. To facilitate the enhanced bandwidth needs of video phone12, network17may be implemented as a high bandwidth network such as a DSL, Cable, Ethernet or other enhanced-bandwidth networking technology. Network18may be implemented according to the standards and bandwidth requirements of voice phone22.

FIG. 2is a simplified diagram of a hearing-impaired communication system10, in accordance with an embodiment of the present invention. To facilitate the interaction with a hearing-impaired user, a video phone12includes video components, including a camera24for capturing the communicative expression of the hearing-impaired user and further includes a display or monitor26for displaying the communicative expressions originating from the hearing-capable user as interpreted by the video relay service20.

Video phone12, in accordance with an embodiment of the present invention, further includes a keypad28or other data entry device configured to enable a hearing-impaired user to initiate a communication session in a conventional manner by entering the telephone number of the hearing-capable user, also known herein as a called party telephone number32. In accordance with one embodiment of the present invention, the hearing-impaired user is able to interact with video phone12to initiate a phone call in a manner consistent with the interaction of a hearing-capable user initiating a phone call using a conventional telephone22. Specifically, a hearing-impaired user enters, using an input device such as a keypad28, the called party number that is captured by a control process30and stored as a captured called party number32.

Control process30retrieves a stored VRS number34and uses the stored VRS number34for initiating a connection over network17to form a communication session between video phone12and video relay service20. The stored VRS number34may be a network address, such an IP address of the video relay service provider, configured to perform interpretive services. Upon the establishment of a communication link, video phone12, through the use of control process30, passes the captured called party number32for use by video relay service20in the establishment of a call between video relay service20and a conventional telephone22of the hearing-capable user over telephone network18.

FIG. 3is a functional block diagram of a hearing-impaired communication system10including a video relay service20configured in accordance with an embodiment of the present invention. The video phone12and voice phone22interoperate via video relay services20as further coupled via network17,18. Video relay services20minimizes operator interaction for establishing a communicative connection between a hearing-impaired user and a hearing-capable user. While the functionality that occurs within video relay services20are discussed herein with specific groupings of functionality within specific functional or operative blocks, the respective functionality may be reallocated to other operative blocks or portions resulting in an acceptable and functional service. Such modifications and partitioning are contemplated to be within the scope of the present invention.

Video relay services20includes a VRS application36that provides generalized control and sequencing of the relay services. VRS application36is preferably implemented as executable software operating on a computational platform, such as a computer or other executable device. VRS application36operatively interfaces the video relay services20to external network17,18coupled to both the hearing-impaired user via video phone12and hearing-capable user via voice phone22, respectively.

VRS application36is configured to interface with network17,18to both initiate and receive calls placed thereto. When the video relay service20receives a call from a hearing-impaired user, the VRS application36receives therein a called party number as originally input by the hearing-impaired user. The called party number designates a target hearing-capable user and is stored within video relay services20in called party number storage38. The video phone12and VRS application36receive and store the called party number to emulate conventional dialing and initiation of a phone call from the perspective of a hearing-impaired user.

VRS application36further requests interpretive services40to interpret or translate communicative interaction between hearing-impaired and hearing-capable users. In one embodiment of the present invention, while waiting to determine if services are available42, video relay services20further include a hold server44, which gives the calling party the sense of being on hold for a temporary amount of time while switching and call routing take place, in addition to any latency associated with the availability of interpretive services40.

Interpretive services40includes an interpretive terminal46that provides an interactive environment for an interpreter48, which may be implemented as an automated service or may be configured as a human operator. To facilitate such an interface with interpreter48, interpretive terminal46further includes a video interface50, namely a video display and camera, for engaging in a video-based connection with video phone12. Furthermore, to facilitate an interface with voice phone22, interpretive terminal46further includes a voice interface52for facilitating communication between interpreter48and a hearing-capable user utilizing voice phone22.

When video relay services20are applied to a commercial environment, timing of the connection with the interpretive services is important in order to provide an accurate measurement for use in billing for the interpretive services. Interpretive services generally commence once concurrent connections are established between video phone12and interpretive services40and between voice phone22and interpretive services40. Any delay in measuring the concurrency of the connection may result in lost revenues. In accordance with an embodiment of the present invention, when such connections are concurrent, an interpretation timer54is started and is maintained until one or both connections are terminated or dropped. A call termination or drop monitor56determines when to end or stop interpretation timer54, while a concurrent connections monitor58determines when to commence or start timing of interpretive services.

The establishment of a communication session between a hearing-impaired user and a hearing-capable user may be initiated by either party. Accordingly,FIG. 4is a flow diagram illustrating a call initiated by a hearing-impaired user, in accordance with an embodiment of the present invention whileFIG. 5is a flow diagram illustrating a call initiated by a hearing-capable user directed toward a hearing-impaired user, in accordance with another embodiment of the present invention.

With reference toFIG. 4, a hearing-impaired user utilizing video phone12initiates a call to a hearing-capable user by inputting the telephone number of the hearing-capable user. Video phone12retrieves a number stored therein, namely the stored VRS number34(FIG. 2) and stores the captured call party number32(FIG. 2) within video phone12. Using the stored VRS number34(FIG. 2), video phone12initiates110a connection to video relay services20(FIG. 3), which, in one embodiment of the present invention, is routed to VRS hold server44while awaiting the availability of interpreter. In one embodiment of the present invention, the VRS hold server44issues a call request112to the VRS application36informing the VRS application36of the request for a communication session between a hearing-impaired user and a hearing-capable user.

In response thereto, and when services become available as determined by an available service42(FIG. 3), VRS application36notifies114the VRS hold server44that interpretive services are available. Thereupon VRS hold server44transfers116the video call to VRS application36, which initiates118a call to voice phone22according to the received called party number38(FIG. 3) as received from video phone12. When the call placed voice phone22is answered120by a hearing-capable user forming a connection122between voice phone22and video relay services20interpretation timer54is activated to time the concurrent session formed by connections122and124. When the call/connection is dropped56(FIG. 3) by either user, then interpretation timer54stops and the duration of the interpretive session may be recorded for monitoring or billing purposes. With reference toFIG. 4, the call may be released126,128by VRS application36, which releases connection122, followed by subsequent release130,132of connection124.

FIG. 5is a flow diagram illustrating a call initiated by a hearing-capable user directed to a hearing-impaired user, in accordance with an embodiment of the present invention. A voice phone22, under the direction of a voice-capable user, requests interpretive services for communicating with a hearing-impaired user by calling VRS140a video relay service20using an available or known VRS telephone number. Video relay services20include a hearing-capable initiated call service142, which requests from the hearing-capable user an IP address or a mappable phone number of the hearing-impaired user. Such an inquiry may occur through an automated or manual means, such as through the use of a recorded message that requests the hearing-capable user to key in the telephone number of the targeted hearing-impaired user.

The hearing-capable initiated call service142initiates144call request to VRS application36, which then takes146and transfers138the call to VRS application36. VRS application36initiates148a call to video phone12and when answered150, starts or activates interpretation timer54. As previously described, interpretation timer54resumes timing of the interpretive session through the duration of the concurrency of both connections150,152until one or both connections150,152are released. With reference toFIG. 5, VRS application36releases154,156connection150causing interpretation timer54to stop timing the duration of the interpretive services. Similarly, VRS application36releases158,160connection152whereupon the communication session between the hearing-capable user and the hearing-impaired user is terminated.

While one sequencing of the termination of connections is illustrated with reference toFIG. 4andFIG. 5, it is also contemplated that either or both users may terminate the connection thereby causing interpretation timer54to suspend measurement of a timing duration of the interpretive services. It is also contemplated that the hearing-capable initiated call service142ofFIG. 5may be implemented in an automatic manner or may be implemented using human intervention.