# Patent

## Title
Automated attendant multimedia session

## Abstract

An automated attendant system is made multimedia capable by adding a combined user agent to the automated attendant. A search is done to verify that the caller to the automated attendant has combined user agent capabilities. If so, the caller receives multimedia content from the automated attendant's combined user agent so that the content may be presented on the caller's computer to assist the caller in navigating through the automated attendant's menus and options. Upon selection of a desired connection from the menus and options, the automated attendant's combined user agent helps the caller be connected by voice to the selected connection.

## Background
CROSS-REFERENCE TO RELATED APPLICATION
The present application is a continuation of U.S. patent application Ser. No. 13/047,362, filed on Mar. 14, 2011; and U.S. Pat. No. 7,920,546, which issued on Apr. 5, 2011, the disclosures of which are hereby incorporated by reference in their entirety.


FIELD OF THE INVENTION
The present invention provides for multimedia sessions between a caller and an automated attendant.
BACKGROUND OF THE INVENTION
Traditional telephony services provided by digital switches, such as digital multiplexing switches, have reached their functional limits with existing user interfaces, which essentially are telephone sets having limited displays and simple keypads. Further, the telephone sets have limited bandwidth. Over newer packet networks, multimedia services are flourishing and are capable of exploiting the capabilities of advanced user terminals, desktop computers, and network appliances.
Currently, the vast majority of voice telephony is provided, at least in part, by traditional circuit-switched networks. Given the extensive infrastructure, reliability, and quality of service, the traditional telephony systems are likely to remain a significant part of communications for the foreseeable future. Unfortunately, there has been difficulty integrating voice sessions over the traditional telephony network with multimedia sessions over packet networks. Users prefer the traditional telephony network for voice, yet the voice network is unacceptable for facilitating advanced multimedia services, such as screen sharing and video conferencing.
The difficulties of integrating voice and multimedia sessions have, to some extent, been solved in commonly owned U.S. patent application Ser. No. 10/028,510, filed 20 Dec. 2001, which is hereby incorporated by reference in its entirety. The applications to which this solution may be put are myriad. For example, many telecommunication service users are frustrated with automated attendants. In particular, a user may place a call and have the call answered by seemingly countless menus and prompts before they can talk to a real person. Thus, there is a need for an option that allows a user to use the multimedia capabilities of their communications equipment to help facilitate the navigation of automated attendants.
SUMMARY OF THE INVENTION
The present invention provides a solution to the needs described above by using a combined user agent to establish a multimedia session between a caller and a called entity that uses an automated response system. In particular, a caller that has multimedia capabilities and uses a combined user agent makes a call to a called entity and passes an indication that the caller has this capability.
The called entity, which also has multimedia capabilities and the use of a combined user agent, learns that the caller has multimedia capabilities and initiates a multimedia session with the caller relating to the automated response system. The caller's computer is used to present the multimedia information to the caller, and the caller may interact with the multimedia information to learn more about selections and options in the automated response system. As the caller navigates through the multimedia information, the caller may be presented the option to select an extension relating to particular portions of the multimedia content. Upon selecting an extension, the caller's telephone may be connected to that extension for a conversation with a real person rather than the automated response system. If the person associated with the extension is not available, the caller may be routed to a voice mail system.
Those skilled in the art will appreciate the scope of the present invention and realize additional aspects thereof after reading the following detailed description of the preferred embodiments in association with the accompanying drawing figures.



BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawing figures incorporated in and forming a part of this specification illustrate several aspects of the invention, and together with the description serve to explain the principles of the invention.
FIG. 1 is a communication environment adapted to support the present invention;
FIG. 2 is a second embodiment of a communication environment adapted to support the present invention;
FIG. 3 is an alternate embodiment of the communication environment of FIG. 2;
FIG. 4 is a block diagram of a combined user agent according to the present invention;
FIG. 5 is a communication environment with a caller and a called entity with multiple potential call termination end points; and
FIG. 6 is a flow chart illustrating the methodology of the present invention.



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
The embodiments set forth below represent the necessary information to enable those skilled in the art to practice the invention and illustrate the best mode of practicing the invention. Upon reading the following description in light of the accompanying drawing figures, those skilled in the art will understand the concepts of the invention and will recognize applications of these concepts not particularly addressed herein. It should be understood that these concepts and applications fall within the scope of the disclosure and the accompanying claims.
The functionality of the present invention relies, in its preferred embodiment, on the previously incorporated '510 patent application for some of its functionality. It should be appreciated that other techniques of facilitating the same functionality are also possible, but that for the purposes of explanation, the present invention will use the elements of the '510 application, which explained an efficient unification of parallel voice and multimedia sessions, wherein the voice session takes place in part over a traditional circuit-switched telephony network. A call signaling agent is created to control packet-based multimedia sessions, as well as to control call signaling at a traditional telephony switch, for a telephone and an associated multimedia device, such as a computer. The multi-functional call processing agent, typically referred to as a combined user agent (CUA), can effectively establish multimedia sessions with the multimedia device and voice calls with the telephone.
The present invention uses the combined call set up and handling procedures to enable callers to receive multimedia content from a called entity that has an automated response system and interact therewith. Once the user has made a selection, the voice portion of the combined call is connected to the selected extension.
For the purposes of a full explanation, the details of a combined user agent and its operation are set forth herein. For more detail, the interested reader is directed to the previously incorporated '510 application. With reference to FIG. 1, a communication environment 10 according to the teachings of the '510 application is illustrated. The communication environment 10 may include a packet network 12 including a CUA 14 and a supporting proxy 16. The CUA 14 acts as a virtual agent for a computing device, such as a computer 18, which is capable of supporting multimedia sessions. The computer 18 may connect to the packet network 12 via a network access 20, which may include a local area network (LAN), frame relay, digital subscriber line, cable, or other such methods.
The CUA 14 also acts as an agent for a traditional telephony device, such as a telephone 22, which is supported by a telephony switch 24, such as a DMS-100 central office switch sold by Nortel Networks Limited of 2351 Boulevard Alfred-Nobel, St. Laurent, Quebec, Canada, H4S 2A9 or a public branch exchange (PBX), that is capable of providing circuit-switched communications between the telephone 22 and other telephony devices. To allow the CUA 14 to interact with and control the telephony switch 24, legacy access 26 is provided between the packet network 12 and the telephony switch 24. The legacy access 26 may be provided by existing intelligent networks (IN), including the advanced intelligent network (AIN), session initiation protocol for telephones (SIP-T) capable networks, TAPI networks, and the like, that provide access to telephony switches 24 to facilitate call signaling. The CUA 14 is configured to establish multimedia sessions over network access 20 with the computer 18 as well as provide call signaling for the telephone 22 through the telephony switch 24 via the legacy access 26.
The present invention is preferably implemented using the session initiation protocol, commonly referred to as SIP, although other standards and protocols could be used without departing from the scope of the present invention. The specification for SIP is provided in the Internet Engineering Task Force's Request for Comments (RFC) 3261: Session Initiation Protocol Internet Draft, which is hereby incorporated by reference in its entirety. In general, SIP is used to establish media sessions between any number of endpoints. Typically, these endpoints may support any number or combination of data, audio, and voice media sessions, depending on the configuration of the device. A SIP endpoint is capable of running an application, typically referred to as a user agent (UA), which is capable of facilitating media sessions using SIP. In certain embodiments, user agents may register their ability to establish sessions with a SIP proxy by sending “REGISTER” messages to the SIP proxy. The REGISTER message informs the SIP proxy of the SIP universal resource locator (URL) that identifies the user agent to the SIP network. The REGISTER message also contains information about how to reach specific user agents over the SIP network, typically by providing the Internet Protocol (IP) address and port that the user agent will use for SIP sessions. When a user agent wants to establish a session with another user agent, the user agent initiating the session may send an INVITE message to the SIP proxy and specify the target user agent in the TO header of the INVITE message. Identification of the user agent takes the form of a SIP URL. The SIP proxy will use the SIP URL in the TO header of the message to determine if the targeted user agent is registered with the SIP proxy. Generally, the user name is unique within the name space of the specified domain.
If the targeted user agent has registered with the SIP proxy, the SIP proxy will forward the INVITE message directly to the targeted user agent. The targeted user agent will respond with a 200 OK message, and a session between the respective user agents will be established as per the message exchange required in the SIP specification. Media capabilities may be exchanged in other messages, such as the SIP “INFO” message. Media capabilities are typically described using the session description protocol (SDP). Once respective endpoints are in an active session with each other and have determined each other's capabilities, the specified media content may be exchanged during an appropriate media session.
According to the Internet Engineering Task Force's RFC 3261, a user agent is an application that contains both a user agent client and a user agent server. A user agent client generally refers to a client application that initiates SIP requests, wherein a user agent server is an application that contacts the user when a SIP request is received, and returns a response on behalf of the user. Typically, the response accepts, rejects, or redirects the received request.
FIG. 1 illustrates the CUA 14, which is an application, program, or function that acts on behalf of a multimedia client, provided by the computer 18 or other computing device, and a telephone 22. The computer 18 may have a SIP user agent, which is represented by the CUA 14. In essence, the CUA 14 will function to control call signaling to effect voice sessions between the telephone 22 and other devices via the telephony switch 24, and other multimedia sessions via the computer 18. Notably, the CUA 14 can effectively facilitate the integration of and association of voice and other multimedia sessions provided by both devices. To devices needing to establish sessions with either the computer 18 or the telephone 22 in a SIP environment, the CUA 14 presents both devices as a single device having voice and other multimedia capabilities. The other devices need not know that the telephone 22 resides on a circuit-switched network.
In one embodiment, the CUA 14 will cooperate with the proxy 16, which is configured as a SIP proxy, in traditional fashion to establish multimedia sessions involving the computer 18. The sessions will be supported across the network access 20 in the packet network 12. With respect to voice communications via the telephone 22, the voice path may take various routes, remaining entirely within the public switched telephone network (PSTN), or venturing into the packet network 12 to communicate with a packet-switched telephony device or simply to bridge to another circuit-switched network.
The communication environment 10 illustrated in FIG. 1 illustrates voice communications between the telephone 22 and a voice-capable packet-switched device 30, such as an IP telephone 30A or a computer 30B. The packet-switched devices 30 are connected to the packet network 12 via a local area network (LAN) 32 to support packet-switched communications. Since the telephone 22 and telephony switch 24 facilitate circuit-switched communications, a gateway (GW) 28 is integrated with the telephony switch 24 or provided as a separate device (as shown) to convert circuit-switched communications to packet-switched communications capable of being transported over the packet network 12 to the desired packet-switched device 30. The connection between the telephony switch 24 and the gateway 28 may be any traditional telephony line or trunk. The gateway 28 appears to the telephony switch 24 as another switching device supporting a variety of telephone numbers, which are associated with the packet-switched devices 30. Typically, the time-division multiplexed (TDM) circuit-switched communications are converted into packets to facilitate voice communications over the Internet Protocol (VoIP). Importantly, although the voice session spans the circuit-switched and packet-switched networks, the CUA 14 represents the telephone 22 to the devices with which it communicates. In essence, the telephone 22 and the computer 18 form a combined legacy client 34, which is represented by the CUA 14.
With reference to FIG. 2, another CUA 14A is provided to support a computer 18A via network access 20A and a circuit-switched telephone 22A, which is supported by telephony switch 24A. The CUA 14A provides call signaling to the telephony switch 24A via legacy access 26A in a similar manner to that described above. Further, the telephony switch 24A is associated with a gateway 28A to convert circuit-switched communications into packet-switched communications for transport over the packet network 12. The communication environment 10 in FIG. 2 illustrates the communication path between telephone 22 and telephone 22A during a voice session being routed over the packet network 12 between the gateways 28 and 28A. Multimedia sessions other than voice sessions between computers 18 and 18A may be established in traditional fashion over the packet network 12. Again, the CUA 14 represents the combined legacy client 34 containing the computer 18 and the telephone 22, whereas the CUA 14A supports the combined legacy client 34A, which is made up of the computer 18A and the telephone 22A. In this embodiment, the CUA 14A is supported by the proxy 16.
With reference to FIG. 3, the CUA 14A may be supported by a separate proxy 16A. Further, the communications between telephone 22 and telephone 22A during a voice session may be supported entirely within the PSTN 36. The CUAs 14 and 14A may provide call signaling not only to the respective telephony switches 24 and 24A, but also to other network elements within the PSTN 36 such that they have enough information to establish an end-to-end connection across the PSTN 36. In short, the CUAs 14 and 14A are configured to provide the necessary call signaling to establish voice sessions that are supported at least partially over the circuit-switched network of the PSTN 36, as well as multimedia sessions with the computer 18 over the packet network 12.
As illustrated in FIG. 4, the CUA 14 is preferably implemented in a control system 38 associated with a packet network interface 40 for communicating over the packet network 12. The control system 38 will support software applications providing a legacy adapter 42, a multimedia client adapter 44, and the basic CUA logic 46. The legacy adapter 42 will provide the necessary protocol adaptation and call signaling control necessary to control the telephony switch 24 in light of SIP or related protocols for establishing media sessions. The multimedia client adapter 44 is used to support sessions with the associated computer 18 or like multimedia device. The multimedia client adapter 44 may provide protocol adaptation as necessary to establish the media sessions of a SIP implementation, wherein when the computer 18 emulates a SIP client, the CUA logic 46 will simply represent the multimedia capabilities of the computer 18 for the non-voice media sessions. The CUA logic 46 will also cooperate with the legacy adapter 42 to provide the necessary call signaling for the telephony switch 24 to control voice communications with the telephone 22. Accordingly, the CUA logic 46 cooperates with the legacy adapter 42 and the multimedia client adapter 44 to provide an interface to the computer 18 as well as an interface to the telephony switch 24, and an interface for communications with other devices, such as the proxy 16. In an exemplary embodiment, the CUA 14 may be incorporated into the Interactive Multimedia Server sold by Nortel Networks Limited of 2351 Boulevard Alfred-Nobel, St. Laurent, Quebec, Canada, H4S 2A9.
Against this backdrop, the present invention is readily implemented. The present invention allows callers that reach automated attendants associated with the called entity to receive multimedia information so as to facilitate selection of a desired connection or option within the automated attendant's options. The communication network 10A in which such a situation may occur is illustrated in FIG. 5. The called entity may be a call center, an enterprise, or other entity with multiple phones 22 that share at least one common PSTN phone number. Collectively, this is represented herein as a user group 35. In prior art implementations, the incoming call can be answered first by a live attendant or operator who then connects the caller to the proper phone 22 within the user group 35. Alternatively, the incoming call can be answered by an automated attendant 50. The automated attendant 50 is representative of any automated response system and may include interactive voice response (IVR) features as needed or desired. Further, the automated attendant 50 may answer any incoming calls to the user group 35 and present the caller with menus and prompts which must be navigated before the caller is connected to the person or information that they seek. For the purposes of the present invention, the final choice is termed an “extension.” While normally the term “extension” implies a particular phone number extension, the present usage is not limited strictly to such situations, but also includes other terminations points, like a recorded announcement, a voice mail system or a call center system. The automated attendant 50 can also accept additional in-band dual tone multi-frequency (DTMF) signaling from the caller to signal which specific extension is to be reached. In both cases the automated attendant 50 signals to the switch 24A to which specific phone 22 from user group 35 the caller needs to be connected.
The present invention provides a technique through which the caller is assisted in the navigation through the menus and selections provided by the automated attendant. The automated attendant 50 is augmented with an automated attendant server 51. The combination of the automated attendant server 51 and the automated attendant 50 creates a hybrid automated attendant 52, which is represented on the network 12 by a CUA 14B. The CUA 14B functions like the CUA 14A, previously described. The automated attendant server 51 communicates with the CUA 14B through any appropriate means and protocols over an access network 54. The hybrid automated attendant 52 uses the CUA 14B for managing its combined voice and media sessions. The CUA 14B may be communicatively connected to a CUA database (DB) 56 that stores what CUAs 14 are associated with what phone numbers and/or addresses. Other profile information may also be stored in CUA database 56 as needed or desired.
The methodology of the present invention is illustrated in FIG. 6. Specifically, a caller dials a number for user group 35 using telephone 22 (block 100). While dialing is one embodiment, the caller may provide an address or identifier for the user group 35 through any appropriate means. User group 35 may be an enterprise, call center, or other location with an automated attendant or automated response system. The switches 24 and 24A set up the call (block 102). The call is then routed to the automated attendant 50 (block 104).
In parallel with the call being routed to the automated attendant, the CUA 14B is informed of the incoming call, the phone number of the caller, and any other information as needed or desired (block 106). The CUA 14B accesses the CUA database 56 to locate an address, typically expressed as a uniform resource locator (URL) or a directory number, for the CUA 14 based on the caller's phone number or other identification element (block 108). Although a single CUA database 56 is shown, a number of CUA databases 56 can be involved in the search for the CUA 14 address, using well known techniques outside the scope of this invention. If the caller does not have multimedia capabilities and does not have a CUA 14, then the search of CUA database 56 will not find a valid entry and the call will be treated like a normal call such that it is handled by the audio-only automated attendant 50. The CUA 14B also retrieves multimedia session information from the automated attendant server 52 (block 110). This information may be extension number, directories, menus, and other multimedia content that may be presented to the caller. Note that this step is optional. The information may remain stored with the automated attendant server 52.
The CUA 14B sets up a session with the CUA 14 (block 112). This may be done by the aforedescribed SIP messages. The CUA 14B sends multimedia content to the computer 18 (block 114) or other multimedia capable device through the CUA 14. In the event that the CUA 14B retrieved the information in block 110, then the CUA 14B sends the information, otherwise, the CUA 14B instructs the automated attendant server 52 to send the information to the computer 18. This multimedia content is used to present the caller with menus and selection options corresponding to those normally audibly presented by the automated attendant 50, but instead of the purely audible options, the caller may be presented with multimedia versions of these options and menus on the computer 18. Further, these options may be supplemented with additional information as needed or desired. The caller can make selections from the multimedia interface presented on computer 18 (block 116). Specifically, the caller may be given the option to perform a query of the directory for user group 35. For example, the caller could type in, using the computer 18, the name of the person or department with whom the caller desires contact. The request would be sent to the automated attendant server 52 which would do the search and send back, to the caller via the computer 18, a list of matching entries. The caller would then simply select a desired entry.
The CUA 14B interprets the selections made by the caller and provides additional options and menus as needed until the caller selects an extension or phone number with which the caller desires to be connected (block 118). The CUA 14B instructs the switch 24A to route the call to the selected destination (block 120), and the caller is connected to the selected extension (block 122).
While the process has been described linearly, it is possible that some of the steps may take place concurrently or in a different order and still fall within the scope of the present invention. Likewise, while the multimedia exchange takes place, a concurrent audio exchange with the audio-only automated attendant 50 may be used in parallel, allowing the caller to make choices in a manner most convenient to the caller.
Note further that while the above process has been described with the CUA 14B of the combined user 35 searching the CUA database 56 for the multimedia capabilities of the caller, it is also possible that the caller may pass along an indication of multimedia capabilities with the original call set up. This may be done by using a flag or similar technique. In an exemplary embodiment, the originating switch determines if the calling party is multimedia capable, and if yes, a flag is added to the call processing message sent toward the called party. The terminating switch checks for the flag and passes information concerning the flag to the CUA 14. Other permutations on this can be performed as needed or desired.
Those skilled in the art will recognize improvements and modifications to the preferred embodiments of the present invention. All such improvements and modifications are considered within the scope of the concepts disclosed herein and the claims that follow.

## Claims

1. A method of enabling a communication session requestor to select communication options using an automated system, the method comprising:
receiving signalling requesting a communication session from a communication function associated with the communication session requestor;
accessing a combined user agent database using an identifier associated with the communication function requesting the communication session to determine a communication function associated with the communication session requestor that can present selectable communication options to the communication session requestor; and
providing information enabling presentation of the selectable communication options to the communication function associated with the communication requestor that can present selectable communication options to the communication session requestor.

2. The method of claim 1, further comprising:
receiving signalling indicating selection of a communication option at the communication function associated with the communication session requestor that can present selectable communication options to the communication session requestor; and
establishing a communication session with the communication function associated with the communication requestor that can present selectable communication options to the communication session requestor in response to the signalling indicating selection of a communication option.

3. The method of claim 2, wherein establishing the communication session comprises configuring the communication session based on the selected communication option.

4. The method of claim 3, wherein establishing the communication session comprises establishing a multimedia session with the communication function associated with the communication session requestor that can present selectable communication options to the communication session requestor.

5. The method of claim 3, wherein establishing the communication session comprises completing an audio connection to the communication function associated with the communication session requestor that can present selectable communication to the communication session requestor.

6. The method of claim 1, wherein at least one combined user agent receives the signaling from the communication function requesting the communication session and accesses the combined user agent database.

7. The method of claim 6, wherein the identifier associated with the communication function requesting the communication session is at least one address associated with the at least one combined user agent.

8. The method of claim 1, wherein the communication function requesting the communication session and the communication function that can present selectable communication options to the communication session requestor are implemented in a combined communication client.

9. The method of claim 8, wherein the combined communication client is associated with a voice communication terminal associated with the communication session requestor and a multimedia communication terminal associated with the communication session requestor.

10. The method of claim 9, wherein providing information enabling presentation of the selectable communication options to the communication function associated with the communication requestor that can present selectable communication options to the communication session requestor comprises transmitting multimedia information to the multimedia communication terminal associated with the communication session requestor.

11. The method of claim 10, wherein the information enabling presentation of the selectable call options at the multimedia terminal associated with the communication session requestor comprises information for presentation on at least one web page.

12. The method of claim 11, wherein the information is transmitted from an automated response system.

13. The method of claim 1, wherein the signalling requesting a communication session comprises at least one SIP message.

14. The method of claim 2, wherein the signalling indicating selection of a communication option comprises at least one SIP message.

15. The method of claim 1, wherein the automated system comprises an automated response system.

16. The method of claim 15, wherein the automated response system comprises an Integrated Voice Response (IVR) system.

17. The method of claim 1, wherein providing information enabling presentation of the selectable communication options to the communication function associated with the communication requestor that can present selectable communication options to the communication session requestor comprises providing multimedia content through at least one combined user agent.

18. The method of claim 2, wherein receiving signalling indicating selection of a communication option at the communication function associated with the caller that can present selectable communication options to the communication session requestor comprises receiving audible input from the communication session requestor.

19. The method of claim 2, wherein receiving signalling indicating selection of a communication option at the communication function associated with the caller that can present selectable communication options to the communication session requestor comprises receiving non-audible input from the communication session requestor.

20. The method of claim 2, wherein receiving signalling indicating selection of a communication option at the communication terminal associated with the caller that can present selectable communication options to the communication session requestor comprises receiving non-audible input from the communication session requestor in parallel with receiving audible input from the communication session requestor.