# Patent

## Title
System and method for multi-modal monitoring of a network

## Abstract

A system and method for multi-modal monitoring of a network are disclosed. In one embodiment of a system incorporating teachings of the present disclosure, a network management engine may be capable of issuing a request to a monitored network device and to receive network information from the monitored network device. In some embodiments, a multi-modal administration engine may allow a calling party to interact with the network management engine. A caller response unit associated with the multi-modal administration engine, may be capable of receiving a user input from the calling party and converting the user input into a request for network information. In preferred embodiments, a format converter associated with the multi-modal administration engine may translate at least a portion of a first signal representing network information into a second signal representing an audible sound. The audible sound may be played to the calling party so that the calling party may receive network information in a modality other than or in addition to the graphical presentation of text.

## Background
FIELD OF THE DISCLOSURE
The present disclosure relates to network management, and more particularly to a system and method for multi-modal monitoring of a network.
BACKGROUND OF THE DISCLOSURE
In the world of information technology (IT), a network is made up of a series of nodes interconnected by communication paths. Networks often interconnect with computing devices of differing types and with other networks of various sizes. An enterprise network, for example, may interconnect with several local area networks (LANs) and one or more metropolitan area networks (MANs) or wide are networks (WANs).
An enterprise with a need to interconnect its various sub-networks with a broader network may do so by connecting some of the nodes on its network with nodes of the broader network. In many cases, this intermingling of smaller network assets actually helps create the broader network.
A given network may be characterized by several factors like who can use the network, the type of traffic the network carries, the typical nature of the network's connections, and the transmission technology the network uses. For example, one network may be public and carry circuit switched voice traffic while another may be private and carry packet switched data traffic. Whatever the make-up, most networks
Given the potential complexity of a network, network operators and enterprises often invest a great deal of time and money managing and maintaining their networks. They usually supervise, monitor, and maintain their networks at a network operations center (NOC). A typical NOC is a room containing visualizations of the network or networks that are being monitored. The NOC may have workstations that show graphical representations of the network and provide a detailed and near real-time status of the network. In most cases, the network operations center is the focal point for network troubleshooting, performance monitoring, third party network coordination, software maintenance and distribution, as well as router and domain name management.



BRIEF DESCRIPTION OF THE DRAWINGS
The present invention is pointed out with particularity in the appended claims. However, features are described in the following detailed description in conjunction with the accompanying drawings in which:
FIG. 1 shows a block diagram of a multi-modal network monitoring system incorporating teachings of the present disclosure; and
FIG. 2 depicts a representative graphical user interface that may be used when practicing a multi-modal monitoring method that incorporates teachings of the present disclosure.



DETAILED DESCRIPTION OF THE DRAWINGS
Network operators and enterprises often invest a great deal of time and money managing and maintaining their networks. Network administrators frequently supervise, monitor, and maintain their networks at a NOC or network operations center. The NOC is typically a room containing visualizations of the network or networks being monitored. The NOC may have workstations that show graphical representations of the network and provide a detailed and near real-time status of the network. In most cases, the network operations center is the focal point for network troubleshooting, performance monitoring, third party network coordination, software maintenance and distribution, as well as router and domain name management.
As mentioned above in the brief description of the drawings, FIG. 1 shows a block diagram of a multi-modal network monitoring system 10 incorporating teachings of the present disclosure. System 10 includes a network operations center 12 that contains several different components. NOC 12, like other network operations center, may tend to rely heavily on manual command line interface interaction and/or software tools that use Simple Network Monitoring Protocol (SNMP) to manage a monitored network 14 and its monitored devices 16, which may include hardware, software, firmware, or combinations thereof.
For many administrators, SNMP represents a standard way of determining if devices on a network like monitored devices 16 are operating properly. With SNMP, monitored devices 16 may effectively monitor their own activity using built-in software programs sometimes referred to as agent software. Monitored devices 16 may store information about their own activity in a local data store or database called a management information base (MIB). The information stored in a typical MIB may be protocol data units (PDUs). An overall network management engine 18, like IBM's NetView, may be running as an application or engine on a NOC server 20 and may be capable of initiating a query to various agents on network 14 and effectively “ask” for a copy of their respective MIB information.
A managed network system incorporating teachings of the present disclosure may contain at least two primary elements: network management engine 18 and agent software running on monitored devices 16. Network management engine 18 may reside at and be executing on a server, workstation or console, like NOC server 20. Network management engine 18 may allow a network administrator to perform network management functions and initiate management commands like get, get next, get bulk, inform, and set from a management console 22. As mentioned above, device agents may be entities that interface to monitored devices 16, and the device agents may initiate among other things response signals and/or event notifications or traps. inform, and set from a management console 22. As mentioned above, device agents may be entities that interface to monitored devices 16, and the device agents may initiate among other things response signals and/or event notifications or traps.
Bridges, Hubs, Routers and/or network servers may be examples of monitored devices 16. However, monitored devices 16 may also include objects. For example, a network server may contain physical objects, hardware, configuration parameters, and/or operational statistics. Each of these objects may act as one or more of monitored devices 16, as each of these objects may have an impact on the then-current operation of their parent device and network 14.
In practice, SNMP may be less of a “protocol” and more of a client server application that runs on the User Datagram Protocol UDP service of the TCP/IP protocol suite. Moreover, SNMP may not be the only option for network management “protocols”. Common Management Information Protocol (CMIP) provides a powerful and secure alternative to SNMP. However, CMIP tends to have more overhead than SNMP, which may not be extremely efficient anyway. In operation, SNMP uses considerable bandwidth relaying extra information like the version number, which is often included in every message.
Whatever the basis of the deployed network management system, the tools used are often very powerful and productive but tend to limit visual access to relevant network information to graphical user interfaces (GUIs) or command line format displays. And, accessing this information usually requires a NOC-centric computer with an attached display device and a network connection like management console 22.
In the embodiment depicted in FIG. 1, system 10 and NOC 12 may improve upon conventional techniques for accessing relevant network information. For example, NOC 12 may make network information and management functions available in different modalities by incorporating such things as a text-to-speech engine, an Interactive Voice Response (IVR) system, a speech-enabled interface architecture, or some GUI-less interface.
As depicted in FIG. 1, NOC 12 may allow multiple modes of interaction, either individually or together. These modes and their implementation may include, among other things, GUIs, speech interaction, visual interaction, pen or stylus interaction, gestures-based interaction, quasi-virtual reality interaction or some other Haptics-based interaction. As such, NOC 12 may facilitate various modalities of human to computer interaction and make it easier to connect and share network information between multiple devices and multiple people.
In some embodiments, a system incorporating teachings of the present disclosure may be able to adapt information exchange to a given device, to a user preference, and/or network state or other condition. For example, an access device engine 24 may be capable of determining an access device type used by a calling or accessing party to interact with the network management engine 18. In some embodiments, access device engine 24 may include a format converter that can translate at least a portion of available network information into a signal and/or signal type receivable by a given access device type. There may be several mark-up languages and techniques employed in system 10 to facilitate this and other capabilities. For example, a designer of system 10 and NOC 12 may elect to use XHTML, SMIL or some other mark-up language in conjunction with a speech recognition engine. Other designers may elect to use Voice XML, HTML, Voice Browser, Xforms, and/or others.
In preferred embodiments, a system administrator may be able to call into a caller response unit like IVR system 26 to troubleshoot networks on a proactive or reactive measure. The system administrator may go through IVR 26 to ask specific questions about the network, to instruct the network components to execute troubleshooting commands such as “pings”, “traceroutes”, etc., or to perform other network management and maintenance functions like network troubleshooting, performance monitoring, third party network coordination, software maintenance and distribution, as well as router and domain name management.
As mentioned above, network management engine 18 may be capable of issuing a request to monitored devices 16 and further capable of receiving network information in response to the request. In some embodiments, a multi-modal administration engine 28 may allow a calling party or administrator to interact with network management engine 18. A caller response unit (like IVR 26) associated with multi-modal administration engine 28 may be capable of receiving a user input from the administrator and converting the user input into a request for network information.
In preferred embodiments, a format converter, which may be a stand alone engine or component like text-to-speech translator 30 or an asset incorporated into another engine like access device engine 24, may be associated with multi-modal administration engine 28 and capable of translating at least a portion of a first signal representing network information into a second signal representing an audible sound. The audible sound may be played to the administrator so that the administrator may receive network information in a modality other than or in addition to the graphical presentation of text.
A system administrator working with a NOC, like NOC 12, that incorporates teachings of the present disclosure may be able to work remotely without a networked data connection to the NOC. The administrator may be able, during times of a NOC failure, to provide a backup solution for monitoring networks. Embodiments incorporating teachings contained herein will preferably provide increased flexibility to network administrators and be operational with products that may or may not be SNMP manageable. Embodiments may be employed with voice networks, data networks, other communications networks, or combinations thereof.
In light of the potential authority granted to a remotely located administrator, a system incorporating teachings of the present disclosure may elect to use some rights management technique. For example, a system like system 10 may employ a security engine 32, which could include an authentication engine and an authorization engine. In practice, the authentication engine may be communicatively coupled to a caller response unit like IVR 26. The authentication engine may be able to compare an initial set of credentials received from the calling party against a maintained set of credentials. The credentials may include, for example, a user name and password combination. If the received credentials match the maintained credentials, the authorization engine may grant access to multi-modal administration engine 28.
As mentioned above, an administrator may call NOC 12 and/or be called by NOC 12. As such, a system incorporating the present teachings may include a telephone interface 34 capable of connecting an administrator's call to a component of system 10 like IVR 26. In some embodiments, interface 34 may be capable of receiving a voice over internet protocol (VoIP) call, a wireless call, and/or a more traditional Plain Old Telephone Service (POTS) call. The call may be a voice call, a data call, or a combination thereof.
In the embodiment of FIG. 1, system 10 may be capable or receiving and/or initiating calls through interface 34. System 10 may also be capable of routing network information back to an administrator and/or the administrator's access device or devices. System 10 could, for example, include a modality engine that initiates the routing of audible information or speech signals to a first access device like a telephone and the routing of additional network information like graphical or visual presentations of information to a second access device like a computer, laptop, personal digital assistant (PDA), smart telephone, or other device capable of receiving data.
As mentioned above, the access device type may effect how network information is communicated to a remote administrator. Similarly, the connection or link type may impact delivery of network information. For example, an administrator may elect to access multi-modal administration engine 28 with one or more remote access devices 36, which may include a computer 38, a wireless telephone 40, and a wireline telephone 42. Accessing with wireline telephone 42 may involve calling NOC 12 across Public Switched Telephone Network 44. Accessing with computer 38 may involve connecting to NOC 12 across a portion of Public Switched Telephone Network 44 and/or a larger network like Internet 46. A connection between computer 38 and NOC 12 may involve the communication of a TCP/IP packet and may be pure data communication or a combination data and voice communication. The voice portion of the combination may involve the creation of a derived voice channel, a VoIP call, an instant messenger (IM) connection, some other technique, or a combination thereof.
Accessing with wireless telephone 40 may involve connecting to NOC 12 via a wireless network component 48, a portion of Public Switched Telephone Network 44 and/or a larger network like Internet 46. A wireless link type may depend on the electronic components associated with a given wireless access device and other wireless networking components like cellular towers or wireless local area network (LAN) hubs.
The wireless access device, cellular tower and/or wireless hub (Wireless Enabled Devices) may include any of several different components. For example, a Wireless Enabled Device may have a wireless wide area transceiver, which may be part of a multi-device platform for communicating data using radio frequency (RF) technology across a large geographic area. This platform may be a GPRS, EDGE, or 3GSM platform, for example, and may include multiple integrated circuit (IC) devices or a single IC device.
A Wireless Enabled Device may also have a wireless local area transceiver, which may communicate using spread-spectrum radio waves in a 2.4 GHz range, 5 GHz range, or other suitable range. The wireless local area transceiver may be part of a multi-device or single device platform and may facilitate communication of data using low-power RF technology across a small geographic area. For example, if the wireless local area transceiver includes a Bluetooth transceiver, the transceiver may have a communication range with an approximate radius of one hundred feet. If the wireless local area transceiver includes an 802.11(x) transceiver, such as an 802.11(a)(b) or (g), the transceiver may have a communication range with an approximate radius of one thousand feet.
In addition to the use of remote access devices, and administrator may choose to more directly access the management tools of NOC 12 from management console 22. In some embodiments, the administrator may access the tools and network information from within monitored network 14. For example, an administrator may be able to access NOC 12 from computer 50, which may be included within monitored network 14.
In practice, the information communicated across the various links of FIG. I may be compressed and/or encrypted prior to communication. The communication may be via a circuit-switched network like most wireline telephony networks, a frame-based network like Fibre Channel, or a packet-switched network that may communicate using TCP/IP packets like Internet. The physical medium making up at least a portion of the links may be coaxial cable, fiber, twisted pair, an air interface, other, or combination thereof. In some embodiments, at least one of the links may be a broadband connection facilitated by an xDSL modem, a cable modem, another 802.11x device, some other broadband wireless linking device, or combination thereof.
In some embodiments, various pieces of information including network information may be communication to an administrator in a format that allows a graphical user interface to display textual information and a visual representation of the monitored network. As mentioned above, FIG. 2 depicts a representative graphical user interface 52 that may be used when practicing a multi-modal monitoring method that incorporates teachings of the present disclosure. GUI 52 may be presented within a display associated with an access device. GUI 52 may include a browser bar portion 54 and a display portion 56. Display portion 56 may contain several active windows 58, 60, and 62.
As depicted, window 58 may be associated with an IM client and capable of showing a transcript of the verbal communication occurring between the administrator and a NOC component. Window 58 may also be associated with a VoIP call, a derived voice channel call, a POTS call, or some other verbal communication link. Window 60 may present an image representing a monitored network, like network 14 of FIG. 1. As shown, the monitored network may be experiencing an outage—represented by an “X”. Window 62 may be displaying requests issued by a network management engine, like network management engine 18 of FIG. 1.
In operation of a system incorporating teachings of the present disclosure, a voice call may be communicatively coupled to a network management engine. The network management engine and/or another engine associated with the system may receive a spoken directive from a party to the call, which may be an administrator. The spoken directive may be converted into a request for network information.
In preferred embodiments, an SNMP request representing the spoken directive may be sent from a network management engine to a monitored network device. The system may receive a response from the monitored network device, recognize that the administrator can receive audible information via the call and graphical information via a data connection. As such, the system may convert a first portion of the response to audible information and a second portion of the response to graphical information. The first portion may then be routed to the administrator via the call, while the second portion is routed to the administrator via the data connection.
Many of the above techniques may be provided by a computing device executing one or more software applications or engines. The software may be executing on a single computing platform or more than one. The platforms may be highly capable workstations, personal computers, microprocessors, servers, or other devices capable of performing the techniques. The device or devices may have a computer-readable medium having computer-readable data to receive a spoken directive from a party to a call, to convert the spoken directive into a request for information from a monitored network device, to receive a response from a software agent associated with the monitored network device, to convert the response into a spoken response, and to initiate playing of the spoken response to the party.
It will be apparent to those skilled in the art that the disclosed embodiments may be modified in numerous ways and may assume many embodiments other than the particular forms specifically set out and described herein.
Accordingly, the above disclosed subject matter is to be considered illustrative, and not restrictive, and the appended claims are intended to cover all such modifications, enhancements, and other embodiments that fall within the true spirit and scope of the present invention. Thus, to the maximum extent allowed by law, the scope of the present invention is to be determined by the broadest permissible interpretation of the following claims and their equivalents, and shall not be restricted or limited by the foregoing detailed description.

## Claims

1. A network monitoring system comprising;
a network management engine operable to issue a request to a monitored network device agent and to receive network information from the monitored network device agent;
a multi-modal administration engine operable to allow a party to a call to interact with the network management engine;
a caller response unit associated with the multi-modal administration engine, the caller response unit operable to receive a user input from the party and to convert the user input into a directive for the network management engine; and
a format converter associated with the multi-modal administration engine, the format converter operable to translate at least a portion of a first signal representing network information into a second signal representing an audible sound.

2. The system of claim 1 further comprising:
an authentication engine communicatively coupled to the caller response unit and operable to consider an initial set of credentials received from the party; and
an authorization engine operable to grant access to the multi-modal administration engine in response to authorization of the initial set of credentials.

3. The system of claim 1, further comprising a telephone interface operable to receive the call.

4. The system of claim 1, further comprising a voice over internet protocol (VoIP) interface operable to facilitate a VoIP call.

5. The system of claim 1, wherein the network management engine relies on a request/response protocol to monitor a network.

6. The system of claim 1, wherein the multi-modal administration engine is operable to allow the party to direct the network management engine to issue a second request to a second monitored network device agent.

7. The system of claim 1,further comprising:
an authentication engine communicatively coupled to the caller response unit and operable to consider an initial set of credentials received from the party;
an authorization engine operable to grant access to the multi-modal administration engine in response to authorization of the initial set of credentials; and
a telephone interface operable to receive the call.

8. The system of claim 7, wherein the multi-modal administration engine is operable to allow the party to direct the network management engine to issue an SNMP request.

9. The system of claim 1 further comprising an access device engine operable to determine an access device type used by the party to interact with the network management engine, wherein the format converter is further operable to translate at least a second portion of the first signal representing network information into a third signal receivable by the access device type.

10. The system of claim 1 further comprising a modality engine operable to route the second signal to a first access device and to route additional network information to a second access device.