# Patent

## Title
System and method for dynamic distributed communication

## Abstract

Growth of a distributed communication system is facilitated through dynamic addition of routing elements. A new routing element may be added to a network of routing elements by first establishing a connection between the new routing element and an existing routing element in the network. The connection may be either wireless or wireline. At least one address is assigned to the new routing element. Each assigned address comes from a pool of addresses maintained at the existing routing element. At least one pool of addresses is issued to the new routing element, permitting the new routing element to dynamically add yet another new routing element to the network of routing elements.

## Background
CROSS-REFERENCE TO RELATED APPLICATIONS
This application is a divisional of application Ser. No. 09/603,035, filed Jun. 23, 2000, now U.S. Pat. No. 6,987,769 which claims the benefit of U.S. Provisional Application No. 60/152,730, filed Sep. 8, 1999 and U.S. Provisional Application No. 60/185,788, filed Feb. 29, 2000. The specification of each of Application Nos. 60/152,730 and 60/185,788 is hereby expressly incorporated by reference in its entirety.


TECHNICAL FIELD
The present invention relates to dynamically modifying communication network components.
BACKGROUND ART
Communication systems are increasingly being required to provide a wide range of services, including different forms of information communicated and different communication characteristics. Information forms include voice, data, video, telemetry, and the like. Communication characteristics include quality, complexity, latency, reliability, cost, availability, portability, and the like. Infrastructure such as telecommunication systems, the Internet, and cable systems exist to provide long-haul routing and information content sourcing. However, difficulty remains in delivering this information to customers. This is particularly the case if the customer is located in a rural location, is communicating through portable equipment, or is mobile.
Traditionally, communication service providers have relied on copper wire or coaxial cable to connect distribution sites and subscriber premises.
Traditionally, communication service providers have relied on copper wire or coaxial cable to connect distribution sites and subscriber premises. However, increases in the number of users, number and type of communication devices per user, and the information rate per device has strained the ability for traditional communication systems to provide the necessary bandwidth and flexibility. Various technologies including digital subscriber line (DSL) and video modems offer broadband access to the subscriber over existing copper or coaxial loop technologies. Fiber-to-the-home offers broadband access through additional wireline connections. While each technology has broadband delivery properties, each is subject to physical and signaling limitations that restrict availability in certain locations and for certain applications. For example, VDSL is limited to within approximately one kilometer of a connecting central office. Further, each central office usually cannot support high-speed access for every customer within the central office coverage area. Similarly, service provided by two-way cable modems is limited to the installation of coax, hybrid fiber coax and fiber-based systems by the cable provider as well as support capabilities of the supporting central office. Currently, many premises do not have access to high-speed wireline voice, data, and video services due, in part, to the expense and difficulty in constructing or expanding central offices.
Wireless systems, such as PCS and cellular systems, offer an alternative to wireline services. Typically, wireless systems include a centralized mobile switching center (MSC) responsible for routing calls, tracking user locations, billing information, and connectivity with other communication systems. The MSC is connected to base station controllers (BSCs), each of which supports one or more base transceiver stations (BTSs). Each BTS supports one or more cells based on the number and configuration of antennas supported by the BTS. Customers communicate with the wireless system through radio telephones when the telephone is within the coverage range of a cell. When a call is placed, a circuit-switched connection is established from the telephone, through the BTS and BSC, to the MSC. The MSC determines the destination and, if the destination is to another telephone within the wireless system, establishes a circuit-switched connection to the destination telephone. If the destination is outside of the wireless system, the MSC routes the call to a service provider for the outside destination.
Cellular and PCS wireless systems have traditionally focused on voice. However, recent introduction of digital radio in both the 800 MHz and 1.9 GHz permits low-speed data services, such as text messaging and one-way paging, to be implemented. Also, wireless modems implementing wireless application protocols may be incorporated into hand-held devices such as lap top personal computers and personal digital assistants (PDAs). Such devices may offer access to the Internet at rates up to 19.2 kilobits per second.
Several problems have developed with traditional wireless systems. First, because all calls are processed by the central MSC, it can become a bottleneck limiting the number of users supported. Second, if the MSC fails, the system becomes inoperative. Third, the BSC and BTS architecture is fairly rigid, requiring manual reconfiguration in the MSC when components are added or deleted. Fourth, circuit-switched channel connections establish an upper bandwidth, limiting communication rates. Fifth, bandwidth is wasted if the communication rate does not reach the maximum established by the communication channel. Sixth, high-speed data and video applications are impractical on wireless telecommunication systems designed primarily for voice.
An alternative wireless communication system is the multi-channel multipoint distribution system (MMDS). In MMDS, an antenna broadcasts high-bandwidth content to local receiving antennas. In the case of Internet access, the return path is typically through slow telephone lines. MMDS, like wireline cable systems, is asymmetrical, making it best suited for distribution of one-way entertainment signals such as television. MMDS also typically operates at a higher carrier frequency than PCS systems, requiring receiving antennas to be positioned in line-of-site with the transmitting antenna. MMDS is typically deployed in a single cell broadcast architecture. Other wireless communication systems, such as local multipoint distribution system (LMDS) may be deployed in a cellular fashion. However, because these systems typically operate at a high carrier frequency, receiving antennas must be positioned in line-of-sight with the transmitting antenna.
What is needed is a communication system that provides voice, data, and video signals at rates appropriate for each user. The system should make efficient use of bandwidth, allocating only the bandwidth necessary for a particular communication. The system should be flexible, permitting automatic addition and deletion of network components. The system should have distributed routing and service provisioning to prevent bottlenecks, permit scaling, and increase reliability and robustness. The system should support wireless subscriber units, accommodating a wide variety of fixed, portable, and mobile user communication devices. The system should support high-speed symmetric communication for applications such as video conferencing, real-time distributed document sharing, and the like.
DISCLOSURE OF INVENTION
The present invention provides automatic and dynamic addition of network routing elements to a distributed communication network. This permits rapid, scalable, and inexpensive growth of the communication network, allowing for a flexible system that can be easily modified to meet customer needs, balance resources, and satisfy physical constraints and government regulations.
A new routing element may be dynamically added to a network of routing elements by first establishing a connection between the new routing element and an existing routing element in the network. The connection may be either wireless or wireline. At least one address is assigned to the new routing element. Each assigned address comes from a pool of addresses maintained at the existing routing element. At least one pool of addresses is issued to the new routing element, permitting the new routing element to dynamically add yet another new routing element to the network of routing elements.
The assigned address may be one or more from a set including an ATM address and an IP address. Likewise, address pools may be pools of ATM addresses and pools of IP addresses. Other types of addresses may be included or substituted, such as TCP, 802.x, and the like. Any assignable address that can distinguish between network elements may be used.
Routing elements may be of a variety of types. Any routing element that receives or forwards information packets may be used. For example, routing elements may include distribution points and access points in a communication network. In one aspect of the present invention, distribution points form peer-to-peer relationships with each other. Access points form client-server relationships with distribution points. If multiple addresses are assigned to each routing element, relationships between routing elements may be established concurrently across more than one layers. For example, IP routing may be established at the network layer and ATM switching at the data link layer with routing elements communicating in a peer-to-peer or client-server relationship at each layer.
Communications networks can now support dynamic addition of routing elements. In one embodiment, a supervisor supplies pools of ATM end user addresses and pools of IP addresses. Access points transmit packets to and receive packets from at least one subscriber unit. Distribution points and access points form the network, with each distribution point communicating with at least one other distribution point and with each access point communicating with at least one distribution point. Each distribution point obtains a pool of ATM end user addresses and a pool of IP addresses from the supervisor. When a distribution point receives a request from a new network element to join the network, the distribution point provides the new network element with an ATM end user address from the pool of ATM end user addresses and an IP address from the pool of IP addresses. An access point may also receive address pools and function as a distribution point in support of additional access points.
Dynamic distributed communication networks may also concurrently support many types of information traffic. For example, packetized voice information may be transferred between network elements at the data link layer while data packets are transferred between network elements at the network layer. Packets may be routed through the communication network based on the forward equivalency class holding the packet destination address or similar information.
The above objects and features as well as other objects, features, and advantages of the present invention are readily apparent from the following detailed description of the best mode for carrying out the invention when taken in connection with the accompanying drawings.



BRIEF DESCRIPTION OF DRAWINGS
FIG. 1 is a schematic drawing illustrating a portion of a communication system according to an embodiment of the present invention;
FIG. 2 is a block diagram of a distribution point according to an embodiment of the present invention;
FIG. 3 is a schematic drawing illustrating an implementation of a communication system according to an embodiment of the present invention;
FIG. 4 is a schematic drawing illustrating an initial state for a communication system according to an embodiment of the present invention;
FIG. 5 is a schematic drawing illustrating the addition of a second access point to the communication system of FIG. 4 according to an embodiment of the present invention;
FIG. 6 is a schematic drawing illustrating a hierarchical routing system using ATM/IP switches according to an embodiment of the present invention;
FIG. 7 is a schematic drawing illustrating a network of distribution points routing packets based on forward equivalency classes; and
FIG. 8 is a schematic drawing illustrating forward equivalency class updating to track a moving subscriber unit.



BEST MODE FOR CARRYING OUT THE INVENTION
Referring to FIG. 1, a schematic drawing illustrating a portion of a communication system according to an embodiment of the present invention is shown. A communication system, shown generally by 20, includes a plurality of access points 22 which may be, for example, a local radio access point (LRAP). Each access point 22 defines coverage area 24 such as, for example, a cell, covering a reception range of access point 22. Coverage area 24 may be formed from many independent sectors, as may result if access point 22 uses many unidirectional antennas, or may be a single region resulting from the use of an omnidirectional antenna. Subscriber unit 26 within coverage area 24 may establish two-way wireless link 28 with access point 22. Subscriber unit 26 may also establish wireline link 29 with access point 22. Links 28, 29 may be symmetrical or asymmetrical. Subscriber unit 26 may be fixed or non-fixed and, if non-fixed, may posses varying degrees of portability and mobility. Subscriber unit 26 may be a mobile telephone, a computer, a video receiver, an audio receiver, a two-way video conferencing station, a video game, an information kiosk, a remote sensor, a remote actuator, or any other suitable communication device.
Wireless link 28 may be any form of electromagnetic signaling not confined to a wire or cable, including energy radiated by antenna as well as visible and invisible light. As will be appreciated by one of ordinary skill in the art, wireless link 28 may be implemented by any access technology, including CDMA, TDMA, FDMA, OFDM, analog, and the like. Modulation techniques that may be used with the present invention include FSK, BPSK, QPSK, m-ary QAM, FM, AM, and the like. Further, the invention does not depend on modulation frequency or on the use of FDD or TDD. In a preferred embodiment, the access technology, frequency, and modulation method for establishing wireless link 28 are based, in part, on local geography, local regulations, noise and distortion sources, other operating wireless systems, cost, or any other suitable parameter. Subscriber unit 26 and access point 22 may establish wireless link 28 using a plurality of combinations of access technology, frequency, and modulation techniques.
Information transmitted on links 28, 29 may represent voice, data, video, streaming audio, streaming video, or the like. Types of information include speech, facsimile, computer data, entertainment and informational audio and video, video game data, telemetry information, security information, and the like. If the information occurs as a continuous stream, subscriber unit 26 breaks the information into packets prior to packet transmission and reassembles the information stream from packets after packet reception. Any type of information that exists in packets or that may be packetized can be used with the present invention.
In an embodiment of the present invention, subscriber unit 26 may be implemented as part of terminal network controller 30 accepting inputs from and providing outputs to information sources including voice equipment 32, computing equipment 34, telemetry equipment 36, video equipment 38, or any other suitable communication equipment. Inputs to terminal network controller 30 may include serial data, parallel data, ISDN, standard telephone, xDSL, SR 1394, coaxial cable, twisted pair cable, optical fiber, or any other suitable communication protocol, method, or medium.
In an embodiment of the present invention, a quality error bit rate is established for each subscriber unit 26. This quality error bit rate may be based on the location of subscriber unit 26 within communication system 20, the class of service assigned to subscriber unit 26, the grade of service assigned to subscriber unit 26, the data or transmission rate of service assigned to subscriber unit 26, or any other suitable parameter. The quality error bit rate may be modified while subscriber unit 26 is within communication system 20 to reflect changing conditions such as noise, demand, connectivity, or any other suitable parameter. Applications providing services to subscriber unit 26 may adjust these services based on the quality error bit rate. For example, an application providing streaming audio and video may reduce the frame update rate as noise increases, guaranteeing successful transmission at a lower information rate. The information rate may be further reduced to provide only still pictures and audio if conditions continue to worsen. The information rate may also be automatically changed if subscriber unit 26 moves between coverage areas 24 with differing transmission capabilities or loads.
Control of the information rate may be achieved by having subscriber unit 26 monitor a signaling channel transmitted by access point 22 for each coverage area 24. This signaling channel informs subscriber unit 26 when to transmit information, how much information to transmit, the information transmission rate, and the like. The signaling channel may be controlled by a central supervisor, described below.
In an embodiment of the present invention, bandwidth on communication link 28 is only consumed when packets containing information are transmitted. For example, each subscriber unit 26 surrenders bandwidth on communication link 28 when not sending or receiving an information packet. Packets to be transmitted are queued based on order of arrival, priority, a combination of arrival order and priority, or the like. Subscriber unit 26 monitors a signaling channel transmitted by access point 22 for each coverage area 24. Subscriber unit 26 only consumes bandwidth when instructed to transmit by the signaling channel or when receiving packets.
Each access point 22 communicates with at least one distribution point 40. Distribution point 40 contains both routing and switching functionality. Access point 22 may be in contact with one or more radio access distribution points 40 over radio link 42, may be wired or cabled to distribution point 40 through wireline link 44, or may be packaged with distribution point 40. Access point 22 may also be transformed into distribution point 40, permitting access point 22 to route traffic that neither originated nor terminated with any of its serviced subscriber units 26. Distribution point 40 is in communication with at least one additional distribution point 40, the collection of interconnected distribution points forming a network of distribution points, shown generally by 41. Two distribution points may be connected by radio link 46 or wireline link 48.
Distribution points 40 may route packets within distribution point network 41 under a variety of protocols such as ATM, TCP/IP, 802.x, or the like. In a preferred embodiment, distribution point 40 includes an ATM/IP switch. Distribution point 40 then operates at both the IP routing and ATM switching layers or, in terms of the Open Systems Interconnection (OSI) standard, at both the network layer and the data link layer.
The IP layer operates with a link-state protocol such as the open shortest path first (OSPF), quality OSPF (Q-OSPF), or internal gateway routing protocol (IGRP) and its derivatives. The IP layer operates as a single autonomous system (AS) within the IP frame of reference. Each system 20 will be allocated a unique and unambiguous AS number for system management. IP addresses for system 20 will use a private IP address space that cannot be routed within public systems such as the Internet. Subscriber units 26 within system 20 may be permitted access to the private IP address space or may be excluded from the private IP address space. When private IP address space is used for subscriber units 26, a network address translator (NAT) within system 20 allows subscriber units 26 access to the Internet. The ATM layer operates with the private network node interface (PNNI) routing protocol. ATM end system addresses (AESAs), managed by the service provider for system 20, are used by distribution point network 41.
The ATM network carries voice traffic and may carry data. Through PNNI, the ATM/IP switch participates in switched or signaled virtual connections (SVCs). When subscriber unit 26 within system 20 requires voice connectivity, it signals such a request, which is serviced by distribution point 40 receiving that request. The IP network coresiding with the ATM network is used for delay insensitive data applications required by subscriber units 26. The IP network is also used for all network management, including management of ATM/IP switches, subscriber units 26, gear associated with distribution points 40, and any other suitable network component. This includes functions such as alarming, monitoring, recovery systems, and the like. While described in the context of a wireless network application, it is readily apparent that ATM/IP routing as described herein may be applied to wireline and mixed wireline-wireless systems as well.
Each distribution point 40 receives an information packet from either another distribution point 40, from subscriber unit 26 in communication with distribution point 40 through access point 22, or from an external communication system. If distribution point 40 determines the information packet is destined for subscriber unit 26 within coverage area 24 of access point 22 in communication with distribution point 40, distribution point 40 forwards the packet to access point 22 forming coverage area 24 containing destination subscriber unit 26. If distribution point 40 determines the information packet is destined for subscriber unit 26 in coverage area 24 formed by access point 22 in communication with a different distribution point 40, distribution point 40 forwards the packet to one of distribution points 40 in communication with distribution point 40. Hence, no central MSC is required for routing. Distributed routing removes delays caused by central switching, increases the robustness of the communication system 20, increases network efficiency, and permits simplified expansion or reduction of communication system 20 by automatically adding or removing distribution points 40.
A third option is that distribution point 40 determines that the information packet is destined for a destination not part of communication system 20. Special distribution points, such as gateway 50, provide a bridge to additional communication systems 52 including wireless and wireline telecommunication systems, video distribution systems, computer network systems such as the Internet, packet systems, frame systems, ATM systems, IP systems, private networks, and any other suitable communication or information system. If distribution point 40 determines the information packet is destined for delivery outside of communication system 20, distribution point 40 forwards the packet to one of distribution points 40 in communication with gateway 50.
In an embodiment of the present invention, communication system 20 includes communication system interface device 54 operative to format information contained in the information packet to pass through telecommunication system 52. Communication system interface device 54 may be incorporated into gateway 50 or may be a separate component of communication system 20. Distribution point 40 receives at least one information packet from the telecommunication system interface device 54 and determines if the at least one information packet destination is to subscriber unit 26 within coverage area 24 of access point 22 in communication with distribution point 40. Distribution point 40 forwards the at least one information packet to access point 22 defining coverage area 24 containing subscriber unit 26 if the information packet destination is to subscriber unit 26 within coverage area 24 of access point 22 in communication with distribution point 40 and forwards the at least one information packet to one of the additional distribution points 40 in communication with distribution point 40 otherwise.
Each distribution point 40 communicates with supervisor 56. Supervisor 56 tracks the locations of subscriber units 26 within communication system 20, identifying with which distribution point 40 each subscriber unit 26 is currently communicating. Supervisor 56 manages transmission priorities based on parameters including load, information type, service requests, location, grade of service, information transfer rates, or any other suitable parameter. Supervisor 56 may also serve as a collection point for alarms and performance measuring of communication system 20. Supervisor 56 may further include or interface with billing and authentication services.
In an embodiment of the present invention, supervisor 56 also assigns an address to each distribution point 40 as distribution point 40 is added to communication system 20. Supervisor 56 provides each distribution point 40 with a logical address and a listing indicating to which additional distribution point 40 in communication with distribution point 40 information packets should be forwarded for each possible destination distribution point 40. The listing may be based on maintaining a minimum quality of service in the path through distribution point network 41 to the destination distribution point 40. Supervisor 56 periodically assesses the performance of network 41 by sending test messages. Reports may also be generated by distribution points 40 attempting to communicate with target addresses.
Supervisor 56 is shown in FIG. 1 as a separate component individually connected to each distribution point 40. Alternatively, communication between supervisor 56 and distribution points 40 may be through radio links 46 and wireline links 48. Supervisor 56 may be one or more separate components of communication system 20, may be incorporated into one of distribution points 40, or may be distributed amongst multiple distribution points 40.
In an embodiment of the present invention, a distribution point may be automatically added to or removed from distribution point network 41. When new distribution point 40 is first inserted into communication system 20, new distribution point 40 transmits a signature signal. Existing distribution points 40 within range of new distribution point 40 receive the signal and report it to supervisor 56. Supervisor 56 then determines if new distribution point 40 will be added to network 41. If so, supervisor 56 assigns new distribution point 40 a routing address and informs network 41 as needed. Each existing distribution point 40 in distribution point network 41 is provided with an indication as to which distribution point 40 in communication with existing distribution point 40 each information packet having a destination address specifying the new distribution point 40 is to be forwarded. If a distribution point 40 is removed from network 41, remaining distribution points 41 report the absence of removed distribution point 40 to supervisor 56. Supervisor 56 then informs network 41 as needed.
In an embodiment of the present invention, each subscriber unit 26 is autonomously registered with communication system 20 when subscriber unit 26 first enters coverage area 24 within communication system 20. Each subscriber unit 26 maintains registration as subscriber unit 26 moves from one coverage area 24 into another coverage area 24 within communication system 20 and is autonomously deregistered when subscriber unit 26 leaves communication system 20. To accomplish automatic registration and deregistration of subscriber units 26, each access point 22 periodically reports the status of subscriber units 26 within any controlled coverage area 24 to supervisor 56 performing registration and authentication. Each access point 22 communicates with subscriber units 26 to determine status. When a subscriber unit 26 voluntarily enters or leaves coverage area 24, such as by powering up or down, subscriber unit 26 transmits a particular signal to access point 22. Information is also received from subscriber unit 26 in response to periodic queries from network 20. Access point 22 may determine the absence of subscriber unit 26 from coverage area 24 if no communication is received after a particular time interval. Algorithms for registering and deregistering subscriber units 26 may be based on various factors including quality of service, traffic, location, service type, network topology, and the like.
Referring now to FIG. 2, a block diagram of a distribution point according to an embodiment of the present invention is shown. Distribution point 40 includes one or more front end communication interfaces 100, each front end interface communicating with one access point 22 in one configuration, access point 22 is packaged with distribution point 40. Front end interface 100 may provide a plug-in port for receiving access point 22. In another configuration, front end interface 100 connects to antenna 102 for establishing radio link 42 with access point 22. In a further configuration, front end interface 100 accepts wireline link 44 connecting distribution point 40 with access point 22. Front end interface 100 operates using a standard packet switching protocol such as, for example, ATM25. Each front end communication interface 100 passes information packets through common front end switch interface 104 operating under a packet protocol such as ATM, TCP/IP, 802.x, or the like.
Distribution point 40 also includes back end communication interfaces 106 for connecting distribution point 40 with additional distribution points 40, with supervisor 56, and, if distribution point 40 is a gateway 50, with telecommunication systems, private network systems, video distribution systems, the Internet, or the like. This may be typically referred to as back haul communication. In one configuration of the present invention, back end interface 106 connects to antenna 108 for establishing radio link 46 with another distribution point 40. In another configuration, back end interface 104 accepts wireline link 44 connecting distribution point 40 with another distribution point 40. In a preferred embodiment, back end interface 106 accepts modules 110 for interfacing through a variety of protocols and media such as ATM25, DS1, DS3, OC3, 1000Base-T, 100Base-T, and the like. Each back end communication interface 106 passes information packets through common back end switch interface 112 operating under a packet protocol such as ATM, TCP/IP, or the like. In a preferred embodiment, distribution point 40 dynamically allocates bandwidth when the information packet is forwarded to one of the additional distribution points 40 in communication with distribution point 40.
Intelligent packet switch 114 received information packets through common front end switch interface 104 and common back end switch interface 112 and routes the packets between front end interfaces 100 and back end communication interfaces 106. Switch 114 may be a packet switching device as is known in the art such as an ATM switch, an IP switch, a TDM switch, a switch working under the 802.11 specification, or any other suitable alternative or combination having the required switching functionality. In an embodiment of the present invention, switch 114 includes an ATM portion for routing voice, video and data, and an IP portion for real-time dynamic data routing and non-real time data routing as well as administration, management, and network topology control.
In an embodiment of the present invention, distribution point 40 is enclosed in an environmentally sealed package. This permits distribution point 40 to be mounted outside, such as on a pole or the side of a building. In keeping with the invention, however, distribution point 40 need not be outside so long as it can communicate with access points 22, additional distribution points 40, supervisor 56, and any other suitable network component.
Referring now to FIG. 3, a schematic drawing illustrating an implementation of a communication system according to an embodiment of the present invention is shown. This implementation provides an example including interfaces between communication system 20 and a variety of external communication systems 52.
Communication system 20 includes wireless service location registers (WSLRs) 200 providing common subscriber and service databases. Each WSLR 200 communicates with at least one distribution point 40 and one additional communication system 52. Connections between WSLRs 200 and communication systems 52 are not shown in FIG. 3 for clarity. Each WSLR 200 provisions requested services from additional communication system 52. For example, WSLR 200 may provide centralized mobility and location management. Supervisor 56 determines which WSLR 200 will provision services based on the distribution point 40 through which subscriber unit 26 requesting services is currently communicating. A device that may serve as WSLR 200 is described in U.S. Pat. No. 5,974,331 titled “Method And System For Dynamically Assigning Features And Users To Wireline Interfaces,” to Cook et al., which is herein incorporated by reference. Call agents may also function as WSLR-like devices to map or integrate additional communication systems with system 20.
Communication system 20 may also include multi-service platform (MSP) 202. MSP 202 provides access to wireline telephone systems (PSTN). This may be accomplished through GR-303 compliant connection 204. Signaling point3 of interface (SPOI) 206 serves as the demarcation point between communication system 20 and external communication system 52. In the example shown, GR-303 connection 204 connects wireline provider 208, serving wired customers 210, with communication system 20. MSP 202 may integrate both PSTN and IP networks as well as provide enhanced circuit/packet switch services.
At least one gateway 212 supports MSP 202. Communication system 20 may include, for example, voice-over-ATM (VoATM) to GR-303 gateways and voice over IP (VoIP) to GR-303 gateways. Gateway 212 serves as a protocol agent, converting information packets to a format acceptable to additional communication system 52. A determination as to which gateway 212 will process an information packet may be based on information contained within the information packet. Gateways 212 may be connected to MSP 202 by GR-303 compliant connection 214.
Communication system 20 may also include gateway 216 connecting communication system 20 with external data network 52 such as the Internet or a private data network interconnecting network users 218. Gateway 216 may, for example, convert between various packet-based standards such as H.323 and SIP.
Communication system 20 may also include gateway 220 interfacing communication system 20 with external SS7 network 52 represented by signal transfer point (STP) 222. Gateway 220 communicates with STP 222 through ISUP compliant connection 224 which permits setting up and taking down trunk calls, calling party information services, call status, and any other suitable network function, by passing signaling information through SS7 network 52 to wireline provider 208 under the control of integrated services control point (ISCP) 226.
Communication system 20 may also include unified message center (UMC) 228, unified messages, also known as integrated messages, permit messages from a variety of sources such as telephone, email, fax, reports, compound documents, or any other suitable information or communication device, to be summarized and presented on a single medium, such as a personal computer. Messages may even be translated from one media type to another. UMC 228 supports unified message applications within communication system 20. In an embodiment, UMC 228 communicates with wireline provider 208, permitting greater integration, flexibility and access to messages.
Connection controller 230 controls access to gateways 50, 202, 212, 216, 220, or any other suitable interface. For example, connection controller 230 may manage voice over ATM to GR-303 access, voice over IP to GR-303 access, H.323/SIP to Internet remote access, SS7 to IP access, and the like. Connection controller 230 may also support information rate adaptation including open application processor interfaces and robust application development platforms.
Referring now to FIGS. 4-6, drawings illustrating dynamic growth of a distribution point network according to an embodiment of the present invention are shown. An initial configuration for system 20 is shown in FIG. 4. ATM/IP switch 300 is in communication with supervisor 56 through ATM virtual connection 302. In this simple configuration, ATM/IP switch 300 may be functioning as access point 22. ATM/IP switch 300 may obtain an IP address and an ATM address either manually or automatically. ATM/IP switch 300 automatically requests addresses by first broadcasting an ATM request in an IP packet over virtual connection (VC) 302. Supervisor 56 forwards this request to address server 304. Address server 304 responds by allocating unique AESA 306 to the address assignment client in ATM/IP switch 300, which updates the ATM layer with new address 306. The address assignment client in ATM/IP switch 300 next requests from address server 304 an IP address, again using IP as the transport service over pre-existing ATM VC 302. Address server 304 forwards IP address 308 to ATM/IP switch 300. ATM/IP switch 300 then requests address pools for ATM and IP. Address server 304 responds by suppling AESA pool 310 and IP address pool 312. Pools of addresses 310, 312 are used by switch 300 when functioning as distribution point 40 in support of other distribution points 40 and access points 22.
Referring now to FIG. 5, a drawing illustrating the addition of a second access point is shown. Access point 22 has the capability to function as a distribution point 40. As new access points 22 are subtended from an existing access point 22, existing access point 22 becomes a distribution point 40. Each distribution point 40 continues to communicate with its initially connected distribution point 40 and with other distribution points 40 as they are provisioned. As new links 46, 48 between distribution points are created, distribution points 40 form peer relationships at both the ATM layer and the IP layer. Distribution points 40 are always peers at the IP and ATM layer, while access points 22 are clients of distribution points 40. As such, each ATM/IP switch 300 functions as a server when operating as distribution point 40 and as a client when operating as access point 22.
When new ATM/IP switch 320 is instantiated as access point 22, it will automatically request an ATM address in an IP packet address assignment request. This IP packet will be sent in an ATM frame over radio link 46 to IP/ATM switch 300 functioning as distribution point 40 using a pre-existing ATM VC. IP/ATM switch 300 will allocate unique ATM address 322 from AESA pool 310 and unique IP address 324 from IP address pool 312. ATM/IP switch 320 then sends a directed request to address server 304 and receives its own AESA pool 326 and IP address pool 328.
Referring now to FIG. 6, a hierarchical routing network is shown. Address server 304 assigns AESA pool 310 and IP address pool 312 as each ATM/IP switch 300 is added. By handling all requests for address pools 310, 312, address server 304 maintains a hierarchy of addresses for both ATM and IP layers. Address server 304 constructs routing tables for each ATM/IP switch 300 indicating to which directly connected ATM/IP switch 300 each incoming packet should be routed if the packet is not destined to subscriber unit 26 serviced by that ATM/IP switch 300. Thus, routing tables are cohesive, reflecting the view of communication system 20 seen by each ATM/IP switch 300. Address server 304 also constructs forward equivalency class (FEC) tables permitting ATM/P switch 300 to route packages based on package contents. FECs can be seen as either the virtual path identifier (VPI) portion of the ATM VPI/VCI or as the entire VPI/VCI, and are enabled by the routing protocols at the IP and PNNI layers.
New routing elements are dynamically added to a network of routing elements by establishing a connection between the new routing element and an existing routing element in the network of routing elements. At least one address is assigned to the new routing element, each assigned address coming from a pool of addresses maintained at the existing routing element. At least one pool of addresses is issued to the new routing element. The one or more pool of addresses permitting the new routing element to dynamically add yet another new routing element to the network of routing elements.
In an embodiment of the present invention, a method of dynamically adding a routing element to a distributed communications includes establishing an ATM virtual connection with an existing distribution point already part of the communications network. An ATM end user address is requested from the existing distribution point. An ATM end user address is obtained from the existing distribution point, the ATM end user address allocated from a pool of ATM end user addresses in the existing distribution point. An IP address is requested from the existing distribution point. An IP address is obtained from the existing distribution point, the IP address allocated from a pool of IP addresses in the existing distribution point. Preferably, a pool of ATM end user addresses is requested and received from an address server. A pool of IP addresses is requested and received from the address server. An ATM end user address from the pool of ATM end user addresses and an IP address from the pool of IP addresses may be assigned to a new routing element requesting to be added to the communications network.
In an embodiment of the present invention, when a new distribution point is added to a network of distribution points, a connection is established between the new distribution point and at least one existing distribution point in the network of distribution points. A peer-to-peer relationship is formed at the OSI network layer between the new distribution point and the at least one existing distribution point. A peer-to-peer relationship is formed at the OSI data link layer between the new distribution point and the at least one existing distribution point.
In an embodiment of the present invention, when an access point is added to a network of distribution points, a connection is established between the access point and at least one existing distribution point in the network of distribution points. A client-server relationship is formed at the OSI network layer between the access point client and the at least one existing distribution point server. A client-server relationship is formed at the OSI data link layer between the access point and the at least one existing distribution point server.
In an embodiment of the present invention, when an ATM/IP switch 300 is removed from communication system 20, all of the addresses 306, 308 and address pools 310, 312 associated with the removed switch 300 are released. Addresses 306, 308 and address pools 310, 312 may be instantiated at distribution point 40 which originally supplied removed switch 300 with addresses 306, 308, may be sent to supervisor 56, or may be split with addresses 306, 308 returning to distribution point 40 and address pools 310, 312 returning to supervisor 56.
When subscriber unit 26 first enters communication system 20, it is detected and serviced by access point 22. Subscriber unit 26 is provided with one or more addresses, each address routable within at least the local hierarchy of ATM/IP switches 300. If subscriber unit 26 enters the range of a new access point 22, new access point 22 sends out a flooding FEC routing update for the ATM address of subscriber unit 26. Previously servicing access point 22 removes subscriber unit 26 from its own FEC upon receiving the FEC update. Any subsequent ATM packets received by previously servicing access point 22 are discarded.
When subscriber unit 26 changes access points 22, the IP routing portion of system 20 moves the IP address of subscriber unit 26 from one FEC class to another. Any IP packets remain untouched, with only a label or equivalence changed. In one embodiment, the label is the VPI portion of the VC. In another embodiment, multiprotocol label switching (MPLS) is used to provide an additional label. In either case, the IP address and virtual connection identifier (VCI) are retained.
Referring now to FIG. 7, a schematic drawing illustrating a network of distribution points routing packets based on forwarding equivalency classes is shown. Each distribution point contains an FEC table 400 used to route packets received from and destined to subscriber units 26. Forwarding equivalency class table 400 contains one entry for each forwarding equivalency class 402. In the embodiment shown, there is one FEC 402 corresponding to each access point 22. When subscriber unit 26 is first detected by access point 22, the address for subscriber unit 22 is placed in the equivalency class 402 corresponding to the detecting access point 22. The address is typically an IP address. This may be done by broadcasting from detecting access point 22 or, preferably, is done by supervisor 56 after supervisor 56 receives a message indicating subscriber unit 26 has been detected by access point 22.
FEC table 400 in each distribution point 40 contains the next destination for each FEC 402. Typically, destinations are other distribution points 40, access points 22 serviced by distribution point 40, gateways 50, and other suitable points for routing, switching, servicing, distributing, and the like. When a packet destined for subscriber unit 26 is received by distribution point 40, distribution point 40 determines to which FEC subscriber unit 26 is assigned, determines to which destination the packets in that FEC are routed, and forwards the packet to the determined destination.
Referring now to FIG. 8, a schematic drawing illustrating forwarding equivalency class updating to track a moving subscriber unit is shown. If subscriber unit 26 is mobile or portable, as indicated by U1 in FIG. 8, subscriber unit 26 may move out of coverage area 24 for one access point 22 and into coverage area 24 for a new access point 22. The address for subscriber unit 26 is then moved from FEC 402 of original access point 22 into FEC 402 for new access point 22. In an embodiment, when original access point 22 is no longer in communication with subscriber unit 26, original access point 22 broadcasts a message to distribution points 40 and supervisor 56. If original access point 22 subsequently receives any packets for subscriber unit 26, original access point forwards these packets back into distribution point network 41. If the packets are sequentially indicated, such as IP packets, correct order will be established by subscriber unit 26 when packets are received.
While embodiments of the invention have been illustrated and described, it is not intended that these embodiments illustrate and describe all possible forms of the invention. Rather, the words used in the specification are words of description rather than limitation, and it is understood that various changes may be made without departing from the spirit and scope of the invention.

## Claims

1. A method of dynamically adding a routing element to a distributed communications network comprising:
establishing an ATM virtual connection with an existing distribution point already part of the communications network;
requesting an ATM end user address from the existing distribution point;
obtaining an ATM end user address from the existing distribution point, the ATM end user address allocated from a pool of ATM end user addresses in the existing distribution point;
requesting an IP address from the existing distribution point;
obtaining an IP address from the existing distribution point, the IP address allocated from a pool of IP addresses in the existing distribution point;
requesting a pool of ATM end user addresses from an address server;
receiving a pool of ATM end user addresses from the address server;
requesting a pool of IP addresses from the address server; and
receiving a pool of IP addresses from the address server;
whereby an ATM end user address from the pool of ATM end user addresses and an IP address from the pool of IP addresses are assigned to a new routing element requesting to be added to the communications network.

2. A method of dynamically adding a routing element as in claim 1 wherein the routing element is a distribution point.

3. A method of dynamically adding a routing clement as in claim 2 further comprising:
forming a peer relationship with the existing distribution point at the data link layer for voice communication; and
forming a peer relationship with the existing distribution point at the network layer for data communication.

4. A method of dynamically adding a routing element as in claim 1 wherein the routing element is an access point interconnecting user communication devices with a distribution point.

5. A method of dynamically adding a routing element as in claim 4 wherein the access point is a local radio access point serving a plurality of packet radios.

6. A method of dynamically adding a routing element as in claim 4 further comprising:
forming a client relationship at the data link layer with the existing distribution point, the existing distribution point functioning as a server for voice communication; and
forming a client relationship at the network layer with the existing distribution point, the existing distribution point functioning as a server for data communication.

7. A method of dynamically adding a routing element as in claim 6 further comprising:
adding at least one access point as a client;
forming a peer relationship with communicating existing distribution points at the data link layer for voice communication; and
forming a peer relationship with communicating existing distribution points at the network layer for data communication.

8. A communications network for distributing packetized information comprising:
a supervisor operative to supply a plurality of pools of ATM end user addresses and a plurality of pools of IP addresses;
a plurality of access points, each access point operative to transmit packets to and receive packets from at least one subscriber unit; and
a plurality of distribution points, the access points and distribution points forming a network, each distribution point in communication with at least one other distribution point and with the supervisor, each access point in communication with at least one distribution point, each distribution point operative to
(a) obtain a pool of ATM end user addresses from the supervisor,
(b) obtain a pool of IP addresses from the supervisor,
(c) receive a request from a new network element to join the network,
(d) provide the new network element with an ATM end user address from the pool of ATM end user addresses, and
(e) provide the new network element with an IP address from the pool of IT addresses.

9. A communications network as in claim 8 wherein the new network element is a new distribution point.

10. A communications network as in claim 9 wherein the new distribution point forms a peer-to-peer relationship with the existing distribution point at the data link layer for voice communication and forms a peer-to-peer relationship with the existing distribution point at the network layer for data communication.

11. A communications network as in claim 8 wherein at least one distribution point is operative to function as an access point.

12. A communications network as in claim 8 wherein the new network element is a new access point.

13. A communications network as in claim 12 wherein the new access point forms a client relationship with the existing distribution point as a server at the data lint layer and the new access point forms a client relationship with the existing distribution point as a server at the network layer.

14. A communications network as in claim 12 wherein at least one access point is a local radio access point in wireless communication with at least one subscriber unit.

15. A communications network as in claim 12 wherein at least one access point is in wireline communication with at least one subscriber unit.

16. A communication network as in claim 12 wherein at least one access point is in wireless communication with at least one subscriber unit.

17. A communications network as in claim 12 wherein at least one access point is operative to function as a distribution point.

18. A communication network as in claim 8 wherein each distribution point is further operative to:
determine that the new network element is no longer joined to the network;
recover the ATM end user address provided from the pool of ATM end user addresses; and
recover the IP address provided from the pool of IP addresses.