# Patent

## Title
IP video delivery using flexible channel bonding

## Abstract

An IP video delivery system and method that allocates a first number of video streams for delivery on a number of channels that, provides a number of bonding groups, where each bonding group bonds at least one of the channels, and allocates a second number of video streams for delivery on the bonding groups. In one aspect, the method delivers the first video streams as unbonded on the channels. The bonding groups utilize bandwidth unused by the first video streams. In one aspect, the method utilizes bandwidth unused by the first or second video streams for high speed data. The method provides instantaneous load balancing to spread the first and second video streams across all available bandwidth in the channels, and delivers those video streams using a variable bit rate with no additional statistical multiplexing rate shaping to fit video streams into the channels.

## Background
RELATED APPLICATION
This application for letters patent relates to and claims the benefit of U.S. Provisional Patent Application Ser. No. 61/229,269, titled “IP Video Delivery Using Flexible Channel Bonding”, and filed on Jul. 28, 2009; the disclosure of which this application hereby incorporates by reference.


BACKGROUND
Data Over Cable Service Interface Specification (DOCSIS) 3.0 technology with its multiple bonded channels is enabling new services such as Internet Protocol (IP) Video delivery over the larger DOCSIS 3.0 pipe. These video streams are typically delivered as multicast packets to a cable modem termination system (CMTS) and “switched” by the CMTS so that only those video streams being watched are actually sent down a DOCSIS channel. Today, Constant Bit Rate (CBR) video streams are typically used because of the simplified traffic management associated with them. Variable Bit Rate (VBR) video streams provide a significantly lower overall average bit rate than CBR (e.g., 30-40%), but it may have peak rates that are two to three times its average rate. If multiple VBR streams in a given channel peak simultaneously, the bandwidth required may exceed the capacity of the channel. Since the video streams might not be encoded jointly, this phenomenon is non-deterministic and may result in dropped packets. With the extensive encoding used in video streams today, each dropped packet can introduce significant impairments to the video quality. If the channel congestion causes the Customer Premises Equipment (CPE) video buffers to underflow, some decoders have been known to lock and require a reset. With today's high-definition services, quality is an extremely important feature so dropped packets are a significant issue.
Today, VBR is often used for broadcast video services where a Statistical Multiplexer can rate shape the peaks as needed to keep the bandwidth within the channel capacity and prevent dropped packets. However, the complexity of Statistical Multiplexers makes them economically unfeasible to use for extensive narrowcast services with smaller service groups expected in IP Video systems.
Some IP Video delivery systems have packet recovery algorithms. These could potentially be used to recover packets that are dropped when the channel capacity is exceeded. The drawbacks of this approach are the added costs of the repair servers and added buffer delays needed to account for the detection, request and re-transmission of dropped packets. Another common packet recovery method is to provide packet level forward error correction (FEC) that the CPE client can use to recover dropped packets. The drawbacks of this approach are the 5% to 20% additional channel capacity required to send the FEC and the extra processing power required by the CPE.
A problem is caused by current bonding limitations with DOCSIS 3.0 devices. For example, to scale IP Video to service groups of several hundred subscribers could require a total 16 to 24 channels for IP Video, which exceeds the abilities of today's commercially available cable modems and cannot be bonded into a single bonding group. Today's commercially available cable modems support only the minimum DOCSIS 3.0 required 4 bonded channels; and even next generation modems about to come to market provide a maximum of 8 bonded channels, some of which are needed for high speed data service, instead of IP Video. Dividing 16 to 24 IP video channels into smaller 4-8 channel bonding groups reduces the overall statistical advantages gained and increases the total number of channels needed. At the same time, choosing a fixed sized bonding group (e.g., 4 bonded channels) for the IP Video service excludes any other devices that may, for example, only have 1, 2 or 3 channels available for the IP Video service.
The prior art in Ramakrishnan, “Scaling the DOCSIS Network for IPTV,” SCTE ET 2009 (hereinafter referred to as “Ramakrishnan”), discloses a packing efficiency improvement provided by 4-channel bonding. FIG. 1A and FIG. 1B depict an illustrative comparison of 4 separate quadrature amplitude modulation (QAM) channels to a 4-channel bonding group, in accordance with the prior art. In one embodiment, the QAM channels are 6-MHz North American signals. FIG. 1A shows 4 separate (and unbonded) QAM channels (QAM1-QAM4) having a channel capacity that allow 10 unbonded standard-definition (SD) streams (SD1-SD10) and 5 unbonded high-definition (HD) streams (HD1-HD5), but leaving QAM channel capacity that is not used because it is not sufficient to allow any additional unbonded HD streams. FIG. 1B shows 4 bonded QAM channels (QAM1-QAM4) having a channel capacity that allow 10 bonded SD streams (SD1-SD10) and 7 bonded HD streams (HD1-HD7). Thus, 4 bonded QAM channels can provide more video capacity than 4 separate (and unbonded) QAM channels.
The prior art in Bernstein & Liu, “VBR Video Services in DOCSIS 3.0 Networks,” NCTA 2008 (hereinafter referred to as “Bernstein”) reach a similar conclusion to Ramakrishnan. Bernstein discloses that VBR in a 4-channel bonding group provided a 57.5% increase (i.e., 63 streams for 4 channels); while VBR in a single unbonded channel provided a 40% increase (i.e., 14 streams for a single channel, or 56 streams across 4 single channels). For example, in Bernstein, FIG. 4 illustrates VBR network statistical multiplexing bandwidth utilization improvement. Hence, Bernstein discloses that bonding 4 channels together can provide an increase in video capacity from 56 to 63 streams. The problem now is that all devices wishing to see these video services must support 4 bonded channels. All other devices cannot access this content.
There is a demand for an IP video delivery method and system to allocate flexibly sized bonding group over unbonded channels. The presently disclosed invention satisfies this demand.
SUMMARY
Aspects of the present invention provide an IP video delivery system and method that allocates a first number of video streams for delivery on a number of channels that, provides a number of bonding groups, where each bonding group bonds at least one of the channels, and allocates a second number of video streams for delivery on the bonding groups. In one aspect, the method delivers the first video streams as unbonded on the channels. The bonding groups utilize bandwidth unused by the first video streams. In one aspect, the method utilizes bandwidth unused by the first or second video streams for high speed data. The method provides instantaneous load balancing to spread the first and second video streams across all available bandwidth in the channels, and delivers those video streams using a variable bit rate with no additional statistical multiplexing rate shaping to fit video streams into the channels.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1A and FIG. 1B depict an illustrative comparison of 4 separate quadrature amplitude modulation (QAM) channels to a 4-channel bonding group, in accordance with the prior art.
FIG. 2 is a network diagram that illustrates one embodiment of the hardware components of a system that performs the present invention.
FIG. 3 depicts a bonding group overlapping unbonded channels, in accordance with an embodiment of the present invention.
FIG. 4A, FIG. 4B, and FIG. 4C depict packing inefficiencies for SD and HD CBR streams, and show the impact of bonding and unbonded channels, in accordance with an embodiment.
FIG. 5A, FIG. 5B, and FIG. 5C depict multiplexing (muxing) inefficiencies for HD VBR, in accordance with an embodiment.
FIG. 6A and FIG. 6B depict leveraging bonding groups across HSD and IP Video, in accordance with an embodiment, and shows this scenario using MPEG-4/AVC HD VBR video streams.
FIG. 7A and FIG. 7B depicts leveraging bonding groups across HSD and IP Video, Overflow & Underflow, in accordance with an embodiment.
FIG. 8A and FIG. 8B depict multiple overlapping bonding groups in accordance with an embodiment.
FIG. 9 and FIG. 10 depict the four overlapping bonding groups described in FIG. 8A and FIG. 8B and extend each bonding group to also include the HSD QAM channels.



DETAILED DESCRIPTION
Aspects of the present invention address how to leverage VBR for IP Video services to support significantly more video streams than CBR, without incurring the dropped packets or the drawbacks of other state of the art implementations.
FIG. 2 is a network diagram that illustrates one embodiment of the hardware components of a system that performs the present invention. A broadband network 200 includes an Internet Protocol (IP) network 210 and a cable network 230. In one embodiment, the cable network 230 is a hybrid fiber-coaxial (HFC) network. The cable network 230 is a data and video content network that connects a customer location 240 to a cable modem termination system (CMTS) 220. The broadband network 200 shown in FIG. 2 may include any number of interconnected IP network 210, CMTS 220, cable network 230, and customer location 240.
The IP network 210 shown in FIG. 2, in one embodiment, is a public communication network or wide area network (WAN) that connects to the CMTS 220. The present invention also contemplates the use of comparable network architectures. Comparable network architectures include the Public Switched Telephone Network (PSTN), a public packet-switched network carrying data and voice packets, a wireless network, and a private network. A wireless network includes a cellular network (e.g., a Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), or Orthogonal Frequency Division Multiplexing (OFDM) network), a satellite network, and a wireless Local Area Network (LAN) (e.g., a Wireless-Fidelity (Wi-Fi) network). A private network includes a LAN, a Personal Area Network (PAN) such as a Bluetooth network, a wireless LAN, a Virtual Private Network (VPN), an intranet, or an extranet. An intranet is a private communication network that provides an organization such as a corporation, with a secure means for trusted members of the organization to access the resources on the organization's network. In contrast, an extranet is a private communication network that provides an organization, such as a corporation, with a secure means for the organization to authorize non-members of the organization to access certain resources on the organization's network. The system also contemplates network architectures and protocols such as Ethernet, Token Ring, Systems Network Architecture, Internet Protocol, Transmission Control Protocol, User Datagram Protocol, Asynchronous Transfer Mode, and proprietary network protocols comparable to the Internet Protocol.
The CMTS 220 provides the subscriber location 240 with various services and/or connections, such as support for data over cable service interface specification (DOCSIS), an instantaneous load balancing process 222, and the connection to the IP network 210. For example, the CMTS 220 may provide a connection to external services such as video servers, public switched telephone network voice, multimedia messages, and internet data.
In an embodiment of the present invention, an innovative use of DOCSIS 3.0 bonding groups together with the instantaneous load balancing process 222 in the CMTS 220 can enable the operator to use VBR with the highest quality (i.e., no additional rate shaping needed to fit video streams into QAM channels), and best utilization possible, while providing the greatest flexibility. Conventionally, DOCSIS bonding groups are typically thought of as fixed sized, non-overlapping groups, sometimes as hierarchical. However, in an embodiment, flexible channel bonding is a key to leveraging the full power of VBR.
An embodiment of a flexible channel bonding of the present invention with the instantaneous load balancing process 222 enables an exemplary system to fully utilize VBR video streams for IP Video delivery over cable. The complete original VBR stream is delivered to the customer location 240 for maximum video quality, compared to some schemes that rate shape the video stream for traffic management but impacts video quality. The flexibility is derived from popular content being sent down single channels that can be received by any DOCSIS device, regardless of the resources available for bonding. Furthermore, multiple-receive channel cable modems can receive the non-bonding popular IPTV without having to join a “bonding group” of a fixed 4 channels. Providing larger bonding groups for “Long Tail” content (i.e., less popular content) enables the IP Video channels to maximize utilization.
In general, “popular” content as used herein refers to content items accounting for a disproportionate share of demand. In one illustrative example of popularity of content, “popular” content may refer to the first 20% of content items in a rank-ordered distribution, such as a Pareto distribution—i.e., content items accounting for approximately a majority of demand—while “Long Tail” content may refer to the lower 80% of content items in a rank-ordered distribution, such as a Pareto distribution. In other illustrative implementations, “popular” content may be determined based on threshold values, such as the n most demanded items, or the n-th percentile of most demanded items, while “less popular” or “Long Tail” content refers to the remaining available content items. In further implementations, popularity may be determined based on actual demand, anticipated demand, or both.
Finally, the instantaneous load balancing process 222 among IP Video and high-speed data (HSD) channels allows the system to scale with large numbers of customer locations 240 and extensive amount of video programs and reach 100% average utilization. All of this is done, in an embodiment of the present invention, without using additional statistical multiplexing rate shaping to fit video streams into QAM channels which can degrade video quality or without causing the dropped packet issues prevalent in other approaches, which may force the use of packet recovery algorithms with their associated drawbacks.
Rather than treat the 4 channels as a single bonding group, an embodiment of flexible channel bonding of the present invention allows overlapping bonding groups. Consider that a single unbonded channel can be considered a bonding group of size one. As one example, we create five total bonding groups: four single channel groups (one per channel) and then a four-channel bonding group that spans all four channels. As video streams are added, they are put into available space on one of the single channel bonding groups. This continues until the groups fill up. At this point, there is not sufficient room on any one channel to add another stream. However, by putting additional streams in the 4-channel bonding group, the instantaneous load balancing process 222 spreads these video streams in available space across all 4 channels.
It is interesting to note that variations of the single-channel packing and bonding group overlay packing are possible. For example, it may be desirable to support a class of 2-channel bonding group services. In this case, those services may be allocated across a pair of channels (a 2-channel bonding group) together with single-channel services and 4-channel bonding group services. Alternately, if a set of modems are deployed that support only 4-channel bonding and newer modems support, say, 8-channel bonding groups, this overlapping of bonding groups (logically by service class) can be extended, with some single-channel services, some 2- or 3-channel services, and some 4-channel-group services able to be received by both older and newer modems. Thus, the flexibility of flexible bonding is over a wide range of bonding group combinations, not just a 1:N packing combination.
Referring to FIG. 1A, this means that the 10 SD and 5 HD streams are supported in separate unbonded channels, but aspects of the present invention provide for 2 additional HD streams to be placed in the 4-channel bonded group and fill the space that was previously “NOT USED”. These aspects of the present invention result in a new configuration shown in FIG. 3.
FIG. 3 depicts a bonding group overlapping unbonded channels, in accordance with an embodiment of the present invention. As shown in FIG. 3, in an illustrative embodiment, the net effect is that the 10 SD and 5 HD streams shown in the example of FIG. 1A can be accessed as unbonded channels by any capable modem, regardless of their resources available (i.e., they do not have to support 4-channel bonding). Also, the overall capacity of the network remains the same: in this example, 10 SD and 7 HD streams.
In the example in the Bernstein prior art, a single channel can support 14 SD streams so a total of 56 SD streams can be placed in the four single-channel bonding groups. In the illustrative embodiment depicted in FIG. 3, the total bandwidth available for use is the same as in the Bernstein example with 4-channel bonding group; therefore, the approach of this embodiment can support a total of 63 SD streams as well, with the 7 additional streams spread across the 4 channels in the 4-channel bonding group.
In practice, in the illustrative example of FIG. 3, the 56 more popular streams end up in single channel groups and can be used by any DOCSIS device independent of their available bonding resources. The 7 streams spread across the 4-channel bonding group will tend to be Long Tail or Video-On-Demand (VOD)/unicast content watched by a single user with no need to be shared. Thus, we achieve the best of both worlds—maximum VBR capacity with the ability to share video streams with any DOCSIS device regardless of the number of channels it has available.
The example in Bernstein assumed video encoded in MPEG-2. However, if we instead use MPEG-4/AVC encoded video, we will be able to get more video streams per QAM channel. With conventional technology, that would be approximately 5 HD CBR streams per QAM, or 20 SD CBR streams per QAM, or some combination thereof.
The cable network 230 shown in FIG. 2 is a broadband network that combines optical fiber and coaxial cable, technology that has been commonly employed globally by cable television operators since the early 1990s. The fiber optic network extends from the cable operators master head end, sometimes to regional head ends, and out to a neighborhood hubsite, and finally to a fiber optic node that serves anywhere from 25 to 2000 homes. The master head end will usually have satellite dishes for reception of distant video signals as well as IP aggregation routers. Some master head ends also house telephony equipment for providing telecommunications services to the community. The regional head ends receive the video signal from the master head end and add to it the Public, Educational and/or Governmental (PEG) channels as required by local franchising authorities or insert targeted advertising that would appeal to the region. The various services are encoded, modulated and up-converted onto RF carriers, combined onto a single electrical signal and inserted into a broadband optical transmitter. This optical transmitter converts the electrical signal to a downstream optically modulated signal that is sent to the nodes. Fiber optic cables connect the head end to optical nodes in a point-to-point or star topology, or in some cases, in a protected ring topology.
The customer location 240 shown in FIG. 2, in one embodiment, is the premises, such as a home, of a customer such as a cable subscriber. The customer location 240 includes a cable modem 242, customer premises equipment (CPE) 244, and a display device 246. In various embodiments, the CPE 244 is a set-top box or Digital Television (DTV) Converter (DTC), and the display device 246 is an Internet Protocol Television (IPTV) or analog television.
The cable modem 242 shown in FIG. 2, in one embodiment, is a general-purpose computing device that performs the present invention. A bus 250 is a communication medium that connects a processor 255, data storage device 260 (such as a Serial ATA (SATA) hard disk drive, optical drive, Small Computer System Interface (SCSI) disk, flash memory, or the like), communication interface 265, and memory 270 (such as Random Access Memory (RAM), Dynamic RAM (DRAM), non-volatile computer memory, flash memory, or the like). The communication interface 265 connects the cable modem 242 to the cable network 230 and allows for communication of data and content. In one embodiment, the cable modem 242 is implemented as an application-specific integrated circuit (ASIC).
The processor 255 performs the disclosed methods by executing the sequences of operational instructions that comprise each computer program resident in, or operative on, the memory 270. The reader should understand that the memory 270 may include operating system, administrative, and database programs that support the programs disclosed in this application. In one embodiment, the configuration of the memory 270 of the cable modem 242 includes a DOCSIS program 272, and a flexible channel bonding program 274. The DOCSIS program 272 is a program that implements the DOCSIS 3.0 specification. The DOCSIS program 272 and flexible channel bonding program 274 perform the methods of the present invention disclosed in the examples depicted in FIG. 4B, FIG. 4C, FIG. 5A, FIG. 5B, FIG. 5C, FIG. 6A, FIG. 6B, FIG. 7A, FIG. 7B, FIG. 8A, FIG. 8B, FIG. 9, and FIG. 10. When the processor 255 performs the disclosed methods, it stores intermediate results in the memory 270 or data storage device 260. In another embodiment, the memory 270 may swap these programs, or portions thereof, in and out of the memory 270 as needed, and thus may include fewer than all of these programs at any one time.
FIG. 4A, FIG. 4B, and FIG. 4C depict packing inefficiencies for SD and HD CBR streams, and show the impact of bonding and unbonded channels, in accordance with an embodiment. As we saw previously, the unbonded QAMs may have unused capacity because any single QAM may not be able to add additional HD video. The bonded QAM channels (QAM1-QAM4) shown in FIG. 4A support 24 SD streams (SD1-SD24) and 14 HD streams (HD1-HD14), while the unbonded QAM channels (QAM1-QAM4) shown in FIG. 4B only support 24 SD streams (SD1-SD24) and 12 HD streams (HD1-HD12). FIG. 4C depicts the addition of an overlapping bonding group to the unbonded QAM channels (QAM1-QAM4) that allows two additional HD streams (HD Bonding Group 1-4 and HD Bonding Group 2-3) to be supported, thus matching the number of bonded QAM channels shown in FIG. 4A with 24 SD streams (SD1-SD24) and 14 HD streams (HD1-HD14).
FIG. 4A, FIG. 4B, and FIG. 4C depict how the overlapping bonding group on unbonded channels can overcome inefficiencies when packing SD and HD CBR video streams together and there is not sufficient room for additional HD streams. Another inefficiency problem arises, however, when using VBR video streams. An example using MPEG-4/AVC HD VBR streams is shown in FIG. 5A, FIG. 5B, and FIG. 5C.
FIG. 5A, FIG. 5B, and FIG. 5C depict multiplexing (muxing) inefficiencies for HD VBR, in accordance with an embodiment. FIG. 5A depicts the baseline scenario. Based on today's technology, one might be able to reasonably fit 5 HD VBR streams in a single QAM (A1-A5 in QAM1, B1-B5 in QAM2, C1-C5 in QAM3, D1-D5 in QAM4, and E1-E5 in QAM5) without a significant probability of channel overflow and dropped packets. Using the methodology in Bernstein, one might expect 4-bonded channels to support 24 HD VBR streams.
Advantageously, using embodiments of the innovation described herein, a 4-channel bonding group can be overlaid on top of the four unbonded QAM channels. This would allow another 4 HD VBR streams (BG1-BG4) to be supported as shown in FIG. 5B and FIG. 5C. It should be noted that FIG. 5B and FIG. 5C depict the same set of video streams at different points of time. The 20 unbonded HD streams (A1-A5, B1-B5, C1-C5, and D1-D5) remain on their respective QAM channel, but the four bonded HD streams (BG1-BG4) are flexibly sized (i.e., the size of each bonding group may vary) and dynamically moved to the QAM with excess bandwidth (i.e., bandwidth that is available because it was not used when allocating the video streams to individual unbonded channels). This action is called dynamic load balancing. By overlaying a bonding group over unbonded channels, the present invention also achieves 24 HD VBR streams over 4 QAMs, but with the benefit that 20 HD VBR streams remain unbonded.
It should be noted that while the illustration of FIG. 5A, FIG. 5B, and FIG. 5C show all streams as contiguous (i.e., occupying adjacent QAMs), in another embodiment, the streams may be non-contiguous (i.e., allocated across non-adjacent QAMs).
A further benefit of an embodiment of the present innovation is increased video utilization compared to traditional approaches as shown in Bernstein. Bernstein describes an experiment that shows a 4-channel bonding group achieving an efficiency of 91.3% (i.e. full utilization would be 69 video streams). (See FIG. 3 of Bernstein.) Bernstein experimentally used SD encoded video and a HITS video source that is highly multiplexed and rate shaped, and found that using higher rate HD traffic and true unmodified VBR video sources, the efficiency will be lower and starts to approach 80%.
With the flexible channel bonding approach of an embodiment of the present invention, the 4-channel bonding group shown in FIG. 5A, FIG. 5B, and FIG. 5C can be expanded to also include the High Speed Data (HSD) channels. The HSD channels may support many different types of services. In general, these have the characteristic of being less time/delay sensitive then a live video service. Some example of services on the HSD channels might include best effort data traffic, web surfing, internet-based video viewing (e.g., adaptive streaming) or even pre-stored video such as video-on-demand HSD service rates are often calculated over many seconds, as compared to VBR video bursts and peaks which are sub-second. Let's assume 8-channels for this example. By sharing across a larger pipe, the four IP Video channels can now be run at 100% utilization (e.g., 69 streams in Bernstein). Using the example from Bernstein, the 56 most popular video streams will be placed in the four single-bonded groups. This time, an additional 13 streams are placed in the 8-channel bonding group. Conceptually, the instantaneous load balancing of a bonding group can try to keep these streams in the 4 IP Video channels. On average, these keep 100% full and the HSD service has four channels of total bandwidth. When the aggregate VBR traffic bursts exceed the capacity of the 4 IP Video channels, the excess video traffic automatically overflows onto the HSD channels. Conversely, when the aggregate VBR traffic is less than the capacity of the four IP Video channels, the instantaneous load balancer can move excess HSD traffic to the IP Video channels. Hence, over time, both HSD and IP Video can average 100% utilization of each of their four channels.
FIG. 6A and FIG. 6B depict leveraging bonding groups across HSD and IP Video, in accordance with an embodiment, and shows this scenario using MPEG-4/AVC HD VBR video streams. FIG. 6A depicts the previous example where the HSD and the IP Video are isolated 4-channel bonding groups (QAM1-QAM4 and QAM5-QAM8, respectively). FIG. 6B depicts the HSD and IP Video bonding groups merged into a single 8-channel bonding group (QAM1-QAM8). The unbonded HD VBR streams (A1-A5, B1-B5, C1-C5, and D1-D5) always remains on the IP Video QAMs (QAM5-QAM8). In this example, the bonded HD VBR streams (BG1-BG4) are nominally put in the IP Video QAMs (QAM5-QAM8) as well. On average, the bonded HD VBR streams (BG1-BG4) will fill up the rest of the IP Video QAMs (QAM5-QAM8) while data fills the HSD QAMs (QAM1-QAM4). Note that 3 additional bonded HD streams (BG5-BG7) have been in FIG. 6B due to the excess bandwidth that was reserved to allow the VBR streams to peak.
FIG. 7A and FIG. 7B depicts leveraging bonding groups across HSD and IP Video, Overflow & Underflow, in accordance with an embodiment. FIG. 7A and FIG. 7B demonstrate what happens as the VBR traffic grows and shrinks. In FIG. 7A, the VBR streams have collectively peaked and overflowed the IP Video QAMs (QAM5-QAM8). While the 20 unbonded HD streams (A1-A5, B1-B5, C1-C5, and D1-D5) remain on their respective IP Video QAM (QAM5-QAM8), several of the bonded HD streams (BG1-2, BG3-2, BG6, and BG7) are scheduled on the HSD QAMs (QAM1-QAM4) to alleviate the bandwidth pressure. In FIG. 7B, the VBR traffic has collectively shrunk and the IP Video QAMs (QAM5-QAM8) are no longer fully utilized. With the extended 8-channel bonding group, the CMTS 220 can now schedule HSD traffic on the IP Video QAMs (QAM5-QAM8). FIG. 7A and FIG. 7B are two different snapshots in time showing that the average HSD traffic should approach its original bandwidth from the four HSD QAMs (QAM1-QAM4).
A further benefit of the approach of this embodiment is that it also eliminates the possibility of dropped video packets due to congestion. This is because IP video is prioritized over High Speed Data. When VBR capacity temporarily exceeds the 4 channels allocated for IPTV, the excess “crowds out” the HSD traffic, potentially causing an HSD packet delays and possible drops. HSD protocols are almost exclusively with TCP, which automatically retransmits dropped packets. In Bernstein, they recognize that with their fixed bonding group approach that there is still some probability of a dropped packet and that a packet recovery algorithm is needed. A packet FEC approach would consume an additional 5-20% of the bandwidth capacity; while a re-transmission approach adds a Repair Server and introduces additional delay into the path to compensate for detection, requesting and re-transmitting dropped packets. With an embodiment of the presently disclosed invention, there is zero IP video packet loss, zero increased overhead for IP video FEC, and zero increased cost of recovery servers. These advantages can be achieved by combining lossless VBR IP video with loss-tolerant HSD data on the same DOCSIS 3.0 bonding group.
The next major advantage of an embodiment of the present invention is its ability to scale for large numbers of subscribers. As IP Video scales to hundreds of subscribers and hundreds of offered video programs, the total need for video streams, especially with lots of HD content, exceeds the capacity for a single 4-channel grouping. For example, a 4-channel bonding group may only be able to support two dozen HD streams, much less than the 100's of programs that are being planned to be offered. A system may need something on the order of 16 to 24 channels to deliver hundreds of HD and SD programs to hundreds of subscribers. This would require four or more separate 4-channel bonding groups from our previous example.
If one were to keep the fixed non-overlapping groups of conventional systems, problems would be introduced. Since consumer devices can only be in one bonding group at a time, devices may need to switch bonding groups to access different content. Many devices will be capable of receiving several video streams; maybe as many as a half dozen streams (e.g., 3 or 4 TVs/PCs and a couple of recordings to a DVR). As a device requests each additional video stream, it now becomes likely that these streams are in different bonding groups. The system is now forced to add a new bonding group (i.e., 4 more channels) to enable this device to watch its unique combination of programs. Popular content will most likely need to get replicated across different bonding groups, increasing the number of channels needed. In this example, this could cause a large step increase of 25% in the number of needed channels (i.e., increase from 4 to 5 bonding groups).
However, embodiments of the Flexible Channel Bonding scheme of the present invention can be extended to easily handle this scenario. Popular content is sent in single-channel bonding groups which is accessible by any cable modem. If the device needs multiple video streams, it is only limited by the range of its wideband tuner; it is not limited by a fixed 4-channel bonding group. The Long Tail and VOD/unicast content sent to individual subscribers is assigned to larger bonding groups (e.g., 4-channel) and is spread across these channels to fully utilize the channels as described above.
FIG. 8A and FIG. 8B depict multiple overlapping bonding groups in accordance with an embodiment. By selectively introducing overlapping bonding groups, the innovation can effectively get the statistical multiplexing advantages of the entire set of channels, not just limited to the size of the bonding group. To demonstrate, let's consider a system with 8 total IP video channels (QAM1-QAM8) but a bonding group size of 4-channels. This is shown in FIG. 8A and FIG. 8B. We can create four separate but overlapping bonding groups that cover the following bonding group channel sets: {A, B, C, D}, {E, F, G, H}, {A, C, E, G} and {B, D, F, H}, where video channel A maps to QAM1, video channel B maps to QAM2, video channel C maps to QAM3, video channel D maps to QAM4, video channel E maps to QAM5, video channel F maps to QAM6, video channel G maps to QAM7, and video channel H maps to QAM8. Next, assume that aggregate VBR peak rates have filled video channels A and B with unbonded video so there is little or no room left for any 4-channel bonded video. With instantaneous load balancing, the {A, B, C, D} group can move its HD video streams onto channels C and D. With channels A, B, C, and D now filled, the {A, C, E, G} group must utilize bandwidth on E and G; while the {B, D, F, H} group must utilize bandwidth on channels F and H. In turn, the {E, F, G, H} group must be moved to accommodate the new demands on those channels. Hence, the peaks on channel A and B cause the 4-channel bonded video to get spread across channels C thru H making this statistically an 8-channel group. It will be apparent that, without departing from the scope of the invention, overlapping bonding groups can be extended across many variations of bonding group sizes and overlapping groups to get the best utilization.
Furthermore, 100% utilization can be reached by including the HSD channels and using instantaneous load balance algorithm across multiple bonding groups as described above. As an example, let's assume the Long Tail content is spread across four groups of channels (called A, B, C, D) of 4 channels each. Four bonding groups are created that all overlap with the HSD channels. These bonding groups are: HSD+A, HSD+B, HSD+C and HSD+D. Let us assume that the aggregate VBR traffic bursts exceeds the capacity for channel groups A and C. The instantaneous load balancing algorithm can schedule the excess VBR video traffic on the HSD channels. This is identical to what was described above except now we have two overlapping bonding groups instead of one.
Now let us assume at this same time, the aggregate VBR traffic in groups B and D is below its capacity. The instantaneous load balancing algorithm can move HSD traffic to channels in groups B and D for all cable modems in those bonding groups. If this traffic amount equals the amount of A and C traffic overflow, then the system has load balanced the VBR video across all 16 channels and the HSD channels provide 4 channels of bandwidth on average.
The overlapping of bonding groups can be created in many different combinations. For instance in the example above, group A and group B may share several channels. This may become advantageous as the system expands from additional content and/or additional subscribers. Additional channels can be added to the system one at a time as needed. If you add a 17th channel to the example above, a new bonding group E can be created from this new channel plus some other channels that overlap with A, B, C and/or D. The innovation does not limit the number of combinations possible.
In FIG. 9 and FIG. 10, as a final example, we extend the four overlapping bonding groups described in FIG. 8A and FIG. 8B, and extend each bonding group to also include the HSD QAM channels.
The current state of art in conventional cable modem technology is limited to 8 DOCSIS QAM channels. For the total system pictured in FIG. 9 and FIG. 10, there are 4 HSD DOCSIS QAM channels (QAM1-QAM4) and 8 IP Video channels (QAM5-QAM12). Since the cable modem can only bond up to 8 channels of the 12 total, any given cable modem can channel bond a subset of the total channels. In the illustrative example depicted in FIG. 9 and FIG. 10, an embodiment defines four different bonding groups. Each bonding group (BG) consists of the four HSD QAM channels and 4 of the 8 IP Video channels.
The first BG consists of the HSD QAMs (QAM1-QAM4) plus the IP Video QAMs {QAM5-QAM8}. The second BG is the HSD QAMs (QAM1-QAM4) and IP Video QAMs {QAM9-QAM12}. The third BG is the HSD QAMs (QAM1-QAM4) and IP Video QAMs {QAM5, QAM7, QAM9, QAM11}. The fourth BG is the HSD QAMs (QAM1-QAM4) and IP Video QAMs {QAM6, QAM8, QAM10, QAM12}. Note that the third and fourth BGs overlap with the first and second BG. Hence the term “Overlapping bonding groups”. It is this concept of overlapping bonding groups that is key to being able to dynamically load balance the traffic across the different DOCSIS QAMs.
FIG. 9 depicts multiple overlapping bonding groups, in accordance with an embodiment, and shows the nominal case where the data traffic remains on the HSD QAMs (QAM1-QAM4) while the four bonding groups are spread across the IP Video QAM channels (QAM5-QAM12). It is worth noting that if service demands require, it is possible to set other nominal cases, such as video service utilizing 110% “video” resources; that is, 100% of the video channels and 10% of the HSD channels. So, while our example uses a nominal or quiescent point of 100%, other values are possible. One benefit of this is that it would allow for more graceful handling of peak-busy-hour conditions by avoiding program request blocking at the expense of temporarily higher HSD overbooking.
In FIG. 10, which also depicts multiple overlapping bonding groups in accordance with an embodiment, we now consider what happens as the collective VBR streams in channels A and B (QAM5 and QAM6) expands while we see a general reduction in VBR bandwidth in the other IP Video QAMs (QAM7-QAM12). While some of the bonded traffic that used to be on A and B (QAM5 and QAM6) got moved to C and D (QAM7 and QAM8), some of it also got moved to the HSD QAMs (QAM1-QAM4). At the same time a reduction in channels E-H (QAM9-QAM12) allows some data traffic to be scheduled on those IP Video QAM channels. Thus, combining overlapping bonding groups extended to include HSD provides an optimum amount of scheduling flexibility, while allowing the majority of HD VBR streams to be delivered as unbonded traffic in a single channel that any CPE 244 device can access.
An embodiment of a Flexible Channel Bonding scheme with instantaneous load balancing can be used with CMTS 220 implementations. In further embodiments, Flexible Channel Bonding with instantaneous load balancing can also be used with CMTS 220 Bypass architectures. In further embodiments, Flexible Channel Bonding with instantaneous load balancing could be deployed in edge devices.
For example, in an illustrative embodiment applying this innovation to CMTS 220 Bypass architectures, the video content goes directly to the Edge Device (e.g., Edge QAM modulator) and bypasses the CMTS 220. The system's Session Manager that controls the Edge Device can instruct it, for each video stream, which channels are part of its bonding group. Some may have a single channel (e.g., popular content) while others may be in a larger (e.g., 4-channel) bonding group.
The additional benefits gained by multiplexing the IP Video and HSD channels are possible with CMTS 220 Bypass architectures, with the following illustrative adaptations: in such an embodiment, the HSD channels (QAM1-QAM4) will be generated from a Modular CMTS (M-CMTS) core and sent to the Edge Device. The Edge Device needs to provide flow control information back to the M-CMTS. As video traffic overflows to the HSD channels (QAM1-QAM4), the Edge Device needs to inform the M-CMTS of the reduced capacity of the HSD channels. Similarly, the Edge Device can inform the M-CMTS of excess capacity on different IP Video channels, and the M-CMTS can provide DOCSIS data to fill the IP Video channels.
The additional benefits gained by multiplexing the IP Video and HSD channels are possible with CMTS 220 Bypass architectures, with the following illustrative adaptations: in such an embodiment, the HSD channels (QAM1-QAM4) will be generated from an Integrated CMTS (I-CMTS) core and the IP Video channels (QAM5-QAM12) generated from an Edge Device. As video traffic overflows the IP Video channels (QAM5-QAM12), the Edge Device forwards the excess video to the HSD channels (QAM1-QAM4) on the I-CMTS. The I-CMTS schedules the excess video on its HSD channels (QAM1-QAM4) at an appropriate priority level to the best effort data. Similarly, the Edge Device can inform the I-CMTS of excess capacity on different IP Video channels (QAM5-QAM12), and the I-CMTS can provide best effort DOCSIS data to fill the IP Video channels (QAM5-QAM12) on the Edge device.
Although the disclosed embodiments describe a fully functioning method and system for IP video delivery, the reader should understand that other equivalent embodiments exist. Since numerous modifications and variations will occur to those reviewing this disclosure, the method and system for IP video delivery is not limited to the exact construction and operation illustrated and disclosed. Accordingly, this disclosure intends all suitable modifications and equivalents to fall within the scope of the claims.

## Claims

1. A method for IP video delivery, comprising:
allocating a first number of video streams for delivery on a number of channels, wherein the first number of video streams include at least one popular content item;
providing a number of bonding groups, wherein each bonding group bonds at least one of the channels; and
allocating a second number of video streams for delivery on the number of bonding groups.

2. The method of claim 1, wherein each bonding group is flexibly sized.

3. The method of claim 1, wherein the first number of video streams are delivered as unbonded on the number of channels, and wherein each channel is a DOCSIS channel.

4. The method of claim 1, wherein the number of bonding groups utilize bandwidth unused by the first number of video streams.

5. The method of claim 4, wherein high speed data utilizes bandwidth unused by the first number of video streams or the second number of video streams.

6. The method of claim 5, wherein the high speed data includes at least one of best effort data traffic, web surfing, adaptive streaming, and video-on-demand.

7. The method of claim 1, further comprising:
providing instantaneous load balancing to spread the first number of video streams and the second number of video streams across all available bandwidth in the number of channels.

8. The method of claim 7, further comprising:
delivering the first number of video streams and the second number of video streams using a variable bit rate with no additional statistical multiplexing rate shaping to fit video streams into the number of channels.

9. The method of claim 8, wherein each bonding group is flexibly sized and bonds at least one of the number of channels or at least one of a number of high speed data channels.

10. A method for IP video delivery, comprising:
allocating a first number of video streams for delivery on a number of channels;
providing a number of bonding groups, wherein each bonding group bonds at least one of the channels; and
allocating a second number of video streams for delivery on the number of bonding groups, wherein the second number of video streams include at least one long tail content item.

11. An IP video delivery system that includes a computing device, comprising:
a memory device resident in the computing device; and
a processor disposed in communication with the memory device, the processor configured to:
allocate a first number of video streams for delivery on a number of channels, wherein the first number of video streams include at least one popular content item;
provide a number of bonding groups, wherein each bonding group bonds at least one of the channels; and
allocate a second number of video streams for delivery on the number of bonding groups.

12. The system of claim 11, wherein each bonding group is flexibly sized.

13. The system of claim 11, wherein the first number of video streams are delivered as unbonded on the number of channels, and wherein each channel is a DOCSIS channel.

14. The system of claim 11, wherein the number of bonding groups utilize bandwidth unused by the first number of video streams.

15. The system of claim 14, wherein high speed data utilizes bandwidth unused by the first number of video streams or the second number of video streams.

16. The system of claim 15, wherein the high speed data includes at least one of best effort data traffic, web surfing, adaptive streaming, and video-on-demand.

17. The system of claim 11, wherein the processor is further configured to:
provide instantaneous load balancing to spread the first number of video streams and the second number of video streams across all available bandwidth in the number of channels.

18. The system of claim 17, wherein the processor is further configured to:
deliver the first number of video streams and the second number of video streams using a variable bit rate with no additional statistical multiplexing rate shaping to fit video streams into the number of channels.

19. The system of claim 18, wherein each bonding group is flexibly sized and bonds at least one of the number of channels or at least one of a number of high speed data channels.

20. An IP video delivery system that includes a computing device, comprising:
a memory device resident in the computing device; and
a processor disposed in communication with the memory device, the processor configured to:
allocate a first number of video streams for delivery on a number of channels;
provide a number of bonding groups, wherein each bonding group bonds at least one of the channels; and
allocate a second number of video streams for delivery on the number of bonding groups, wherein the second number of video streams include at least one long tail content item.

21. A non-transitory computer-readable medium, comprising computer-executable instructions that, when executed on a computing device, perform steps of:
allocating a first number of video streams for delivery on a number of channels, wherein the first number of video streams include at least one popular content item;
providing a number of bonding groups, wherein each bonding group bonds at least one of the channels; and
allocating a second number of video streams for delivery on the number of bonding groups.

22. A non-transitory computer-readable medium, comprising computer-executable instructions that, when executed on a computing device, perform steps of:
allocating a first number of video streams for delivery on a number of channels;
providing a number of bonding groups, wherein each bonding group bonds at least one of the channels; and
allocating a second number of video streams for delivery on the number of bonding groups, wherein the second number of video streams include at least one long tail content item.