Source: http://www.google.com/patents/US6025877?dq=5,758,352
Timestamp: 2016-10-28 20:29:31
Document Index: 172105501

Matched Legal Cases: ['art, 12', 'art, 13', 'art, 14', 'art, 15', 'art, 16', 'art, 17', 'art 11', 'art 12', 'art 13', 'art 14', 'art 15', 'art 16', 'art 17', 'art 18', 'art 24', 'art 21', 'art 21', 'art 12', 'art 13', 'art 24', 'art 15', 'art 16', 'art 17', 'art 18', 'art 21', 'art 24']

Patent US6025877 - Scalable transmission method of visual objects segmented by content-base - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inPatentsThe present invention relates to a method of scalable transmission of video objects segmented by content-base, comprising the steps of: constituting a set of video objects to be transferred (TxSet); checking as to whether TxSet is the last portion of a video sequence, and then calculating a current transmission...http://www.google.com/patents/US6025877?utm_source=gb-gplus-sharePatent US6025877 - Scalable transmission method of visual objects segmented by content-baseAdvanced Patent SearchTry the new Google Patents, with machine-classified Google Scholar results, and Japanese and South Korean patents.Publication numberUS6025877 APublication typeGrantApplication numberUS 08/959,084Publication dateFeb 15, 2000Filing dateOct 28, 1997Priority dateOct 28, 1996Fee statusPaidPublication number08959084, 959084, US 6025877 A, US 6025877A, US-A-6025877, US6025877 A, US6025877AInventorsHee-Dong Chang, Young-Kwon LimOriginal AssigneeElectronics And Telecommunications Research InstituteExport CitationBiBTeX, EndNote, RefManPatent Citations (8), Non-Patent Citations (6), Referenced by (31), Classifications (27), Legal Events (9) External Links: USPTO, USPTO Assignment, EspacenetScalable transmission method of visual objects segmented by content-base
US 6025877 AAbstract
The present invention relates to a method of scalable transmission of video objects segmented by content-base, comprising the steps of: constituting a set of video objects to be transferred (TxSet); checking as to whether TxSet is the last portion of a video sequence, and then calculating a current transmission rate and a transmission tolerance data size; constituting a video object evaluation group (egs); comparing the data size of the video object evaluation group with a data size of TxSet elements plus a data amount of the video objects of the transmission priority j and then adding the video objection evaluation group (egs) to the TxSet; and checking as to whether the video object of the transmission priority j is the last element of the video object evaluation group i.
1. A scalable transmission method of video objects segmented by content-base, comprising the following steps of:constituting a set of video objects to be transferred (hereinafter, referred to as TxSet), and then transmitting said TxSet: checking as to whether said TxSet is the last portion of a video sequence, and then calculating a current transmission rate (hereinafter, referred to as TxRate) and a transmission tolerance data size; constituting a video object evaluation group (egs), and setting said TxSet; comparing the data size of the video object evaluation group (egs) with a data size (hereinafter referred to as TxSetSize) of said TxSet elements plus a data amount (hereinafter, referred to as ObjSize (j)) of the video objects of the transmission priority j, and then adding the video object evaluation group (egs) to the TxSet; and checking as to whether the video object (hereinafter referred to as Object (j) of the transmission priority j is the last element of the video object evaluation group i. 2. The method as in claim 1, wherein said step of constituting said TxSet, and then transmitting said TxSet includes the following steps of:constituting said TxSet with a compensated background objects and the video objects whose frame is 0, and then setting the video object evaluation group i at 1; and transmitting said TxSet. 3. The method as in claim 1, wherein said step of checking as to whether or not said TxSet is the last portion of the video sequence, and then calculating said TxRate and the transmission tolerance data size includes the following steps of:checking as to whether or not said TxSet is the last portion of the video sequence; finishing the operation in case said TxSet is the last portion, on the other hand, calculating said TxRate from said TxSet transmission in case said TxSet is not the last portion; and calculating the transmission data size of the egs, which can be received at the source frame rate under the current transmission speed, by using the following equation: egs=TxRate�FRate�n wherein, FRate represents the source frame rate, and n represents the number of the frame corresponding to the video object evaluation group, respectively. 4. The method as in claim 1, wherein said step of constituting a video object evaluation group, and setting said TxSet includes the following steps of:determining the transmission priority of the elements after constituting the video object evaluation group i; and presetting said TxSet with a set having no element, allocating the transmission priority j as 1, and presetting said TxSetSize with 0, respectively. 5. The method as in claim 1, wherein said step of comparing the data size of the video object evaluation group (egs) with said TxSetSize plus said ObjSize (j), and then changing the number of the TxSet includes of the following steps of:checking whether the TxSetSize plus said Object (j) is smaller than or equal to the transmission data size of the video object evaluation group (egs); returning to the step of transmitting said TxSet after changing i to i+1 in case said TxSetSize plus said Object (j) is larger than the transmission data size of the video object evaluation group (egs); and adding said Object (j) to said TxSet, and also adding said ObjSize (j) to said TxSetSize in case said TxSetSize plus said Object (j) is smaller than or equal to the transmission data size of the video object evaluation group (egs). 6. The method as in claim 1, wherein said step of checking as to whether or not said Object (j) is the last element of the video object evaluation group i includes the following steps of:checking as to whether or not said Object (j) is the last element of the transmission data size of the video object evaluation group i; returning to step of checking whether said TxSetSize plus said Object (j) is smaller than or equal to the transmission data size of the video object evaluation group (egs) after changing j to j+1 in case said Object (j) is not the last element; and returning to step of transmitting said TxSet after changing i to i+1 in case said Object (j) is the last element. 7. The method as in claim 4, wherein said transmission priority of the elements is determined by the transmission priority ranking, and then the encoding type, i.e., in the order of I type, P type and B type.
The present invention relates to a scalable transmission method of visual objects segmented by content-base in order to provide excellent video services, which are highly demanded in the Internet of which the transmission speed is variable.
In general, a content-based video encoding scheme is shown that a content of the input picture (for example, person, desk, flower and the like) is segmented into video objects, and then segmented video objects are coded. The principle of the coding and decoding is described in FIG. 1.
FIG. 1 illustrates an earlier schematic diagram of a video transmission system, wherein the reference numeral 11 represents the content-based object segmenting part, 12 represents the encoding part, 13 represents the multiplexing part, 14 denotes the transmitting part, 15 denotes the receiving part, 16 denotes the demultiplexing part, 17 denotes the decoding part, and 18 represents the picture reconstructing and displaying part, respectively.
As shown in FIG. 1, the content-based object segmenting part 11 segments an inputted video frame sequence for example, content-object sequence A, content-object sequence B, and background object sequence C. Then, the encoding part 12 encodes the above segmented video object sequences, respectively. Meanwhile, those encoded video object sequences are multiplexed by the multiplexing part 13, resulting in one bitstream. Then, the bitstream is transmitted by the transmitting part 14 via a network.
Once the transmitted bitstream arrives at the receiving part 15, the bitstream is demultiplexes into several encoded video object sequences by the demultiplexing part 16. Then, with the help of the decoding part 17, the encoded video object sequences are decoded to the original video object sequence. Finally, the picture reconstructing and displaying part 18 reconstructs the decoded video sequence for display by using the spatial and temporal information.
In the meantime, the encoding scheme for the video objects adopts the predictive encoding scheme which involves an Intra type (I type) encoding, a Predictive type (P type) encoding, and a bidirectionally predictive type (B type) encoding. In the I type encoding, the prediction is achieved within the object. In the P type encoding, the prediction having a forward characteristic with regard to time is achieved. As to the B type encoding, the prediction having a bidirectional characteristic with regard to time is accomplished.
Meanwhile, the I type encoding uses information only on the current frame for encoding. The P type encoding uses either the previous I or P type video object for encoding. Also, the B type uses both the previous I or P type object and the next I or P type object.
In addition, it is assumed that the encoding of the video objects recurs with a specific pattern, for example, IPBBP . . . IPBBP . . . IPBBP. The set of video objects having this specific pattern is called Group Of Pictures (hereinafter, referred to as GOP).
However, there has been a problem that the motion picture services, such as Video On Demand (hereinafter, referred to as VOD), can not guarantee a high quality on the Internet whose channel transmission speed is varying every point of time.
Therefore, it is the objective of the present invention to provide a method of scalable transmission of content-based segmented video objects by transferring video objects according to their transmission priority, after scaling down the data size of the frame for the purpose of receiving the transmitted video bitstream at the source frame rate. Thus, a high quality of the video can be obtained because the effect of the varying transmission speed is apparently minimized.
In accordance with one embodiment of the present invention, a scalable transmission method of video objects segmented by content base comprises the following steps of: constituting a set of the video objects to be transferred (hereinafter, referred to as TxSet), and then transferring the TxSet;
checking as to whether or not the TxSet is the last portion of the moving video sequence, and then calculating the current transmission rate (hereinafter, referred to as TxRate) and the transmission tolerance data size;
constituting a video object evaluation group, and setting the TxSet;
comparing the data size of the video object evaluation group (egs) with the number of the TxSet elements (hereinafter, referred to as TxSetSize) plus the data amount of the video objects of the transmission priority j (hereinafter, referred to as ObjSize (j)), and then changing the number of the TxSet elements; and
checking as to whether or not the video object of the transmission priority j (hereinafter, referred to as Object (j)) is the last element of the video object evaluation group i.
FIG. 1 illustrates an earlier schematic diagram of a video transmission system.
FIG. 2 illustrates a schematic diagram of a scalable video transmission system in accordance with the present invention.
FIG. 3 illustrates a background compensation method in accordance with the present invention.
FIG. 4 illustrates an arrangement of the video objects for determining the transmission priority in accordance with the present invention.
FIG. 5 illustrates a flow chart of the scalable transmission of the video objects in accordance with the present invention.
FIG. 2 illustrates a schematic diagram of a scalable video transmission system in accordance with the present invention. Also, FIG. 3 illustrates a background compensation method in accordance with the present invention.
Referring to FIG. 2, the scalable video transmission system segments the input video frames with the content-based method like FIG. 1, and then determines the transmission priority ranking for each video object, and also compensates the background objects as shown in FIG. 3.
Meanwhile, the video object sequence is encoded and multiplexed as shown in FIG. 1, and then the multiplexed video object bitstream follows the scalable transmission method by the scalable transmitting part 24. The next procedures are the same as that of the prior art as shown in FIG. 1.
That is, the scalable video transmission system is composed of the subsequence initiating part 21 for segmenting, and then initiating the video frame sequence into the subsequence having the same background (that is, the subsequence initiating part 21 is used for segmenting the content-based video objects, determining the transmission priority ranking, and compensating the background objects), the encoding part 12 for encoding the segmented object sequence by the video object, the multiplexing part 13 for multiplexing the encoded video object bitstream, the scalable transmitting part 24 for transmitting the multiplexed video object bitstream scalably, the receiving part 15 for receiving the transmitted bitstream, the demultiplexing part 16 for demultiplexing the received bitstream, the decoding part 17 for decoding the encoded video object sequence by the video object, and the scene reconstructing and displaying part 18 for reconstructing the decoded video sequence for display by using the spatial and temporal information.
Compared with the prior art, it can be easily seen that the core elements of the present invention are the subsequence initiating part 21 and the scalable transmitting part 24. Their feature and function are now described in detail.
In order to display the video data at the source frame rate, the proposed system should receive the video bitstream at the source frame rate. This can be realized by determining the size of the maximum data on the frame which can be received at the source frame rate under the current transmission speed of the network, and then selecting and transmitting the video objects according to the transmission priority.
Therefore, even though the size of the transmission data is varying scalably according to the change of the transmission speed, the transfer frame rate is the same as the input video frame rate. Also, because the video objects are transmitted according to the transmission priority, the important information of the scenes is fully received. Thus, the receiving end can obtain an excellent video which is nearly free from the effect resulting from the varying transmission speed.
More specifically, the video frame sequence is segmented into the subsequence having the same background, the video objects on the video frame are segmented by the content base (for example, person A, person B, desk, and chair). At this time, the objects having the same content have the same identification (ID) number. For instance, in case a video object A is allocated to a desk at a frame t, a desk at a frame t+s is also a video object A.
In the meantime, the transmission priority ranking of the segmented video objects has 3 rankings, i.e., ranking 1, ranking 2, and ranking 3. Of course, the number of the ranking can be increased or decreased according to the kind of the application. Hence, the video objects corresponding to a high ranking are transmitted earlier than the video objects with a low ranking.
The transmission priority ranking can be determined either automatically or manually, considering the content, importance, and motion characteristic of the video objects. That is, the transmission priority ranking can be determined automatically in the order of the moving degree.
Referring to the compensation of the background for each subsequence, the background is partially occluded by the foreground video objects. When the video objects are separated from the background, the information occupied by the video objects is lost. Therefore, in case all the background objects in the subsequence are finished with the calculation of summing their elements, the background whose information is least lost can be obtained as shown in FIG. 3. Even in case of restoring the display through the scene-composing video objects at an arbitrarily selected time, this compensated background does not make the vacant portion between the background and the video objects.
The sets of the video objects (hereinafter, referred to as a video object evaluation group) which are included in the frames of the Least Common Multiple (LCM) of the Group Of Pictures (hereinafter, referred to as GOP) length (that is, the number of the elements) are shown in FIG. 4, wherein since the GOP length of the video objects A, B, and C is 4, respectively, and the GOP length of the video object D is 2, the number of the frames corresponding to the video object evaluation group is 4.
In addition, as to the method of determining the transmission priority of each video object, the transmission priority is determined by the following manners:
first, in the transmission priority ranking order; and
second, in case of having the same transmission priority ranking, in the encoding type order, i.e., I type, P type, and finally B type.
For example, as shown in FIG. 4, in case of determining the transmission priority regarding the objects whose object video sequence is B, and video object evaluation group is j, their transmission priority begins with 9 since the objects have the transmission priority ranking 3, and then the last priority is finished with 12 according to the encoding type, i.e., in the order of I type, P type and B type.
FIG. 5 illustrates a flow chart of the scalable transmission of the video objects in accordance with the present invention, wherein TxSet represents the set of the video objects to be transmitted, TxSetSize represents the data size of TxSet, TxRate represents the current transmission rate, Object (j) represents the video object whose transmission priority is j, and ObjSize represents the amount of data of Object (j), respectively.
The TxSet is composed of the compensated background objects, and the video objects whose frame is 0, and then the video object evaluation group i is set at 1 (step 501). Then, the TxSet is transmitted (step 502). The TxSet is verified as to whether or not the TxSet is the last portion of the moving video sequence (step 503). In case the TxSet is the last portion, the operation is finished, on the other hand, in case the TxSet is not the last portion, the TxRate is calculated from the TxSet transmission (step 504).
In addition, the transmission data size of the video object evaluation group (egs), which can be received at the source frame rate under the current transmission speed, is calculated by the following equation (step 505):
egs=TxRate�FRate�n
wherein, egs is the transmission data size of the video object evaluation group, TxRate represents the current transmission rate, and FRate represents the source frame rate, and n represents the number of the frame corresponding to the video object evaluation group, respectively.
Then, after constituting the video object evaluation group i, the transmission priority of the elements is determined (step 506). Also, the TxSet is preset with a set having no element, and the transmission priority j is allocated as 1, and the TxSetSize is preset with 0, respectively (step 507).
Then, whether the TxSetSize plus Object (j) is smaller than or equal to the transmission data size of the video object evaluation group (egs) is checked (step 508).
In case the TxSetSize plus Object (j) is larger than the transmission data size of the video object evaluation group (egs), the process returns to step 502 after i is changed to i+1 (step 512). On the other hand, in case the TxSetSize plus Object (j) is smaller than or equal to the transmission data size of the video object evaluation group (egs), the object whose transmission priority j, Object (j) is added to the TxSet, and the ObjSize (j) is added to the TxSetSize (step 509).
In addition, the Object (j) is checked as to whether or not the Object (j) is the last element of the transmission data size of the video object evaluation group i (step 510). In case the Object (j) is not the last element, the process returns to step 508 after j is changed to j+1 (step 511). On the contrary, in case the Object (j) is the last element, the process returns to step 502 after i is changed to i+1 (step 512).
As described above, especially being used in the Internet having a great variation of the transmission speed, the present invention gives an excellent video service such as VOD because of receiving the video bitstream at the source frame rate.
Furthermore, since the video objects are transmitted according to the transmission priority, the receiving end can obtain a good quality of the video with the least effect resulting from the variation of the transmission speed.
Patent CitationsCited PatentFiling datePublication dateApplicantTitleUS5475430 *May 17, 1994Dec 12, 1995Kokusai Denshin Denwa Co., Ltd.Direct encoding system of composite video signal using inter-frame motion compensationUS5552829 *Feb 26, 1993Sep 3, 1996Samsung Electronics Co., Ltd.Image signal coding systemUS5623312 *Dec 22, 1994Apr 22, 1997Lucent Technologies Inc.Compressed-domain bit rate reduction systemUS5629736 *Nov 1, 1994May 13, 1997Lucent Technologies Inc.Coded domain picture composition for multimedia communications systemsUS5687095 *Nov 1, 1994Nov 11, 1997Lucent Technologies Inc.Video transmission rate matching for multimedia communication systemsUS5754766 *Aug 14, 1995May 19, 1998Shaw; Venson M.Integrated circuit system for direct document executionUS5786855 *Oct 26, 1995Jul 28, 1998Lucent Technologies Inc.Method and apparatus for coding segmented regions in video sequences for content-based scalabilityUS5805221 *Oct 30, 1995Sep 8, 1998Daewoo Electronics Co., Ltd.Video signal coding system employing segmentation technique* Cited by examinerNon-Patent CitationsReference1Hee Dong Chang et al., "A scalable Video Transmission Method over The Internet", Electronics and Telecommunications Research Institute.2 *Hee Dong Chang et al., A scalable Video Transmission Method over The Internet , Electronics and Telecommunications Research Institute.3Soumen Chakrabarti et al., "Adaptive Control for Packet Video", Proceedings of the International Conference on Multimedia Computing and Systems, May 1994, 1994 IEEE, pp. 56-62.4 *Soumen Chakrabarti et al., Adaptive Control for Packet Video , Proceedings of the International Conference on Multimedia Computing and Systems, May 1994, 1994 IEEE, pp. 56 62.5Thierry Turletti et al., "Videoconferencing on the Internet", IEEE/ACM Transactions on Networking , vol. 4, No. 3, Jun. 1996, pp. 340-351.6 *Thierry Turletti et al., Videoconferencing on the Internet , IEEE/ACM Transactions on Networking , vol. 4, No. 3, Jun. 1996, pp. 340 351.* Cited by examinerReferenced byCiting PatentFiling datePublication dateApplicantTitleUS6363413 *Jan 8, 1999Mar 26, 2002Intel CorporationMethod and apparatus for increasing the effective bandwidth of video sequences transmitted over a network by using cached dataUS7529270 *Sep 12, 2002May 5, 2009Pioneer CorporationCommunication information bandwidth control apparatus and methodUS7630570 *Nov 12, 2005Dec 8, 2009At&T Intellectual Property Ii, L.P.Method and apparatus to prioritize video information during coding and decodingUS7868912 *Apr 5, 2005Jan 11, 2011Objectvideo, Inc.Video surveillance system employing video primitivesUS7932923Sep 29, 2009Apr 26, 2011Objectvideo, Inc.Video surveillance system employing video primitivesUS7970722Nov 9, 2009Jun 28, 2011Aloft Media, LlcSystem, method and computer program product for a collaborative decision platformUS7983499Nov 23, 2009Jul 19, 2011At&T Intellectual Property Ii, L.P.Method and apparatus to prioritize video information during coding and decodingUS8005777Jul 27, 2010Aug 23, 2011Aloft Media, LlcSystem, method and computer program product for a collaborative decision platformUS8160988Jul 27, 2010Apr 17, 2012Aloft Media, LlcSystem, method and computer program product for a collaborative decision platformUS8374447 *Jul 13, 2011Feb 12, 2013At&T Intellectual Property Ii, L.P.Method and apparatus to prioritize video information during coding and decodingUS8564661Jul 26, 2007Oct 22, 2013Objectvideo, Inc.Video analytic rule detection system and methodUS8587655Sep 23, 2011Nov 19, 2013Checkvideo LlcDirected attention digital video recordationUS8660377 *Feb 11, 2013Feb 25, 2014At&T Intellectual Property Ii, L.P.Method and apparatus to prioritize video information during coding and decodingUS8711217 *Dec 15, 2005Apr 29, 2014Objectvideo, Inc.Video surveillance system employing video primitivesUS9042669Feb 18, 2014May 26, 2015At&T Intellectual Property Ii, L.P.Method and apparatus to prioritize video information during coding and decodingUS9215467 *Nov 17, 2009Dec 15, 2015Checkvideo LlcAnalytics-modulated coding of surveillance videoUS9344362 *Jan 11, 2008May 17, 2016University-Industry Cooperation Group Of Kyung Hee UniversityPacket format of network abstraction layer unit, and algorithm and apparatus for video encoding and decoding using the format, QOS control algorithm and apparatus for IPV6 label switching using the formatUS9378632 *Mar 10, 2014Jun 28, 2016Avigilon Fortress CorporationVideo surveillance system employing video primitivesUS20030095570 *Sep 12, 2002May 22, 2003Pioneer CorporationCommunication information bandwidth control apparatus and methodUS20050162515 *Feb 15, 2005Jul 28, 2005Objectvideo, Inc.Video surveillance systemUS20050169367 *Apr 5, 2005Aug 4, 2005Objectvideo, Inc.Video surveillance system employing video primitivesUS20070013776 *Jun 28, 2005Jan 18, 2007Objectvideo, Inc.Video surveillance system employing video primitivesUS20080100704 *Dec 15, 2005May 1, 2008Objectvideo, Inc.Video surveillance system employing video primitivesUS20090175353 *Jan 11, 2008Jul 9, 2009University-Industry Cooperation Group Of Kyng Hee UniversityPacket format of network abstraction layer unit, and algorithm and apparatus for video encoding and decoding using the format, qos control algorithm and apparatus for ipv6 label switching using the formatUS20100013926 *Sep 29, 2009Jan 21, 2010Lipton Alan JVideo Surveillance System Employing Video PrimitivesUS20100026802 *Jul 26, 2007Feb 4, 2010Object Video, Inc.Video analytic rule detection system and methodUS20100124274 *Nov 17, 2009May 20, 2010Cheok Lai-TeeAnalytics-modulated coding of surveillance videoUS20110268189 *Jul 13, 2011Nov 3, 2011AT&T Intellectual Properties II, L.P.Method and apparatus to prioritize video information during docing and decodingUS20130156102 *Feb 11, 2013Jun 20, 2013At&T Intellectual Property Ii, L.P.Method and appratus to prioritize video information during coding and decodingUS20150245047 *May 12, 2015Aug 27, 2015At&T Intellectual Property Ii, L.P.Method and apparatus to prioritize video information during coding and decodingWO2008134987A1 *May 8, 2008Nov 13, 2008Zhiping MengMethod of using information set in video resource* Cited by examinerClassifications U.S. Classification375/240.01, 709/231, 709/233, 715/719, 375/E07.081, 709/232, 709/236, 375/E07.088, 715/723International ClassificationH04N19/50, H04N19/503, H04N19/20, H04N19/577, H04N19/37, H04N19/85, H04N19/102, H04N19/625, H04N19/61, H04N19/59, H04N19/166, H04N5/00, H04N7/24Cooperative ClassificationH04N19/30, H04N19/20, G06T9/001European ClassificationH04N7/26E, H04N7/26J2Legal EventsDateCodeEventDescriptionMay 20, 1998ASAssignmentOwner name: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHANG, HEE-DONG;LIM, YOUNG-KWON;REEL/FRAME:009211/0960Effective date: 19970811Aug 7, 1998ASAssignmentOwner name: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHANG, HEE-DONG;LIM, YOUNG-KWON;REEL/FRAME:009372/0008Effective date: 19970811Jul 21, 2003FPAYFee paymentYear of fee payment: 4Jul 20, 2007FPAYFee paymentYear of fee payment: 8Nov 3, 2009ASAssignmentOwner name: IPG ELECTRONICS 502 LIMITEDFree format text: ASSIGNMENT OF ONE HALF (1/2) OF ALL OF ASSIGNORS RIGHT, TITLE AND INTEREST;ASSIGNOR:ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE;REEL/FRAME:023456/0363Effective date: 20081226Sep 26, 2011REMIMaintenance fee reminder mailedFeb 2, 2012FPAYFee paymentYear of fee payment: 12Feb 2, 2012SULPSurcharge for late paymentYear of fee payment: 11Jul 23, 2012ASAssignmentOwner name: PENDRAGON ELECTRONICS AND TELECOMMUNICATIONS RESEAFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:IPG ELECTRONICS 502 LIMITED;ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE;SIGNING DATES FROM 20120410 TO 20120515;REEL/FRAME:028611/0643RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services