Patent SG-11201907089U-A (SG)
Title: Inter prediction refinement based on bi-directional optical flow (bio)
Inventor: CHUANG HSIAO-CHIANG
IPC: H04N19/00
Filed: 2018-03-13
Abstract: WO 18/ 169989 Al (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 20 September 2018 (20.09.2018) WIP0 I PCT ill~~~~~~~~ 011101VIIIVIIIVIII olo VIII VIII omom oimIE (10) International Publication Number WO 2018/169989 Al (51) International Patent Classification: H04N 19/00 (2014.01) (21) International Application Number: PCT/US2018/022226 (22) International Filing Date: 13 March 2018 (13.03.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/470,809 13 March 2017 (13.03.2017) US 15/919,060 12 March 2018 (12.03.2018) US (71) Applicant: QUALCOMM INCORPORATED [US/US]; ATTN: International IP Administration, 5775 Morehouse Drive, San Diego, California 92121-1714 (US). (72) Inventors: CHUANG, Hsiao-Chiang; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). CHEN, Jianle; 10756 Corte De Tiburon, San Diego, California 92130 (US). CHEN, Yi-Wen; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). LI, Xiang; 10574 Gaylemont Lane, San Diego, California 92130 (US). KAR- CZEWICZ, Marta; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). CHIEN, Wei-Jung; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). (74) Agent: JOSEPH, Jeffrey R.; Shumaker & Sieffert, PA., 1625 Radio Drive, Suite 100, Woodbury, Minnesota 55125 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, (54) Title: INTER PREDICTION REFINEMENT BASED ON BI-DIRECTIONAL OPTICAL FLOW (BIO) (57) : A video decoder can be configured to determine that a 220 block of video data is encoded using a bi-directional inter prediction A ,-- --- mode; determine that the block of video data is encoded using a bi-direc- tional optical flow (BIO) process; inter predict the block of video data according to the bi-directional inter prediction mode; perform the BIO • 2 22 process for the block, wherein performing the BIO process for the block comprises determining a single motion vector refinement for a group of pixels in the block, wherein the group of pixels comprises at least two pixels; refine the group of pixels based on the single motion vector refine- ment; and output a BIO refmed predictive block of video data comprising 224 the refmed group of pixels. PERFORM THE BIO PROCESS FOR THE BLOCK, BY DETERMINING A SINGLE MOTION VECTOR REFINEMENT FOR A GROUP OF PIXELS IN THE BLOCK AND REFINING THE GROUP OF PIXELS BASED ON THE SINGLE MOTION VECTOR REFINEMENT OUTPUT A BIO REFINED PREDICTIVE BLOCK OF VIDEO DATA COMPRISING THE REFINED GROUP OF PIXELS FIG. 21 [Continued on next page] DETERMINE THAT A BLOCK OF VIDEO DATA IS ENCODED USING A BI-DIRECTIONAL INTER PREDICTION MODE DETERMINE THAT THE BLOCK OF VIDEO DATA IS ENCODED USING A BIO PROCESS INTER PREDICT THE BLOCK OF VIDEO DATA USING THE BI-DIRECTIONAL INTER PREDICTION MODE 226 228 WO 2018/169989 Al MIDEDIMOMMIDEFIDIDEMIERCIMEHMOVOIMIE TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))