Patent SG-11201808923Q-A (SG)
Title: Fisheye rendering with lens distortion correction for 360-degree video
Inventor: VAN DER AUWERA GEERT
IPC: G06T3/00
Filed: 2017-04-25
Abstract: INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property 11111111111111111110 11111110 11E111110 1111111111111111111110 HOED Organization International Bureau (10) International Publication Number (43) International Publication Date ......0\"\"1 WO 2017/204971 Al 30 November 2017 (30.11.2017) WIPO I PCT (51) International Patent Classification: California 92121-1714 (US). KARCZEWICZ, Marta; G06T 3/00 (2006.01) 5775 Morehouse Drive, San Diego, California 92121-1714 (21) International Application Number: (US). PCT/US2017/029441 (74) Agent: WONG, Claudine et al.; Kilpatrick Townsend & (22) International Filing Date: Stockton LLP, Mailstop: IP Docketing - 22, 1100 Peachtree 25 April 2017 (25.04.2017) Street, N.E., Suite 2800, Atlanta, Georgia 30309 (US). (25) Filing Language: English (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, (26) Publication Language: English AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, (30) Priority Data: CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, 62/340,914 24 May 2016 (24.05.2016) US DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, 15/495,709 24 April 2017 (24.04.2017) US HR, HU, ID, IL, IN, IR, IS, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, (71) Applicant: QUALCOMM INCORPORATED [US/US]; MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, Attn: International IP Administration, 5775 Morehouse Dri- PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, ye, San Diego, California 92121-1714 (US). SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (72) Inventors: VAN DER AUWERA, Geert; 5775 More- house Drive, San Diego, California 92121-1714 (US). (84) Designated States (unless otherwise indicated, for every COBAN, Muhammed; 5775 Morehouse Drive, San Diego, kind of regional protection available): ARIPO (BW, GH, = (54) Title: FISHEYE RENDERING WITH LENS DISTORTION CORRECTION FOR 360-DEGREE VIDEO = io% 10 2 _ 1134- \_ = = = = = (- Z j -io4. = ‘ • — -- -- .4- . •-•-•-• fr.% .•- . 7::: ......, ........\". P .- j \".\"'' EZCZirr . \" C e-' = - --- 1 E:=1 ,--,] E= \" 0=11=000 . A\" : or-i =loop. = = = • • ,.. ,...---.\" , --, .4k 1-----.11:=]=1 (r -----,_,_ \"I lie A ' = oo =coo • ' IN , ni g a t g.tr.1- .1.-.... • — V --::;,_ `7. - -- , _ - - > = Ib ik v\" YPI' 104- N. _ %IN 0 j -104 1-1 1-1 FIG. .1 IN 01 'V (57) : In various implementations, provided are systems and methods for correcting the distortion present in a fisheye image, and rendering the image for display as 360-degree video. In various implementations, a computing device can receive 2-dimensional ei ----. video data captured by an omnidirectional camera. The computing device can map an image from each video frame to a 3-dimensional IN hemispherical representation. In various implementations, this mapping can be executed using a polynomial model. The 3-dimensional © hemispherical representation can then be used in a 360-degree video presentation, to provide a virtual reality experience. ei O [Continued on next page] WO 2017/204971 Al MIDEDIMOMOIDEIROIDEM001010110MOMHIEMOVOIMIE GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Published: — with international search report (Art. 21(3))