Patent SG-11201810874Y-A (SG)
Title: Virtual, augmented, and mixed reality
Inventor: VISSER ERIK
IPC: H04S7/00
Filed: 2017-05-25
Abstract: AcousticalEnvironment-' 190 ---130 191 .--b, 2 ?)----140 o f Device (e.g., Headset) 102 Processor 114 Location Estimation Circuitry 122 Audio Analysis Circuitry 124 Virtual Sound Generation Circuitry 126 Virtual Sound Source Generation Circuitry 128 Video Playback Device 160 Audio Playback Device 162 Visual Rep. of Acoustical Environment 170 Rep. of Acoustical Environment 172 Memory 104 Microphone(s) 106 Camera(s) 108 Speaker(s) 110 Display Screen 112 Sound Characteristic 164 Sound Characteristic 166 Sound Characteristic 168 Database of Sound Characteristics 116 N O co O C (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 18 January 2018 (18.01.2018) W I PO I PCT ill~~~~~~~~ 011101010VIIIOH olo omm ollimoiliommo oimIE (10) International Publication Number WO 2018/013237 Al (51) International Patent Classification: G06F 3/01 (2006.01) GO6F 3/16 (2006.01) H04S 7/00 (2006.01) (21) International Application Number: PCT/US2017/034522 (22) International Filing Date: 25 May 2017 (25.05.2017) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/363,104 15 July 2016 (15.07.2016) US 15/238,591 16 August 2016 (16.08.2016) US (71) Applicant: QUALCOMM INCORPORATED [US/US]; ATTN: International IP Administration, 5775 Morehouse Drive, San Diego, California 92121-1714 (US). (72) Inventors: VISSER, Erik; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). KIM, Lae-Hoon; 5775 Morehouse Drive, San Diego, California 92121-1714 (US). PERI, Raghuveer; 2134 Oak St., Los Angeles, Cal- ifornia 90007 (US). (74) Agent: TOLER, Jeffrey G.; 8500 Bluffstone Cove, Suite A201, Austin, Texas 78759 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, (54) Title: VIRTUAL, AUGMENTED, AND MIXED REALITY 100 —132 Real Virtual 2 FIG. I (57) : A method for outputting virtual sound includes detecting an audio signal in an environment at one or more microphones. The method also includes determining, at a processor, a location of a sound source of the audio signal and estimating one or more acoustical characteristics of the environment based on the audio signal. The method further includes inserting a virtual sound into the environment based on the one or more acoustical characteristics. The virtual sound has one or more audio properties of a sound generated from the location of the sound source. [Continued on next page] WO 2018/013237 Al MIDEDIMOMOIDEIREIDIONIMMIMMINIIBUDIMIE UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Declarations under Rule 4.17: as to applicant's entitlement to apply for and be granted a patent (Rule 4.17(H)) as to the applicant's entitlement to claim the priority of the earlier application (Rule 4.17(iii)) Published: — with international search report (Art. 21(3))