Patent SG-11201810890R-A (SG)
Title: Situation aware personal assistant
Inventor: JOO TAE HONG
IPC: B60W50/00
Filed: 2017-06-20
Abstract: SensorB Vehicle 300 100 110A 108 '72 108 — 110B Electronic Personal Assistant 106 Driving Situation Monitor 302 110C Sensor 102A Sensor 102C 112 114 O N O C (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 28 December 2017 (28.12.2017) W I PO I PCT ~~ll~~~~~~~~ 011101010VIII010um o H0111°1111111 minima ow (10) International Publication Number WO 2017/223013 Al (51) International Patent Classification: B60W 50/00 (2006.01) HO4M 1/725 (2006.01) B60W 30/08 (2012.01) H04W 48/04 (2009.01) (21) International Application Number: PCT/US2017/038213 (22) International Filing Date: 20 June 2017 (20.06.2017) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 15/192,880 24 June 2016 (24.06.2016) US (71) Applicant: MICROSOFT TECHNOLOGY LI- CENSING, LLC [US/US]; One Microsoft Way, Redmond, Washington 98052-6399 (US). (72) Inventors: JOO, Tae Hong; Microsoft Technology Li- censing, LLC, One Microsoft Way, Redmond, Washing- ton 98052-6399 (US). ELABBADY, Tarek Z.; Microsoft Technology Licensing, LLC, One Microsoft Way, Red- mond, Washington 98052-6399 (US). HABIB, Mona Soli- man; Microsoft Technology Licensing, LLC, One Mi- crosoft Way, Redmond, Washington 98052-6399 (US). (74) Agent: MINHAS, Sandip et al.; Microsoft Technology Li- censing, LLC, One Microsoft Way, Redmond, Washington 98052-6399 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, (54) Title: SITUATION AWARE PERSONAL ASSISTANT FIG. 3 (57) : Methods, systems, apparatuses, and computer program products are provided for altering the behavior of an electronic personal assistant 106 based on a situation associated with a mobile device 300. A situation is sensed with a plurality of sensors 102A - 102C to generate sensor data 110A - HOC. A situation score is calculated based on the sensor data. Behavior of the electronic personal assistant 106 is altered based on the calculated situation score. In one aspect, the situation is a driving situation in which a driver drives a vehicle on a roadway. In such case, a driving situation score is calculated based on the sensor data, and behavior of the electronic personal assistant is altered based on the calculated driving situation score, such as suspending interactions by the electronic personal assistant with the driver to avoid the driver being distracted. A user may optionally provide a request 108 to electronic personal assistant 106 verbally. Request 108 is also received by driving situation monitor 302 through electronic personal assistant 106 or is directly received from the user. Under normal circumstances, electronic personal assistant 106 may respond verbally to request 108 with an answer 114. Situation score 112, however, may cause electronic personal assistant 106 to change its behavior. In such case, electronic personal assistant 106 may suspend answer 114 (or other interaction) by not speaking to the user, and/or may alter its behavior in another way. Suspending answer 114 may last at least until driving situation monitor 302 determines electronic personal assistant 106 can resume normal interactions. [Continued on next page] WO 2017/223013 Al IMEDIMO DOI 01011MMEMHIMMIIIIMMIHMOVOIMIE MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). Declarations under Rule 4.17: as to applicant's entitlement to apply for and be granted a patent (Rule 4.17(H)) as to the applicant's entitlement to claim the priority of the earlier application (Rule 4.17(iii)) Published: — with international search report (Art. 21(3))