Patent SG-11201905466Y-A (SG)
Title: Taking action based on physical graph
Inventor: MITAL VIJAY
IPC: H04L12/28
Filed: 2018-01-11
Abstract: Receive Query Response(s) 805 ---- Identify Action(s) To Take 806 ----- Take Action Figure 8 W O 20 18/ 136 280 Al (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization International Bureau (43) International Publication Date 26 July 2018 (26.07.2018) WIP0 I PCT Hu omit °nolo 1E1111m Hs (10) International Publication Number WO 2018/136280 Al 800 801 Interpret User Command(s) 6192 Formulate Query Or Queries Against Physical Graph ir (51) International Patent Classification: GOON 5/04 (2006.01) H04L 12/28 (2006.01) GOOF 17/30 (2006.01) G06N 3/00 (2006.01) (21) International Application Number: PCT/US2018/013232 (22) International Filing Date: 11 January 2018 (11.01.2018) (25) Filing Language: English (26) Publication Language: English (30) Priority Data: 62/447,790 18 January 2017 (18.01.2017) US 15/436,686 17 February 2017 (17.02.2017) US (71) Applicant: MICROSOFT TECHNOLOGY LI- CENSING, LLC [US/US]; One Microsoft Way, Redmond, Washington 98052-6399 (US). (72) Inventor: MITAL, Vijay; MICROSOFT TECHNOLOGY LICENSING, LLC, One Microsoft Way, Redmond, Wash- ington 98052-6399 (US). (74) Agent: MINHAS, Sandip S. et al.; MICROSOFT TECH- NOLOGY LICENSING, LLC, One Microsoft Way, Red- mond, Washington 98052-6399 (US). (81) Designated States (unless otherwise indicated, for every kind of national protection available): AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JO, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW. (84) Designated States (unless otherwise indicated, for every kind of regional protection available): ARIPO (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG). (54) Title: TAKING ACTION BASED ON PHYSICAL GRAPH (57) : Taking action based on a physical graph. The taking of actions oc- curs with the use of an agent that interprets command(s) (such as natural language commands) from a user. The agent responds to the command(s) by formulating at least one query against a physical graph that represents state of one or more phys- ical entities within a physical space and observed by a plurality of sensors. The agent then uses the query or queries against the physical graph. In response to the responses thereto, the agent identifies actions to take. Such actions could include actions such as presenting information to the user, and sending communications out to others. However, the actions could even include physical actions. For in- stance, the agent might include a physical action engine that performs physical 803 Issue Query Or Queries actions (such as via a robot or drone). [Continued on next page] WO 2018/136280 Al MIDEDIMOMOIDEIREEMOM0111011111110110MEHOM Declarations under Rule 4.17: as to applicant's entitlement to apply for and be granted a patent (Rule 4.17(11)) as to the applicant's entitlement to claim the priority of the earlier application (Rule 4.17(iii)) Published: — with international search report (Art. 21(3))