Patent AU-2022203636-B2 (AU)
Title: Methods and systems for generating mobile enabled extraction models
Inventor: ROSSI DOMINIC MIGUEL
IPC: G06F16/20
Filed: 2022-03-24
Granted: 2023-04-20
Abstract: INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 
(19) World Intellectual Property 
(1) Organization11111111111111111111111I1111111111111i1111liiiii 
International Bureau (10) International Publication Number 
(43) International Publication Date W O 2022/231739 Al 
03 November 2022 (03.11.2022) W IPO I PCT 
(51) International Patent Classification: View, CA 94043 (US). RIMCHALA, Tharathorn; c/o In
G06F 40/30 (2020.01) tuit Inc., 2700 Coast Avenue, Mountain View, CA 94043 
(21) International Application Number: (US).  
PCT/US2022/021703 (74) Agent: MINUTOLI, Gianni et al.; DLA Piper LLP (US), 
(22) International Filing Date: 11911 Freedom Drive, Suite 300, Reston, VA 20190 (US).  
24 March 2022 (24.03.2022) (81) Designated States (unless otherwise indicated, for every 
(25) Filing Language• English kind ofnational protection available): AE, AG, AL, AM, 
AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, 
(26) Publication Language: English CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, 
(30)PriorityData: DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, 
(30)/PriorityDa: 30 April 2021 (30.04.2021) us HR, HU, ID, IL, IN, I, IS, IT, JM, JO, JP, KE, KG, KH, 
KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, 
(71) Applicant: INTUIT INC. [US/US]; 2700 Coast Avenue, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, 
Mountain View, CA 94043 (US). NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, 
. . ~~RW, SA, SC, SD, SE, SG, SK, SL, ST, SVSY, TH, TJ, TM, 
(72) Inventors: ROSSI, Dominic, Miguel; c/o Intuit Inc., 2700 TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, WS, ZA, ZM, 
Coast Avenue, Mountain View, CA 94043 (US). LEE, ZW.  
Hui, Fang; c/o Intuit Inc., 2700 Coast Avenue, Mountain 
(54) Title: METHODS AND SYSTEMS FOR GENERATING MOBILE ENABLED EXTRACTION MODELS 
FIG.2 
Back End Computing System 104 
Repository 202 
NLP System 206 
Training Module 210 
ExternalPPr-Processi) 
Ex-te -- PrP cessng - TeacherNetwork216 P 204 
Student Network 218 Processor(s) 
204 
Converter2Module Procesor(s) 
2204 
(57) Abstract: A computing system generates a plurality of training data sets for generating the NLP model. The computing system 
trains a teacher network to extract and classify tokens from a document. The training includes a pre-training stage where the teacher 
network is trained to classify generic data in the plurality of training data sets and a fine-tuning stage where the teacher network is 
trained to classify targeted data in the plurality of training data sets. The computing system trains a student network to extract and 
classify tokens from a document by distilling knowledge learned by the teacher network during the fine-tuning stage from the teacher 
network to the student network. The computing system outputs the NLP model based on the training. The computing system causes 
the NLP model to be deployed in a remote computing environment.
W O 2022/231739 A|||I|IIII|H||IHI|I|||H||I|||I|||H||II ||||||||||||||||||||||||||||||||| 
(84) Designated States (unless otherwise indicated, for every 
kind of regional protection available): ARIPO (BW, GH, 
GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, 
UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, RU, TJ, 
TM), European (AL, AT, BE, BG, CH, CY, CZ, DE, DK, 
EE, ES, Fl, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, 
MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, 
TR), OAPI (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, 
KM, ML, MR, NE, SN, TD, TG).  
Published: 
- with international search report (Art. 21(3))