This is pdfTeX, Version 3.14159265-2.6-1.40.20 (TeX Live 2019/W32TeX) (preloaded format=pdflatex 2020.3.10) 21 APR 2023 01:28 entering extended mode restricted \write18 enabled. %&-line parsing enabled. **main.tex (./main.tex LaTeX2e <2020-02-02> patch level 5 L3 programming layer <2020-02-25> (c:/texlive/2019/texmf-dist/tex/latex/base/article.cls Document Class: article 2019/12/20 v1.4l Standard LaTeX document class (c:/texlive/2019/texmf-dist/tex/latex/base/size10.clo File: size10.clo 2019/12/20 v1.4l Standard LaTeX file (size option) ) \c@part=\count167 \c@section=\count168 \c@subsection=\count169 \c@subsubsection=\count170 \c@paragraph=\count171 \c@subparagraph=\count172 \c@figure=\count173 \c@table=\count174 \abovecaptionskip=\skip47 \belowcaptionskip=\skip48 \bibindent=\dimen134 ) (c:/texlive/2019/texmf-dist/tex/latex/graphics/graphicx.sty Package: graphicx 2019/11/30 v1.2a Enhanced LaTeX Graphics (DPC,SPQR) (c:/texlive/2019/texmf-dist/tex/latex/graphics/keyval.sty Package: keyval 2014/10/28 v1.15 key=value parser (DPC) \KV@toks@=\toks15 ) (c:/texlive/2019/texmf-dist/tex/latex/graphics/graphics.sty Package: graphics 2019/11/30 v1.4a Standard LaTeX Graphics (DPC,SPQR) (c:/texlive/2019/texmf-dist/tex/latex/graphics/trig.sty Package: trig 2016/01/03 v1.10 sin cos tan (DPC) ) (c:/texlive/2019/texmf-dist/tex/latex/graphics-cfg/graphics.cfg File: graphics.cfg 2016/06/04 v1.11 sample graphics configuration ) Package graphics Info: Driver file: pdftex.def on input line 105. (c:/texlive/2019/texmf-dist/tex/latex/graphics-def/pdftex.def File: pdftex.def 2018/01/08 v1.0l Graphics/color driver for pdftex )) \Gin@req@height=\dimen135 \Gin@req@width=\dimen136 ) (c:/texlive/2019/texmf-dist/tex/latex/booktabs/booktabs.sty Package: booktabs 2020/01/12 v1.61803398 Publication quality tables \heavyrulewidth=\dimen137 \lightrulewidth=\dimen138 \cmidrulewidth=\dimen139 \belowrulesep=\dimen140 \belowbottomsep=\dimen141 \aboverulesep=\dimen142 \abovetopsep=\dimen143 \cmidrulesep=\dimen144 \cmidrulekern=\dimen145 \defaultaddspace=\dimen146 \@cmidla=\count175 \@cmidlb=\count176 \@aboverulesep=\dimen147 \@belowrulesep=\dimen148 \@thisruleclass=\count177 \@lastruleclass=\count178 \@thisrulewidth=\dimen149 ) (./math_commands.tex (c:/texlive/2019/texmf-dist/tex/latex/amsmath/amsmath.sty Package: amsmath 2020/01/20 v2.17e AMS math features \@mathmargin=\skip49 For additional information on amsmath, use the `?' option. (c:/texlive/2019/texmf-dist/tex/latex/amsmath/amstext.sty Package: amstext 2000/06/29 v2.01 AMS text (c:/texlive/2019/texmf-dist/tex/latex/amsmath/amsgen.sty File: amsgen.sty 1999/11/30 v2.0 generic functions \@emptytoks=\toks16 \ex@=\dimen150 )) (c:/texlive/2019/texmf-dist/tex/latex/amsmath/amsbsy.sty Package: amsbsy 1999/11/29 v1.2d Bold Symbols \pmbraise@=\dimen151 ) (c:/texlive/2019/texmf-dist/tex/latex/amsmath/amsopn.sty Package: amsopn 2016/03/08 v2.02 operator names ) \inf@bad=\count179 LaTeX Info: Redefining \frac on input line 227. \uproot@=\count180 \leftroot@=\count181 LaTeX Info: Redefining \overline on input line 389. \classnum@=\count182 \DOTSCASE@=\count183 LaTeX Info: Redefining \ldots on input line 486. LaTeX Info: Redefining \dots on input line 489. LaTeX Info: Redefining \cdots on input line 610. \Mathstrutbox@=\box45 \strutbox@=\box46 \big@size=\dimen152 LaTeX Font Info: Redeclaring font encoding OML on input line 733. LaTeX Font Info: Redeclaring font encoding OMS on input line 734. \macc@depth=\count184 \c@MaxMatrixCols=\count185 \dotsspace@=\muskip16 \c@parentequation=\count186 \dspbrk@lvl=\count187 \tag@help=\toks17 \row@=\count188 \column@=\count189 \maxfields@=\count190 \andhelp@=\toks18 \eqnshift@=\dimen153 \alignsep@=\dimen154 \tagshift@=\dimen155 \tagwidth@=\dimen156 \totwidth@=\dimen157 \lineht@=\dimen158 \@envbody=\toks19 \multlinegap=\skip50 \multlinetaggap=\skip51 \mathdisplay@stack=\toks20 LaTeX Info: Redefining \[ on input line 2859. LaTeX Info: Redefining \] on input line 2860. ) (c:/texlive/2019/texmf-dist/tex/latex/amsfonts/amsfonts.sty Package: amsfonts 2013/01/14 v3.01 Basic AMSFonts support \symAMSa=\mathgroup4 \symAMSb=\mathgroup5 LaTeX Font Info: Redeclaring math symbol \hbar on input line 98. LaTeX Font Info: Overwriting math alphabet `\mathfrak' in version `bold' (Font) U/euf/m/n --> U/euf/b/n on input line 106. ) (c:/texlive/2019/texmf-dist/tex/latex/tools/bm.sty Package: bm 2019/07/24 v1.2d Bold Symbol Support (DPC/FMi) \symboldoperators=\mathgroup6 \symboldletters=\mathgroup7 \symboldsymbols=\mathgroup8 LaTeX Font Info: Redeclaring math alphabet \mathbf on input line 141. LaTeX Info: Redefining \bm on input line 209. ) LaTeX Font Info: Overwriting math alphabet `\mathsfit' in version `bold' (Font) OT1/cmss/m/sl --> OT1/cmss/bx/n on input line 314. ) (c:/texlive/2019/texmf-dist/tex/latex/hyperref/hyperref.sty Package: hyperref 2020/01/14 v7.00d Hypertext links for LaTeX (c:/texlive/2019/texmf-dist/tex/generic/ltxcmds/ltxcmds.sty Package: ltxcmds 2019/12/15 v1.24 LaTeX kernel commands for general use (HO) ) (c:/texlive/2019/texmf-dist/tex/generic/iftex/iftex.sty Package: iftex 2019/11/07 v1.0c TeX engine tests ) (c:/texlive/2019/texmf-dist/tex/latex/pdftexcmds/pdftexcmds.sty Package: pdftexcmds 2019/11/24 v0.31 Utility functions of pdfTeX for LuaTeX (HO ) (c:/texlive/2019/texmf-dist/tex/generic/infwarerr/infwarerr.sty Package: infwarerr 2019/12/03 v1.5 Providing info/warning/error messages (HO) ) Package pdftexcmds Info: \pdf@primitive is available. Package pdftexcmds Info: \pdf@ifprimitive is available. Package pdftexcmds Info: \pdfdraftmode found. ) (c:/texlive/2019/texmf-dist/tex/generic/kvsetkeys/kvsetkeys.sty Package: kvsetkeys 2019/12/15 v1.18 Key value parser (HO) ) (c:/texlive/2019/texmf-dist/tex/generic/kvdefinekeys/kvdefinekeys.sty Package: kvdefinekeys 2019-12-19 v1.6 Define keys (HO) ) (c:/texlive/2019/texmf-dist/tex/generic/pdfescape/pdfescape.sty Package: pdfescape 2019/12/09 v1.15 Implements pdfTeX's escape features (HO) ) (c:/texlive/2019/texmf-dist/tex/latex/hycolor/hycolor.sty Package: hycolor 2020-01-27 v1.10 Color options for hyperref/bookmark (HO) ) (c:/texlive/2019/texmf-dist/tex/latex/letltxmacro/letltxmacro.sty Package: letltxmacro 2019/12/03 v1.6 Let assignment for LaTeX macros (HO) ) (c:/texlive/2019/texmf-dist/tex/latex/auxhook/auxhook.sty Package: auxhook 2019-12-17 v1.6 Hooks for auxiliary files (HO) ) (c:/texlive/2019/texmf-dist/tex/latex/kvoptions/kvoptions.sty Package: kvoptions 2019/11/29 v3.13 Key value format for package options (HO) ) \@linkdim=\dimen159 \Hy@linkcounter=\count191 \Hy@pagecounter=\count192 (c:/texlive/2019/texmf-dist/tex/latex/hyperref/pd1enc.def File: pd1enc.def 2020/01/14 v7.00d Hyperref: PDFDocEncoding definition (HO) ) (c:/texlive/2019/texmf-dist/tex/generic/intcalc/intcalc.sty Package: intcalc 2019/12/15 v1.3 Expandable calculations with integers (HO) ) (c:/texlive/2019/texmf-dist/tex/generic/etexcmds/etexcmds.sty Package: etexcmds 2019/12/15 v1.7 Avoid name clashes with e-TeX commands (HO) ) \Hy@SavedSpaceFactor=\count193 \pdfmajorversion=\count194 Package hyperref Info: Hyper figures OFF on input line 4547. Package hyperref Info: Link nesting OFF on input line 4552. Package hyperref Info: Hyper index ON on input line 4555. Package hyperref Info: Plain pages OFF on input line 4562. Package hyperref Info: Backreferencing OFF on input line 4567. Package hyperref Info: Implicit mode ON; LaTeX internals redefined. Package hyperref Info: Bookmarks ON on input line 4800. \c@Hy@tempcnt=\count195 (c:/texlive/2019/texmf-dist/tex/latex/url/url.sty \Urlmuskip=\muskip17 Package: url 2013/09/16 ver 3.4 Verb mode for urls, etc. ) LaTeX Info: Redefining \url on input line 5159. \XeTeXLinkMargin=\dimen160 (c:/texlive/2019/texmf-dist/tex/generic/bitset/bitset.sty Package: bitset 2019/12/09 v1.3 Handle bit-vector datatype (HO) (c:/texlive/2019/texmf-dist/tex/generic/bigintcalc/bigintcalc.sty Package: bigintcalc 2019/12/15 v1.5 Expandable calculations on big integers (HO ) )) \Fld@menulength=\count196 \Field@Width=\dimen161 \Fld@charsize=\dimen162 Package hyperref Info: Hyper figures OFF on input line 6430. Package hyperref Info: Link nesting OFF on input line 6435. Package hyperref Info: Hyper index ON on input line 6438. Package hyperref Info: backreferencing OFF on input line 6445. Package hyperref Info: Link coloring OFF on input line 6450. Package hyperref Info: Link coloring with OCG OFF on input line 6455. Package hyperref Info: PDF/A mode OFF on input line 6460. LaTeX Info: Redefining \ref on input line 6500. LaTeX Info: Redefining \pageref on input line 6504. (c:/texlive/2019/texmf-dist/tex/generic/atbegshi/atbegshi.sty Package: atbegshi 2019/12/05 v1.19 At begin shipout hook (HO) ) \Hy@abspage=\count197 \c@Item=\count198 \c@Hfootnote=\count199 ) Package hyperref Info: Driver (autodetected): hpdftex. (c:/texlive/2019/texmf-dist/tex/latex/hyperref/hpdftex.def File: hpdftex.def 2020/01/14 v7.00d Hyperref driver for pdfTeX (c:/texlive/2019/texmf-dist/tex/latex/atveryend/atveryend.sty Package: atveryend 2019-12-11 v1.11 Hooks at the very end of document (HO) Package atveryend Info: \enddocument detected (standard20110627). ) \Fld@listcount=\count266 \c@bookmark@seq@number=\count267 (c:/texlive/2019/texmf-dist/tex/latex/rerunfilecheck/rerunfilecheck.sty Package: rerunfilecheck 2019/12/05 v1.9 Rerun checks for auxiliary files (HO) (c:/texlive/2019/texmf-dist/tex/generic/uniquecounter/uniquecounter.sty Package: uniquecounter 2019/12/15 v1.4 Provide unlimited unique counter (HO) ) Package uniquecounter Info: New unique counter `rerunfilecheck' on input line 2 86. ) \Hy@SectionHShift=\skip52 ) (c:/texlive/2019/texmf-dist/tex/latex/algorithmicx/algorithmicx.sty Package: algorithmicx 2005/04/27 v1.2 Algorithmicx (c:/texlive/2019/texmf-dist/tex/latex/base/ifthen.sty Package: ifthen 2014/09/29 v1.1c Standard LaTeX ifthen package (DPC) ) Document Style algorithmicx 1.2 - a greatly improved `algorithmic' style \c@ALG@line=\count268 \c@ALG@rem=\count269 \c@ALG@nested=\count270 \ALG@tlm=\skip53 \ALG@thistlm=\skip54 \c@ALG@Lnr=\count271 \c@ALG@blocknr=\count272 \c@ALG@storecount=\count273 \c@ALG@tmpcounter=\count274 \ALG@tmplength=\skip55 ) (c:/texlive/2019/texmf-dist/tex/latex/l3backend/l3backend-pdfmode.def File: l3backend-pdfmode.def 2020-02-23 L3 backend support: PDF mode \l__kernel_color_stack_int=\count275 \l__pdf_internal_box=\box47 ) (./main.aux) \openout1 = `main.aux'. LaTeX Font Info: Checking defaults for OML/cmm/m/it on input line 16. LaTeX Font Info: ... okay on input line 16. LaTeX Font Info: Checking defaults for OMS/cmsy/m/n on input line 16. LaTeX Font Info: ... okay on input line 16. LaTeX Font Info: Checking defaults for OT1/cmr/m/n on input line 16. LaTeX Font Info: ... okay on input line 16. LaTeX Font Info: Checking defaults for T1/cmr/m/n on input line 16. LaTeX Font Info: ... okay on input line 16. LaTeX Font Info: Checking defaults for TS1/cmr/m/n on input line 16. LaTeX Font Info: ... okay on input line 16. LaTeX Font Info: Checking defaults for OMX/cmex/m/n on input line 16. LaTeX Font Info: ... okay on input line 16. LaTeX Font Info: Checking defaults for U/cmr/m/n on input line 16. LaTeX Font Info: ... okay on input line 16. LaTeX Font Info: Checking defaults for PD1/pdf/m/n on input line 16. LaTeX Font Info: ... okay on input line 16. (c:/texlive/2019/texmf-dist/tex/context/base/mkii/supp-pdf.mkii [Loading MPS to PDF converter (version 2006.09.02).] \scratchcounter=\count276 \scratchdimen=\dimen163 \scratchbox=\box48 \nofMPsegments=\count277 \nofMParguments=\count278 \everyMPshowfont=\toks21 \MPscratchCnt=\count279 \MPscratchDim=\dimen164 \MPnumerator=\count280 \makeMPintoPDFobject=\count281 \everyMPtoPDFconversion=\toks22 ) (c:/texlive/2019/texmf-dist/tex/latex/epstopdf-pkg/epstopdf-base.sty Package: epstopdf-base 2020-01-24 v2.11 Base part for package epstopdf Package epstopdf-base Info: Redefining graphics rule for `.eps' on input line 4 85. (c:/texlive/2019/texmf-dist/tex/latex/latexconfig/epstopdf-sys.cfg File: epstopdf-sys.cfg 2010/07/13 v1.3 Configuration of (r)epstopdf for TeX Liv e )) \AtBeginShipoutBox=\box49 Package hyperref Info: Link coloring OFF on input line 16. (c:/texlive/2019/texmf-dist/tex/latex/hyperref/nameref.sty Package: nameref 2019/09/16 v2.46 Cross-referencing by name of section (c:/texlive/2019/texmf-dist/tex/latex/refcount/refcount.sty Package: refcount 2019/12/15 v3.6 Data extraction from label references (HO) ) (c:/texlive/2019/texmf-dist/tex/generic/gettitlestring/gettitlestring.sty Package: gettitlestring 2019/12/15 v1.6 Cleanup title references (HO) ) \c@section@level=\count282 ) LaTeX Info: Redefining \ref on input line 16. LaTeX Info: Redefining \pageref on input line 16. LaTeX Info: Redefining \nameref on input line 16. (./main.out) (./main.out) \@outlinefile=\write3 \openout3 = `main.out'. LaTeX Font Info: Trying to load font information for U+msa on input line 18. (c:/texlive/2019/texmf-dist/tex/latex/amsfonts/umsa.fd File: umsa.fd 2013/01/14 v3.01 AMS symbols A ) LaTeX Font Info: Trying to load font information for U+msb on input line 18. (c:/texlive/2019/texmf-dist/tex/latex/amsfonts/umsb.fd File: umsb.fd 2013/01/14 v3.01 AMS symbols B ) (./abstract.tex) (./introduction.tex [1 {c:/texlive/2019/texmf-var/fonts/map/pdftex/updmap/pdftex.map}]) (./related wor ks.tex Overfull \hbox (16.90321pt too wide) in paragraph at lines 9--10 []\OT1/cmr/bx/n/10 Transfer Learn-ing in Re-in-force-ment Learn-ing[] \OT1/cmr /m/n/10 Trans-fer learn-ing has emerged [] [2]) (./backgrounds.tex [3]) (./methodology.tex Overfull \hbox (4.19505pt too wide) in paragraph at lines 16--1 []\OT1/cmr/m/n/10 In sum-mary, Re-in-force-ment Learn-ing aims to solve se-quen -tial decision-making [] ) (./experiments.tex) (./conclusion.tex) (./main.bbl Underfull \hbox (badness 4765) in paragraph at lines 42--45 []\OT1/cmr/m/n/10 M. R. Rong Zhu. Self-correcting q-learning. \OT1/cmr/m/it/1 0 arXiv preprint [] [4]) Package atveryend Info: Empty hook `BeforeClearDocument' on input line 33. [5] Package atveryend Info: Empty hook `AfterLastShipout' on input line 33. (./main.aux) Package atveryend Info: Executing hook `AtVeryEndDocument' on input line 33. Package atveryend Info: Executing hook `AtEndAfterFileList' on input line 33. Package rerunfilecheck Info: File `main.out' has not changed. (rerunfilecheck) Checksum: BDA0A09DE8A1BA38D91AB90D129107CB;141. Package atveryend Info: Empty hook `AtVeryVeryEnd' on input line 33. ) Here is how much of TeX's memory you used: 6872 strings out of 480994 96493 string characters out of 5916032 366696 words of memory out of 5000000 22198 multiletter control sequences out of 15000+600000 545458 words of font info for 72 fonts, out of 8000000 for 9000 1141 hyphenation exceptions out of 8191 34i,6n,30p,1027b,429s stack positions out of 5000i,500n,10000p,200000b,80000s Output written on main.pdf (5 pages, 151598 bytes). PDF statistics: 158 PDF objects out of 1000 (max. 8388607) 136 compressed objects within 2 object streams 29 named destinations out of 1000 (max. 500000) 25 words of extra memory for PDF output out of 10000 (max. 10000000)