SlowGuess/NeurIPS_2023_OCR huggingface dataset:
[61] Geoffrey Wolfer and Aryeh Kontorovich. Estimating the mixing time of ergodic markov chains. In Alina Beygelzimer and Daniel Hsu, editors, Proceedings of the Thirty-Second Conference on Learning Theory, volume 99 of Proceedings of Machine Learning Research, pages 3120–3159. PMLR, 25–28 Jun 2019. (Cited on page 5.)
[62] Ming Yin and Yu-Xiang Wang. Optimal Uniform OPE and Model-based Offline Reinforcement Learning in Time-Homogeneous, Reward-Free and Task-Agnostic Settings. In Advances in Neural Information Processing Systems, volume 34, pages 12890-12903. Curran Associates, Inc., 2021. (Cited on page 10.)
[63] Anru Zhang and Mengdi Wang. Spectral State Compression of Markov Processes. IEEE Transactions on Information Theory, 66(5):3202-3231, 2020. (Cited on pages 6, 9, 18, 21, 44, 49, and 50.)
[64] Tianjun Zhang, Tongzheng Ren, Mengjiao Yang, Joseph Gonzalez, Dale Schuurmans, and Bo Dai. Making Linear MDPs Practical via Contrastive Representation Learning. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 26447-26466. PMLR, 17-23 Jul 2022. (Cited on page 10.)
[65] Xuezhou Zhang, Yuda Song, Masatoshi Uehara, Mengdi Wang, Alekh Agarwal, and Wen Sun. Efficient Reinforcement Learning in Block MDPs: A Model-free Representation Learning Approach. In Proceedings of the 39th International Conference on Machine Learning, volume 162 of Proceedings of Machine Learning Research, pages 26517-26547. PMLR, 17-23 Jul 2022. (Cited on page 10.)
[66] Zihan Zhang, Simon Du, and Xiangyang Ji. Near Optimal Reward-Free Reinforcement Learning. In Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, pages 12402-12412. PMLR, 18-24 Jul 2021. (Cited on page 8.)
[67] Ziwei Zhu, Xudong Li, Mengdi Wang, and Anru Zhang. Learning markov models via low-rank optimization. Operations Research, 70(4):2384-2398, 2022. (Cited on page 9.)