Nijkamp, Erik, Pang, Bo, Han, Tian, Zhou, Linqi, Zhu, Song-Chun, and Wu, Ying Nian. Learning multi-layer latent variable model via variational optimization of short run mcmc for approximate inference. In Computer Vision-ECCV 2020: 16th European Conference, Glasgow, UK, August 23-28, 2020, Proceedings, Part VI 16, pp. 361-378. Springer, 2020b.
Ou, Zijing, Xu, Tingyang, Su, Qinliang, Li, Yingzhen, Zhao, Peilin, and Bian, Yatao. Learning neural set functions under the optimal subset oracle. Advances in Neural Information Processing Systems, 35:35021-35034, 2022.
Pang, Bo, Han, Tian, Nijkamp, Erik, Zhu, Song-Chun, and Wu, Ying Nian. Learning latent space energy-based prior model. Advances in Neural Information Processing Systems, 33:21994-22008, 2020.
Peyre, Gabriel and Cuturi, Marco. Computational optimal transport. Foundations and Trends in Machine Learning, 11 (5-6):355-602, 2019.
Pidstrigach, Jakiw. Score-based generative models detect manifolds. In Koyejo, S., Mohamed, S., Agarwal, A., Belgrave, D., Cho, K., and Oh, A. (eds.), Advances in Neural Information Processing Systems, volume 35, pp. 35852-35865. Curran Associates, Inc., 2022.
Raginsky, Maxim and Sason, Igal. Concentration of measure inequalities in information theory, communications, and coding. Foundations and Trends® in Communications and Information Theory, 10(1-2):1-246, 2013. ISSN 1567-2190. doi: 10.1561/0100000064.
Ronneberger, Olaf, Fischer, Philipp, and Brox, Thomas. U-net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention - MICCAI, 9351:234-241, 2015.
Schröder, Tobias, Ou, Zijing, Li, Yingzhen, and Duncan, Andrew B. Training discrete ebms with energy discrepancy. Sampling and Optimization in Discrete Spaces workshop, ICML, 2023.
Song, Yang and Ermon, Stefano. Generative modeling by estimating gradients of the data distribution. Advances in Neural Information Processing Systems, 32, 2019.
Song, Yang and Kingma, Diederik P. How to Train Your Energy-Based Models. arXiv e-prints, 2021.
Song, Yang, Garg, Sahaj, Shi, Jiaxin, and Ermon, Stefano. Sliced score matching: A scalable approach to density and score estimation. In Uncertainty in Artificial Intelligence, pp. 574-584. PMLR, 2020.
Song, Yang, Durkan, Conor, Murray, Iain, and Ermon, Stefano. Maximum likelihood training of score-based diffusion models. Advances in Neural Information Processing Systems, 34:1415-1428, 2021a.
Song, Yang, Sohl-Dickstein, Jascha, Kingma, Diederik P., Kumar, Abhishek, Ermon, Stefano, and Poole, Ben. Score-based generative modeling through stochastic differential equations. In 9th International Conference on Learning Representations, ICLR, 2021b.
Stam, A.J. Some inequalities satisfied by the quantities of information of fisher and shannon. Information and Control, 2(2):101-112, 1959. ISSN 0019-9958.
Sutskever, Ilya and Tieleman, Tijmen. On the convergence properties of contrastive divergence. In Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp. 789-795. JMLR Workshop and Conference Proceedings, 2010.
van den Oord, Aaron, Li, Yazhe, and Vinyals, Oriol. Representation learning with contrastive predictive coding. arXiv preprint 1807.03748, 2018.
Vincent, Pascal. A connection between score matching and denoising autoencoders. Neural computation, 23(7):1661-1674, 2011.
Xiao, Zhisheng and Han, Tian. Adaptive multi-stage density ratio estimation for learning latent space energy-based model. In Koyejo, S., Mohamed, S., Agarwal, A., Belgrave, D., Cho, K., and Oh, A. (eds.), Advances in Neural Information Processing Systems, volume 35, pp. 21590-21601. Curran Associates, Inc., 2022.