[20] Nishant Desai, Andrew Critch, and Stuart J Russell. Negotiable reinforcement learning for pareto optimal sequential decision-making. Advances in Neural Information Processing Systems, 31, 2018.
[21] Yilun Du, Shuang Li, and Igor Mordatch. Compositional visual generation with energy based models. Advances in Neural Information Processing Systems, 33:6637-6647, 2020.
[22] Yonathan Efroni, Nadav Merlis, and Shie Mannor. Reinforcement learning with trajectory feedback. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 35, pages 7288-7295, 2021.
[23] Benjamin Eysenbach and Sergey Levine. Maximum entropy rl (provably) solves some robust rl problems. In International Conference on Learning Representations, 2022.
[24] William Fedus, Carles Gelada, Yoshua Bengio, Marc G Bellemare, and Hugo Larochelle. Hyperbolic discounting and learning over multiple horizons. arXiv preprint arXiv:1902.06865, 2019.
[25] John Farejohn and Talbot Page. On the foundations of intertemporal choice. American Journal of Agricultural Economics, 60(2):269-275, 1978.
[26] Shane Frederick, George Loewenstein, and Ted O'Donoghue. Time discounting and time preference: A critical review. Journal of economic literature, 40(2):351-401, 2002.
[27] Maor Gaon and Ronen Brafman. Reinforcement learning with non-markovian rewards. In Proceedings of the AAAI conference on artificial intelligence, volume 34, pages 3980-3987, 2020.
[28] Paul W Glimcher. Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis. Proceedings of the National Academy of Sciences, 108(supplement_3):15647-15654, 2011.
[29] Tuomas Haarnoja, Vitchyr Pong, Aurick Zhou, Murtaza Dalal, Pieter Abbeel, and Sergey Levine. Composable deep reinforcement learning for robotic manipulation. In 2018 IEEE international conference on robotics and automation (ICRA), pages 6244-6251. IEEE, 2018.
[30] Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on machine learning, pages 1861-1870. PMLR, 2018.
[31] Peter J Hammond. Harsanyi's utilitarian theorem: A simpler proof and some ethical connotations. In Rational Interaction, pages 305-319. Springer, 1992.
[32] John C Harsanyi. Cardinal welfare, individualistic ethics, and interpersonal comparisons of utility. Journal of political economy, 63(4):309-321, 1955.
[33] Geoffrey Heal. Intertemporal welfare economics and the environment. Handbook of environmental economics, 3:1105-1145, 2005.
[34] Robert A Jacobs, Michael I Jordan, Steven J Nowlan, and Geoffrey E Hinton. Adaptive mixtures of local experts. Neural computation, 3(1):79-87, 1991.
[35] Hong Jun Jeon, Smitha Milli, and Anca Dragan. Reward-rational (implicit) choice: A unifying formalism for reward learning. Advances in Neural Information Processing Systems, 33:4415-4426, 2020.
[36] Nan Jiang, Alex Kulesza, Satinder Singh, and Richard Lewis. The dependence of effective planning horizon on model accuracy. In Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems, pages 1181-1189, 2015.
[37] J Zico Kolter and Andrew Y Ng. Near-bayesian exploration in polynomial time. In Proceedings of the 26th annual international conference on machine learning, pages 513-520, 2009.
[38] Tjalling C Koopmans. Stationary ordinal utility and impatience. Econometrica: Journal of the Econometric Society, pages 287-309, 1960.
[39] David Kreps. Notes on the Theory of Choice. Westview press, 1988.
[40] David M Kreps and Evan L Porteus. Temporal resolution of uncertainty and dynamic choice theory. Econometrica: journal of the Econometric Society, pages 185-200, 1978.
[41] Romain Laroche, Mehdi Fatemi, Joshua Romoff, and Harm van Seijen. Multi-advisor reinforcement learning. arXiv preprint arXiv:1704.00756, 2017.