[67] David Silver, Satinder Singh, Doina Precup, and Richard S Sutton. Reward is enough. Artificial Intelligence, 299:103535, 2021.
[68] Satinder P Singh and David Cohn. How to dynamically merge markov decision processes. In Advances in neural information processing systems, pages 1057-1063, 1998.
[69] Joar Skalse and Alessandro Abate. On the limitations of markovian rewards to express multi-objective, risk-sensitive, and modal tasks. In Uncertainty in Artificial Intelligence, pages 1974-1984. PMLR, 2023.
[70] Matthew J Sobel. Ordinal dynamic programming. Management science, 21(9):967-975, 1975.
[71] Robert M Solow et al. Growth theory. an exposition. In Growth theory. An exposition. Oxford: Clarendon Press., 1970.
[72] Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. Learning to summarize with human feedback. Advances in Neural Information Processing Systems, 33:3008-3021, 2020.
[73] Patrick Suppes. Behavioristic foundations of utility. Econometrica: Journal of The Econometric Society, pages 186-202, 1961.
[74] Richard S Sutton and Andrew G Barto. Reinforcement Learning: An Introduction. MIT Press, 2018.
[75] Richard S Sutton, Joseph Modayil, Michael Delp, Thomas Degris, Patrick M Pilarski, Adam White, and Doina Precup. Horde: A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. In The 10th International Conference on Autonomous Agents and Multiagent Systems-Volume 2, pages 761-768. International Foundation for Autonomous Agents and Multiagent Systems, 2011.
[76] Csaba Szepesvári. Constrained mdps and the reward hypothesis. Musings about machine learning and other things (blog), 2020.
[77] Peter Vamplew, Benjamin J Smith, Johan Källström, Gabriel Ramos, Roxana Răduulescu, Diederik M Roijers, Conor F Hayes, Fredrik Heintz, Patrick Mannion, Pieter JK Libin, et al. Scalar reward is not enough: A response to silver, singh, precup and sutton (2021). Autonomous Agents and Multi-Agent Systems, 36(2):41, 2022.
[78] Kristof Van Moffaert and Ann Nowé. Multi-objective reinforcement learning using sets of pareto dominating policies. The Journal of Machine Learning Research, 15(1):3483-3512, 2014.
[79] Kristof Van Moffaert, Madalina M Drugan, and Ann Nowé. Scalarized multi-objective reinforcement learning: Novel design techniques. In 2013 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL), pages 191-199. IEEE, 2013.
[80] Harm Van Seijen, Mehdi Fatemi, and Arash Tavakoli. Using a logarithmic mapping to enable lower discount factors in reinforcement learning. Advances in Neural Information Processing Systems, 32, 2019.
[81] John Von Neumann and Oskar Morgenstern. Theory of games and economic behavior. Princeton university press, 1953.
[82] Nir Vulkan. An economist's perspective on probability matching. Journal of economic surveys, 14(1): 101-118, 2000.
[83] Martin L Weitzman. Gamma discounting. American Economic Review, 91(1):260-271, 2001.
[84] John A Weymark. Measurement theory and the foundations of utilitarianism. Social Choice and Welfare, 25(2-3):527-555, 2005.
[85] Martha White. Unifying task specification in reinforcement learning. In The Thirty-fourth International Conference on Machine Learning, 2017.
[86] Christian Wirth, Riad Akrour, Gerhard Neumann, and Johannes Furnkranz. A survey of preference-based reinforcement learning methods. Journal of Machine Learning Research, 18(136):1-46, 2017.
[87] John I Yellott Jr. The relationship between luce's choice axiom, Thurstone's theory of comparative judgment, and the double exponential distribution. Journal of Mathematical Psychology, 15(2):109-144, 1977.
[88] Stephane Zuber. The aggregation of preferences: can we ignore the past? Theory and decision, 70(3): 367-384, 2011.