Modern Dynamic Programming Approaches to Sequential Decision Making
By: Seungki Min
Publisher: [publisher not identified]
Published: 2021
Place of publication: [New York, N.Y.?]
Language: eng
Description: Dynamic programming (DP) has long been an essential framework for solving sequential decision-making problems. However, when the state space is intractably large or the objective contains a risk term, the conventional DP framework often fails to work. In this dissertation, we investigate such issues, particularly those arising in the context of multi-armed bandit problems and risk-sensitive optimal execution problems, and discuss the use of modern DP techniques to overcome these challenges such as information relaxation, policy gradient, and state augmentation. We develop frameworks formalize and improve existing heuristic algorithms (e.g., Thompson sampling, aggressive-in-the-money trading), while shedding new light on the adopted DP techniques.
Notes: Department: Business.

Thesis advisor: Ciamac Cyrus Moallemi.

Thesis advisor: Constantinos Maglaras.

Thesis (Ph.D.)--Columbia University, 2021.