 The problem falls into the entropy-regularized  relaxed stochastic control framework recently introduced in Wang et al. (2019).
<meaning-changed>  The problem falls into the entropy-regularized  relaxed stochastic control framework recently introduced in Wang et al. (2019).
 The problem is to achieve the best tradeoff between exploration and exploitation, and is formulated as an entropy-regularized relaxed stochastic control framework recently introduced in Wang et al. (2019).