Before revision:  This paper introduces Voronoi Progressive Widening (VPW), a general technique to modify tree search algorithms to effectively handle continuous or hybrid action spaces , and proposes and evaluates three continuous space solvers: VOSS, VOWSS, and VOMCPOW. VOSS and VOWSSare theoretical tools based on sparse sampling and Voronoi optimistic optimization designed to justify VPW-based  online solvers . While previous algorithms have enjoyed convergence guarantees for problems with continuous state and observation spaces, VOWSS is the first  with global convergence guarantees for problems that additionally have continuous action spaces.
After revision:  This paper introduces Voronoi Progressive Widening (VPW), a general technique to modify tree search algorithms to effectively handle continuous or hybrid action spaces , and proposes and evaluates three continuous space solvers: VOSS, VOWSS, and VOMCPOW. VOSS and VOWSSare theoretical tools based on sparse sampling and Voronoi optimistic optimization designed to justify VPW-based online solvers , and it is the first with global convergence guarantees for problems that additionally have continuous action spaces.