you actually have the same problem in general in classic rl as well but you know you can cut off time steps and so on there are various hacks in any case there can be advantages to not having that gradient and evolutionary methods are a way to do that in evolutionary method usually you are don't train one agent you train a population of agents so you have a bunch of these uh neural network agents in here and the way you update the neural network agent is you simply let them run you know you let them run your app