Code used for discret action space experiments in my PhD thesis.