Before revision:  With this, we offer new insights into understanding the action selection mechanisms in RL . During the analysis of the robotic environment, we present various small modifications on the very same schema that lead to different optimal policies . Finally, we emphasize that beyond building efficient RL algorithms, only the proper design of the environment can ensure the desired results .
After revision:  With this, we offer new insights into understanding the action selection mechanisms in RL . During the analysis of the robotic environment, we present various small modifications on the very same schema that lead to different optimal policies .