Implement value iteration and Q-learning; Agents tested first on Gridworld, then applied to a simulated robot controller (Crawler) and Pacman.