I think the q-learning agent now works. (I changed the update equation kendall was using and changed a maximum value to zero instead of negative infinity)