further changes to grid world test for different encoding methods