comments added for value_iteration