Modified several policy evaluation algorithms to implement the
PolicyEvaluation interface.