Fixed a potential bug where METHOD_FAIL and URL_FAIL could be confused in remove dups optimization