Add testcases for the RemoteVerifier class.
Fix some flake, ignore some flake