nebius/SWE-rebench-V2-PRs huggingface dataset:
Repository: Azure/ARO-RP
Pull request #2435 (2022-09-30 15:58:07)

Stylistic: makes e2e flags consistent
Changes nothing: only adds missing `-` (apperently ginkgo works with single - in flags as well) and re-orders flags so that `go test` flags are grouped together and `ginkgo` flags are together.


Patch:
diff --git a/Makefile b/Makefile
index ceded499e..6956b51a3 100644
--- a/Makefile
+++ b/Makefile
@@ -2,7 +2,7 @@ SHELL = /bin/bash
 TAG ?= $(shell git describe --exact-match 2>/dev/null)
 COMMIT = $(shell git rev-parse --short=7 HEAD)$(shell [[ $$(git status --porcelain) = "" ]] || echo -dirty)
 ARO_IMAGE_BASE = ${RP_IMAGE_ACR}.azurecr.io/aro
-E2E_FLAGS ?= -ginkgo.timeout 180m -test.v -ginkgo.v --ginkgo.flake-attempts=2
+E2E_FLAGS ?= -test.v --ginkgo.v --ginkgo.timeout 180m --ginkgo.flake-attempts=2
 
 # fluentbit version must also be updated in RP code, see pkg/util/version/const.go
 FLUENTBIT_VERSION = 1.9.4-1
diff --git a/pkg/operator/README.md b/pkg/operator/README.md
index 693bc6970..f9d4aa7c6 100644
--- a/pkg/operator/README.md
+++ b/pkg/operator/README.md
@@ -151,5 +151,5 @@ oc -n openshift-config get secrets/pull-secret -o template='{{index .data ".dock
 ### How to run operator e2e tests
 
 ```sh
-go test ./test/e2e -v -ginkgo.v -ginkgo.focus="ARO Operator" -tags e2e
+go test ./test/e2e -tags e2e -test.v --ginkgo.v --ginkgo.focus="ARO Operator"
 ```


Test patch:
diff --git a/.pipelines/templates/template-prod-e2e-steps.yml b/.pipelines/templates/template-prod-e2e-steps.yml
index a9afe1051..6f6be0707 100644
--- a/.pipelines/templates/template-prod-e2e-steps.yml
+++ b/.pipelines/templates/template-prod-e2e-steps.yml
@@ -53,6 +53,6 @@ steps:
       --env CLUSTER="v4-e2e-V$BUILD_BUILDID-$LOCATION" \
       --entrypoint e2e.test \
       "$IMAGE:$VERSION" \
-      -ginkgo.timeout 180m -test.v -ginkgo.v
+      -test.v --ginkgo.v --ginkgo.timeout 180m --ginkgo.flake-attempts=2
 
   displayName: 🚀 Run ${{ parameters.location }} E2E
Repository: Azure/ARO-RP
Pull request #2519 (2022-11-04 10:58:48)

Adds junit report to E2E
### Which issue this PR addresses:

Part of [WI 13667437](https://msazure.visualstudio.com/AzureRedHatOpenShift/_workitems/edit/13667437/).

### What this PR does / why we need it:

So we can see trends and more easily identify most frequently failing tests.

### Test plan for issue:

Run E2E pipeline

### Is there any documentation that needs to be updated for this PR?

No, CI updates.



Patch:
diff --git a/Makefile b/Makefile
index a69b5e939..169df4de3 100644
--- a/Makefile
+++ b/Makefile
@@ -2,7 +2,7 @@ SHELL = /bin/bash
 TAG ?= $(shell git describe --exact-match 2>/dev/null)
 COMMIT = $(shell git rev-parse --short=7 HEAD)$(shell [[ $$(git status --porcelain) = "" ]] || echo -dirty)
 ARO_IMAGE_BASE = ${RP_IMAGE_ACR}.azurecr.io/aro
-E2E_FLAGS ?= -test.v --ginkgo.v --ginkgo.timeout 180m --ginkgo.flake-attempts=2
+E2E_FLAGS ?= -test.v --ginkgo.v --ginkgo.timeout 180m --ginkgo.flake-attempts=2 --ginkgo.junit-report=e2e-report.xml
 
 # fluentbit version must also be updated in RP code, see pkg/util/version/const.go
 FLUENTBIT_VERSION = 1.9.9-1


Test patch:
diff --git a/.pipelines/e2e.yml b/.pipelines/e2e.yml
index dd960fb3c..5aaf2aa3c 100644
--- a/.pipelines/e2e.yml
+++ b/.pipelines/e2e.yml
@@ -20,13 +20,16 @@ jobs:
     demands: go-1.17
   steps:
   - template: ./templates/template-checkout.yml
+
   - template: ./templates/template-az-cli-login.yml
     parameters:
       azureDevOpsJSONSPN: $(aro-v4-e2e-devops-spn)
+
   - template: ./templates/template-push-images-to-acr.yml
     parameters:
       rpImageACR: $(RP_IMAGE_ACR)
       buildCommand: publish-image-aro
+
   - script: |
       export CI=true
       . ./hack/e2e/run-rp-and-e2e.sh
@@ -44,6 +47,7 @@ jobs:
 
       make test-e2e
     displayName: Execute Tests
+
   - script: |
       export CI=true
       . ./hack/e2e/run-rp-and-e2e.sh
@@ -57,10 +61,18 @@ jobs:
       tar cf must-gather.tar.gz must-gather.local.*
     displayName: Collect must-gather
     condition: failed()
+
   - publish: must-gather.tar.gz
     artifact: must-gather
     displayName: Append must-gather to Pipeline
     condition: failed()
+
+  - task: PublishTestResults@2
+    displayName: 📊 Publish tests results
+    inputs:
+      testResultsFiles: $(System.DefaultWorkingDirectory)/**/e2e-report.xml
+    condition: succeededOrFailed()
+
   - task: CopyFiles@2
     condition: succeededOrFailed()
     inputs:
@@ -72,6 +84,7 @@ jobs:
     inputs:
       pathToPublish: $(Build.ArtifactStagingDirectory)
       artifactName: Screenshots
+
   - script: |
       export CI=true
       . ./hack/e2e/run-rp-and-e2e.sh
@@ -83,4 +96,5 @@ jobs:
       kill_vpn
     displayName: Cleanup
     condition: always()
+
   - template: ./templates/template-az-cli-logout.yml