Support running performance tests of different builds using the same Gradle version

+review REVIEW-5318