Fix JenkinsTest when run alongside other end-to-end tests