Sorry I didn't see this earlier. Fortunately @bajtos had the same suggestion: make the test setup script idempotent so it is a no-op after the first run, then it will be friendly to both CI and devs.