I mean have run-tests.py generate test/testcases.jsonp everytime it is invoked by calling on test/update-testcases.py. This way we don't need to run it manually when we add new tests.
We can .gitignore test/testcases.jsonp to keep the file from getting back into the repo.