What I was planing for for this project was that user should be able to run tests locally, that was also one of the reasons to keep the tests with application code itself. 
What do you think @bobsilverberg  ?