Create a tests directory with the runner