Added functionality to create and delete the Spark scratch space before and after each test run respectively. Bumped teardown time up to 30 minutes (deleting the many files Spark creates may take some time).