NonApkTestRunner test case and updates test runner to work with alpha3