alexvollmer/tuneup_js — Issue #15: Is it possible to run tuneuped UIAutomation test scripts in a build environment?
Author: ChenxinYan
Created: 2012-01-12 19:41:13+00:00
State: open

Thanks for this great library, which makes scripts more like test cases. Now I am wondering if it can do more.

WIth UIAutomation 4.2, I am able to run tests in command line. However, I have to look through the output to check if all tests passed. This does not work for Continuous Integration build system. Is there anything available to help my case? Or I have to write an extra piece of software to parse the output then decide to fail the build or not. It helps even if tuneup_js can print out a summary that says if any test failed.

To help understanding. The following illustrates how I tick off test runs on command line and its output.

Thanks a lot!

Chexin

============

$ instruments -w 43f5e9e749005e145fcf0f1b5d9346e2e2b4ecf4 -t ~/Library/"Application Support"/Instruments/Templates/Template_login_tuneup_II MyApp

2012-01-12 11:31:25 -0800 Start: Test checking login then cancel
2012-01-12 11:31:25 -0800 Debug: target.frontMostApp().keyboard().typeString("somebody@someCompany.com")
2012-01-12 11:31:28 -0800 Debug: target.frontMostApp().mainWindow().secureTextFields()["password"].tap()
2012-01-12 11:31:28 -0800 Debug: target.frontMostApp().mainWindow().secureTextFields()["password"].tap()
2012-01-12 11:31:28 -0800 Debug: target.frontMostApp().keyboard().typeString("password")
2012-01-12 11:31:29 -0800 Debug: target.frontMostApp().mainWindow().buttons()["rememberMe"].tap()
2012-01-12 11:31:29 -0800 Debug: target.frontMostApp().mainWindow().buttons()["launch"].tap()
2012-01-12 11:31:31 -0800 Debug: target.frontMostApp().mainWindow().buttons()["cancel"].tap()
2012-01-12 11:31:31 -0800 Pass: Test checking login then cancel

2012-01-12 11:31:31 -0800 Start: Test checking login then cancel (II)
012-01-12 11:31:25 -0800 Debug: target.frontMostApp().keyboard().typeString("somebody@someCompany.com")
2012-01-12 11:31:28 -0800 Debug: target.frontMostApp().mainWindow().secureTextFields()["password"].tap()
2012-01-12 11:31:28 -0800 Debug: target.frontMostApp().mainWindow().secureTextFields()["password"].tap()
2012-01-12 11:31:28 -0800 Debug: target.frontMostApp().keyboard().typeString("password")
2012-01-12 11:31:36 -0800 Debug: target.frontMostApp().mainWindow().buttons()["rememberMe"].tap()
2012-01-12 11:31:36 -0800 Debug: target.frontMostApp().mainWindow().buttons()["launch"].tap()
2012-01-12 11:31:37 -0800 Debug: target.frontMostApp().mainWindow().buttons()["cancel"].tap()
2012-01-12 11:31:37 -0800 Pass: Test checking login then cancel (II)

Instruments Trace Complete (Duration : 16.793417s; Output : /Users/somebody/workspace/SVN/rtoss-trunk-1/build-client-iOS-appstore_d/ui_testing/instrumentscli14.trace)