Yep, but running the tests manually does not make "make" exit with an error code and therefore Travis marks the build an broken. Running with catkin_make test will exit with failure if the tests fail.