Er, my mistake here, sorry for sending you down the garden path. I was apparently confusing `py.test` with unittest's discovery capabilities. Unittest (and thus this runner) can accept directory paths to discover within, but not paths to test files. I've added a test for this, and corrected the docs.