Allow for custom path as well as specifying plugin id for jake test