Add support for using autotest with files
For backwards compatibility still support :dirs.
It just uses :files