Add support for using autotest with files
For backwards compatibility still support :dirs.
It just uses :files
Refactor: Improving naming.
Its not really files, its files and dirs. Lets make that clear.
Silence output during test