Add support for using autotest with files

Re issue: #187