Support running files in the repl with autotest

Unsure where the repl autotest work is tested. Any suggestions?