Add a file that will be rollback