shotop: adds test data; preprocesses input files to deal with different delimiters