separate filtering from transposing
move more of the processing into read_files
add ability to join rows from different columns