Introduce end-to-end performance tests on medium-sized data

This isn't quite done, but figured it's at a good spot to get feedback.

In particular the cluster security isn't set up correctly yet and thus this hasn't been tested end-to-end.
Then for these it can be map with a pattern match on the column names.

Not sure if it will really be better, just closer to how we would normally process line-by-line data.