Refactor :only column filtering to private method

I prefer not to do any unnecessary calculations in #initialize, so that
objects are easier to instantiate for unit testing.