Reverted per column caching aside from id field.

Was a bit messy, just so hard to automagically cache stuff without knowing the data usage.