Make it possible to add columns to columnar store without reloading all data