Created mechanism for reqriting all data - useful for doing incremental expansions of the data model
For #29-subject-shards
Do not rewrite all data every day
For #29-subject-shards