Make sure that old config data is all written out