Only write config on configure