do not create runtime.json if not PERSIST_ON_CHANGE