Revert "Turn persist_once on by default"

This reverts commit 6c5da4ddbc5c51cab78bda575974691cebeeb16d.
Update changelog