916369: Do not persist config changes until the action completes
Merge pull request #523 from candlepin/bkearney/916369

916369: Do not persist config changes until the action completes