Fixes #5745: Do the configid migration properly