Properly error out when mixing old with new configurations. Fixes #651.