Fix `test_config_only_without_actually_configuring_anything_fails` since it's now a warning.