Backfill tests for basic error handling when loading config

[#82968904]