[IMP] config: Test that the config file is readable

Fixes #3237

cherry-pick of 8e72049