Feat(config): Error messages for missing suites

Closes #1444 
Style nitpick: add a space after if