Start work on #4405

This commit adds the errors to the pillar. The next step is to have
state runs fail if errors are found in the pillar.