Pillar dirs don't need to flag a failure

Fix #18299