Don't call chown() when initializing config dirs unless owner != worker user.
Merge pull request #621 from jart/dont-chown

Security Fix: Don't call chown() unless necessary.