Allow directories to be symlinks to directories

In that case we do not set the credential and perms on the directory
considering the user making those symlinks knows what he is doing.