Honor (lack of) mode recurse in file.directory

Currently, we set the mode recursively if the file.directory state is
set to recurse whether or not recurse: mode is specified. This change
makes mode follow the same recurse behavior as user and group.