Don't assume a site has index.html
Fix redirector path handling to be absolute to the context
Restore recursive path redirecting, with saner conditionals
Don't set xmlwalker empty titles
Simplify xmlwalker keys by using conventional names such as excludeFromNav
Use lxml to make parsed HTML links absolute
Don't add xmlwalker redirects for Link objects
Fix folder redirects by assuming that a folder should use the dirname path
If the xmlwalker path dirname is not a Folder, use it's parent
Only exclude xmlwalker items from nav if they have not already been constructed
Move some xmlwalker sections to the place where they are actually run
Normalize xmlwalker leading and trailing slashes for seen paths and URLs
Better to install plone without default content when using xmlwalker
xmlwalker items from the dirwalker section should be treated as a URL source
not paths