Package: dokuwikidumper
DokuWiki DumperA tool for archiving DokuWiki.Recommend usingdokuWikiDumperonmodernfilesystems, such asext4orbtrfs.NTFSis not recommended because it denies many special characters in the filename.For webmasterIf you don’t want your wiki to be archived, add the following to yourdomain/robots.txt:User-agent: dokuWikiDumper
Disallow: /RequirementsdokuWikiDumperPython 3.8+ (developed on py3.10)beautifulsoup4requestslxmlrichdokuWikiUploaderUpload wiki dump toInternet Archive.dokuWikiUploader -hfor help.internetarchivep7zip (7zcommand) (p7zip-fullpackage)InstalldokuWikiDumperdokuWikiUploaderis included indokuWikiDumper.InstalldokuWikiDumperwithpip(recommended)https://pypi.org/project/dokuwikidumper/pip3installdokuWikiDumperInstalldokuWikiDumperwithPoetry(for developers)InstallPoetrypip3installpoetryInstalldokuWikiDumpergitclonehttps://github.com/saveweb/dokuwiki-dumpercddokuwiki-dumper
poetryinstall
rmdist/-rf
poetrybuild
pipinstall--force-reinstalldist/dokuWikiDumper*.whlUsageusage:dokuWikiDumper[-h][--content][--media][--html][--pdf][--current-only][--skip-toSKIP_TO][--pathPATH][--no-resume][--threadsTHREADS][--i-love-retro][--insecure][--ignore-errors][--ignore-action-disabled-edit][--ignore-disposition-header-missing][--trim-php-warnings][--delayDELAY][--retryRETRY][--hard-retryHARD_RETRY][--parserPARSER][--usernameUSERNAME][--passwordPASSWORD][--cookiesCOOKIES][--auto][-u][-gUPLOADER_ARGS]url

dokuWikiDumperVersion:0.1.31

positionalarguments:urlURLofthedokuWiki(providethedoku.phpURL)options:-h,--helpshowthishelpmessageandexit--current-onlyDumplatestrevision,nohistory[default:false]--skip-toSKIP_TO!DEV!Skiptotitlenumber[default:0]--pathPATHSpecifydumpdirectory[default:<site>-<date>]--no-resumeDonotresumeapreviousdump[default:resume]--threadsTHREADSNumberofsubthreadstouse[default:1],notrecommendedtoset>5--i-love-retroDonotcheckthelatestversionofdokuWikiDumper(frompypi.org)beforerunning[default:False]--insecureDisableSSLcertificateverification--ignore-errors!DANGEROUS!ignoreerrorsinthesubthreads.Thismaycauseincompletedumps.--ignore-action-disabled-editSomesitesdisableeditactionforanonymoususersandsomecorepages.Thisoptionwillignorethiserrorandtextareanotfounderror.Butyoumayonlygetapartialdump.(onlyworkswith--content)--ignore-disposition-header-missingDonotcheckDispositionheader,usefulforoutdated(<2014)DokuWikiversions[default:False]--trim-php-warningsTrimPHPwarningsfromrequests.Response.text--delayDELAYDelaybetweenrequests[default:0.0]--retryRETRYMaximumnumberofretries[default:5]--hard-retryHARD_RETRYMaximumnumberofretriesforharderrors[default:3]--parserPARSERHTMLparser[default:lxml]--usernameUSERNAMElogin:username--passwordPASSWORDlogin:password--cookiesCOOKIEScookiesfile--autodump:content+media+html,threads=3,ignore-action-disable-edit.(threadsisoverridable)-u,--uploadUploadwikidumptoInternetArchiveaftersuccessfullydumped(onlyworkswith--auto)-gUPLOADER_ARGS,--uploader-argUPLOADER_ARGSArgumentsforuploader.

Datatodownload:Whatinfodownloadfromthewiki--contentDumpcontent--mediaDumpmedia--htmlDumpHTML--pdfDumpPDF(OnlyavailableonsomewikiswiththePDFexportplugin)(OnlydumpsthelatestPDFrevision)For most cases, you can use--autoto dump the site.dokuWikiDumperhttps://example.com/wiki/--autowhich is equivalent todokuWikiDumperhttps://example.com/wiki/--content--media--html--threads3--ignore-action-disabled-editHighly recommend using--usernameand--passwordto login (or using--cookies), because some sites may disable anonymous users to access some pages or check the raw wikitext.--cookiesaccepts a Netscape cookies file, you can usecookies.txt Extensionto export cookies from Firefox. It also accepts a json cookies file created byCookie Quick Manager.Dump structureDirectory or FileDescriptionattic/old revisions of page. (wikitext)dumpMeta/(dokuWikiDumper only) metadata of the dump.dumpMeta/check.html?do=check page of the wiki.dumpMeta/config.jsondump's configuration.dumpMeta/favicon.icofavicon of the site.dumpMeta/files.txtlist of filename.dumpMeta/index.htmlhomepage of the wiki.dumpMeta/info.jsoninfomations of the wiki.dumpMeta/titles.txtlist of page title.html/(dokuWikiDumper only) HTML of the pages.media/media files.meta/metadata of the pages.pages/latest page content. (wikitext)*.markmark file.Available Backups/DumpsI made some backups for testing, you can check out the list:https://github.com/orgs/saveweb/projects/4.Some wikidump has been uploaded to IA, you can check out:https://archive.org/search?query=subject%3A"dokuWikiDumper"If you dumped a DokuWiki and want to share it, please feel free to open an issue, I will add it to the list.How to import dump to DokuWikiIf you need to import Dokuwiki, please add the following configuration tolocal.php$conf['fnencode'] = 'utf-8'; // Dokuwiki default: 'safe' (url encode)# 'safe' => Non-ASCII characters will be escaped as %xx form.# 'utf-8' => Non-ASCII characters will be preserved as UTF-8 characters.$conf['compression'] = '0'; // Dokuwiki default: 'gz'.# 'gz' => attic/<id>.<rev_id>.txt.gz# 'bz2' => attic/<id>.<rev_id>.txt.bz2# '0' => attic/<id>.<rev_id>.txtImportpagesdir if you only need the latest version of the page.Importmetadir if you need thechangelogof the page.Importatticandmetadirs if you need the old revisionscontentof the page.Importmediadir if you need the media files.dumpMetaandhtmldirs are only used bydokuWikiDumper, you can ignore it.InformationDokuWiki linksDokuWikiDokuWiki changelogDokuWiki source codeDokuWiki - ArchiveTeam WikiOther toolswikiteam/WikiTeam, a tool for archiving MediaWiki, written in Python 2 that you won't want to use nowadays. :(mediawiki-client-tools/MediaWiki Scraper(akawikiteam3), a tool for archiving MediaWiki, forked fromWikiTeamand has been rewritten in Python 3. (Lack of code writers and reviewers, STWP no longer maintains this repo.)saveweb/WikiTeam3forked from MediaWiki Scraper, maintained by STWP. :)DigitalDwagon/WikiBota Discord and IRC bot to run the dokuWikiDumper and wikiteam3 in the background.LicenseGPLv3ContributorsThis tool is based on an unmerged PR (8 years ago!) ofWikiTeam:DokuWiki dump alphaby@PiRSquared17.I (@yzqzss) have rewritten the code in Python 3 and addedsome features, also fixedsome bugs.