Package: wayback-machine-archiver
Wayback Machine Archiver (Archiver for short) is a commandline utility
writen in Python to backup Github Pages using theInternet
Archive.InstallationThe best way to install Archiver is withpip:pipinstallwayback-machine-archiverThis will give you access to the script simply by calling:archiver--helpYou can also clone this repository:gitclonehttps://github.com/agude/wayback-machine-archiver.gitcdwayback-machine-archiverpython./wayback_machine_archiver/archiver.py--helpIf you clone the repository, Archiver can be installed as a local
application using thesetup.pyscript:gitclonehttps://github.com/agude/wayback-machine-archiver.gitcdwayback-machine-archiver./setup.pyinstallWhich, like usingpip, will give you access to the script by callingarchiver.Archiver requiresthe ``requests`library <https://github.com/kennethreitz/requests>`__ by Kenneth Reitz.
Archiver supports Python 2.7, and Python 3.4+.UsageThe simplest way to schedule a backup is by specifying the URL of a web
page, like so:archiverhttps://alexgude.comThis will submit the main page of my blog,alexgude.com, to the Wayback Machine for
archiving.You can also archive all the URLs specified in a`sitemap.xml<https://en.wikipedia.org/wiki/Sitemaps>`__ as follows:archiver--sitemapshttps://alexgude.com/sitemap.xmlThis will backup every page listed in the sitemap of my website,alexgude.com.You can also pass a sitemap.xml file (requires thefile://prefix)
to the archiver:archiver--sitemapsfile://sitemap.xmlYou can backup multiple pages by specifying multiple URLs or sitemaps:archiverhttps://radiokeysmusic.com--sitemapshttps://charles.uno/sitemap.xmlhttps://alexgude.com/sitemaps.xmlYou can also backup multiple URLs by writing them to a file (for
example,urls.txt), one URL per line, and passing that file to
archiver:archiver--fileurls.txtSitemaps often exclude themselves, so you can request that the sitemap
itself be backed up using the flag--archive-sitemap-also:archiver--sitemapshttps://alexgude.com/sitemaps.xml--archive-sitemap-alsoHelpFor a full list of commandline flags, Archiver has a built-in help
displayed witharchiver--help:usage: archiver [-h] [--version] [--file FILE]
                [--sitemaps SITEMAPS [SITEMAPS ...]]
                [--log {DEBUG,INFO,WARNING,ERROR,CRITICAL}]
                [--log-to-file LOG_FILE] [--archive-sitemap-also]
                [--jobs JOBS] [--rate-limit-wait RATE_LIMIT_IN_SEC]
                [urls [urls ...]]

A script to backup a web pages with Internet Archive

positional arguments:
  urls                  the URLs of the pages to archive

optional arguments:
  -h, --help            show this help message and exit
  --version             show program's version number and exit
  --file FILE           path to a file containing urls to save (one url per
                        line)
  --sitemaps SITEMAPS [SITEMAPS ...]
                        one or more URIs to sitemaps listing pages to archive;
                        local paths must be prefixed with 'file://'
  --log {DEBUG,INFO,WARNING,ERROR,CRITICAL}
                        set the logging level, defaults to WARNING
  --log-to-file LOG_FILE
                        redirect logs to a file
  --archive-sitemap-also
                        also submit the URL of the sitemap to be archived
  --jobs JOBS, -j JOBS  run this many concurrent URL submissions, defaults to
                        1
  --rate-limit-wait RATE_LIMIT_IN_SEC
                        number of seconds to wait between page requests to
                        avoid flooding the archive site, defaults to 5; also
                        used as the backoff factor for retriesSetting Up aSitemap.xmlfor Github PagesIt is easy to automatically generate a sitemap for a Github Pages Jekyll
site. Simply usejekyll/jekyll-sitemap.Setup instructions can be found on the above site; they require changing
just a single line of your site’s_config.yml.