Mailing Lists

Mailing lists are a type of discussion group that is a precursor to forums (like Discourse) and is declining in popularity as email declines in use, being replaced by forums, and then social media. Existing mailing lists have a lot of history that would be useful to save.
= Requirements =
* Some sites only support TLS 1.0, or maybe even SSL 3 or earlier
* Some software (notably Sympa) or sites need POST plus a cookie to get otherwise public archives
= Sources =
There are some things that could be useful to find mailing list services/software:
* Wikidata
** instance of (P31) electronic mailing list (Q304863)
** might be a few more with other links to that item via refs etc
* Search engine enumeration
* https://en.wikipedia.org/wiki/List_of_mailing_list_software
* https://en.wikipedia.org/wiki/Category:Mailing_list_software
* https://alternativeto.net/tag/mailing-list/
* https://builtwith.com/mailman
= Services =
There are a number of notable services that include mailing lists, some have public archives:
* Usenet
* Gmane (now NNTP-only)
* The Mail Archive
** raw emails not publicly accessible
** some lists archived elsewhere too, but sole archive source for some lists (eg Hyphanet devl)
* Mailing list ARChives (MARC)
** raw or partially raw mails public
** some lists archived elsewhere too, but sole archive source for some lists (eg some KDE lists)
* thr3ads.net
** archives lists on Google Groups, Mailman 2 instances and other services
* Nabble
* Narkive
** main site is Usenet
** lists on subdomains, for eg https://debian-knoppix.linuxtag.narkive.com/
* FreeLists
* Google Groups
* groups.io
** Has support for custom domains, for eg https://lists.lfenergy.org/g/main
* Simplelists
** https://srfi.schemers.org/srfi-list-subscribe.html
* SourceForge
** Derived from Mailman
** example https://lists.sourceforge.net/lists/listinfo/valgrind-announce
* Framasoft
* LWN
* Debian
* notmuch
* PostgreSQL
* LibreOffice
* ActiveState
* SecLists
== Message-Id lookup ==
There are some services that offer Message-Id lookup. It is important that we archive both the Message-Id based URLs and the URLs they redirect to. We should also extract the Message-Ids from every message to develop a mapping between Message-Ids and URLs, and later create a service for searching that.
http://mid.gmane.org/alpine.BSF.2.00.1004291655110.61392@x.fncre.vasb
nntp://news.gmane.io/65491cda.c80a0220.5fa79.7688SMTPIN_ADDED_BROKEN@mx.google.com
http://news.gmane.org/find-root.php?message_id=alpine.BSF.2.00.1004291655110.61392@x.fncre.vasb
https://marc.info/?i=Prayer.1.0.18.0811191202370.4107@sabinus.cs.umn.edu
http://mid.mail-archive.com/9dc4201d0807272359r1f0ad9d6ta44f31f439de58b7@mail.gmail.com
https://www.mail-archive.com/search?l=mid&q=9dc4201d0807272359r1f0ad9d6ta44f31f439de58b7@mail.gmail.com
https://www.freebsd.org/cgi/mid.cgi?db=mid&id=199802242058.MAA24843@monk.via.net
https://docs.FreeBSD.org/cgi/mid.cgi?db=mid&id=199802242058.MAA24843@monk.via.net
https://mail-archive.freebsd.org/cgi/mid.cgi?db=mid&id=199802242058.MAA24843@monk.via.net
https://lists.debian.org/msgid-search/20050606213954.GC884@finlandia.infodrom.north.de
https://lists.debian.org/msgid-search/?m=YvogMm/B0cM/AUMu@einval.com
https://lists.debconf.org/cgi-lurker/keyword.cgi?doc-url=/lurker&format=en.html&query=id:87vey4ogcj.fsf@vorlon.ganneff.de
https://www.w3.org/mid/alpine.BSF.2.00.1004291655110.61392@x.fncre.vasb
https://www.postgresql.org/message-id/20060419051850.96025.qmail@web31802.mail.mud.yahoo.com
https://public-inbox.org/git/Pine.LNX.4.58.0504150753440.7211@ppc970.osdl.org
https://article.olduse.net/40478@ucbvax.BERKELEY.EDU
http://al.howardknight.net/msgid.cgi?STYPE=msgid&A=0&MSGI=<usenet-hier-faq-1516003264%246620%40hope.eyrie.org>
https://lwn.net/ml/linux-kernel/20181020134908.GA32218@kroah.com/
https://lwn.net/ml/all/20181020134908.GA32218@kroah.com/
https://lore.kernel.org/all/20181020134908.GA32218@kroah.com/
https://yhbt.net/lore/all/20181020134908.GA32218@kroah.com/
https://public-inbox.org/git/1486427537.16949.42.camel@bonedaddy.net/
https://www.43-1.org/app/nntp/mid/20050606213954.GC884@finlandia.infodrom.north.de
https://forum.dlang.org/post/d19o8m$1jlj$1@digitaldaemon.com
https://www.nntp.perl.org/group/perl.beginners/;msgid=01041316021102.03716%40localhost.localdomain
https://nmbug.notmuchmail.org/nmweb/show/156832191038.4937.14365134928759130092%40fireG0
https://www.ctan.org/ctan-ann/id/mailman.3878.1440779487.4386.ctan-ann@dante.de
lists.sr.ht graphql API
https://archives.spi-inc.org/message-id/14d2a7e9-3269-d881-7f15-506bbf78299f%40spi-inc.org
= Software =
There are lots of software for mailing lists that have instances with public archives:
* Mailman: versions 2 (pipermail archives) and 3 (HyperKitty archives)
** Requires a very special strategy for Mailman 2 instances
** pabs is monitoring ArchiveBot for Mailman 2 URL patterns
** HyperKitty example https://lists.darmstadt.ccc.de/hyperkitty/
* Sympa
** May need POST plus a cookie to get otherwise public archives
** https://framalistes.org/sympa/ https://framagroupes.org/abc/en/ https://groupes.renater.fr/sympa https://listes.centrale-marseille.fr/ https://listes.ens-paris-saclay.fr/wws/ https://listes.entrouvert.com/ https://listes.hadoly.fr/ https://listes.infini.fr/ https://listes.renater.fr/wws/ https://listes.univ-reunion.fr/wws/ https://lists.cam.ac.uk/sympa/ https://lists.ens.psl.eu/wws/ https://lists.fdn.fr/ https://lists.linuxfromscratch.org/sympa/ https://lists.squat.net/wws/ https://lists.uniroma2.it/ https://lists.vvn-bda.de/ https://mlistes.resel.fr/wws/ https://sympa.laas.fr/wws/ https://sympa.lix.polytechnique.fr/ https://sympa.obspm.fr/wws/ https://www.iut-tlse3.fr/wws/ https://www.listes.upmc.fr/wws/ https://mail.linuxtag.org/wws/
* Apache Pony Mail
** https://lists.apache.org/ (huge)
* public-inbox
** https://inbox.sourceware.org/ (huge) https://inbox.vuxu.org/ https://list.orgmode.org/ https://lore.barebox.org/ https://lore.kernel.org/ (huge) https://lore.pengutronix.de/ https://lore.ptxdist.org/ https://yhbt.net/kgio-public/ https://yhbt.net/raindrops-public/ https://yhbt.net/unicorn-public/ https://yhetil.org/
* LISTSERV
** https://listserv.ihs.gov/ (saving in AB)
* lyris
* mlmmj
** seems to use external archivers
** lists.lighttpd.net
* lurker
** https://lists.dyne.org/ https://www.guilde.asso.fr/lurker/
* mhonarc
** https://identicalsoftware.com/maillist/xwpe/ https://archives.seul.org/ lists.gnu.org (saved by AB)
* hypermail
** https://lists.suckless.org/ https://list.skarnet.org/lists/ http://lalists.stanford.edu/
* Majordomo2
** https://mail.kspei.com/cgi-bin/mj_wwwusr?domain=lists.mj2.org&func=lists-full&extra=mj2-dev https://lists.openbsd.org/cgi-bin/mj_wwwusr
* ezmlm/ezmlm-idx/ezmlm-web (associated with qmail/djbdns)
** https://cr.yp.to/lists.html
* SourceHut
** mbox downloads behind a POST request
** https://lists.sr.ht/ https://lists.2mb.codes/ https://todo.argonaut-constellation.org/ https://lists.ditigal.xyz/~ruther https://lists.open-music-kontrollers.ch/~hp https://lists.xenrox.net/~xenrox https://lists.alpinelinux.org/
* CREN ListProc (more info)
* Unknown
** http://www.techwr-l.com/archives/
** https://lists.racket-lang.org/
= Tools =
These are some pages of and individual tools that are useful for archiving mailing lists:
* Mailman
* forum-dl
= Projects =
These are some former archiving projects by ArchiveTeam that involved mailing lists:
* Freeml
* DiscussionApps
* Yahoo! Groups
* Google Groups]
* Gna!
* BerliOS
* Google Groups Files
= Pages =
There are a number of wiki pages that mention mailing lists in some way.
* OWASP
* Gopher
* Spanish Revolution
* Hackerspaces
* WikiApiary
* OpenSolaris
* Internet infrastructure
* Chaos Computer Club
* AdelaideUniversityMerger
= Articles =
There are some articles about hosting mailing lists that may be useful.
* Creating an email archive with public-inbox