This is the problem.

I've mentioned on multiple occasions that the current post-Snowden security and privacy movement is creating a serious threat to the Internet history preservation, and to some extents, threat the understanding/insights of the human civilization in the digital age.

My personal interest is Internet culture and communities. And I'm not amused by this comment, let me talk about the problem briefly.

Online communication from 1970 to 1995 was almost completely public, archived indefinitely. You can still read every single comment by every hacker from the late 80s in Usenet archives, sometimes even back to the ARPAnet era. There are a million posts to read and no spam and low-effort posting at all (by modern standards, even many flame wars seem to be high-quality). You can easily lost days, months or even years in the Usenet archive.

Records like these are often the only remaining records of the online communities, a snapshot of great historical and cultural value. To me, even the controversial political flamewars are interesting as they reveal parts of the history I would not know otherwise (I guess if someone rereads Reddit threads about Donald Trump today in 2055, he/she may have a similar feeling).

On the other hand, you also have names, addresses, and even phone numbers of almost everyone posted on Usenet. It was not a big problem when the access to Usenet/Internet was exclusive to members of the academia, and at a time when there was almost no systematic, organized abuses of the personal information. But today's different, we have big and little brothers who have "Collect Them All" as their slogan, and they are actively trying to exploit the information available to the maximum extents.

What is the response then? People (at least many in the hacking community) start to prefer private, semi-private, or in-group communities over public communication, often protected by cryptography. Some people also actively erases/purges their footprints, for example, some would delete every single post when they left a community, no matter how insightful they are, others may even deliberately insert misleading or false information. And we have something roughly similar to Vernor Vinge's True Name (describes an underground hacking community in the cyberspace). Good, now personal privacy and security is more or less protected by using the cryptographic barrier.

But what is it doing then? We are now creating a unprecedented, HUGE GAP of information in history, within our life time, we are now entering a new digital Dark Age where no one has seen before.

Centralized and/or proprietary services often delete information when they go out-of-service, too, so we need to archive them, desperately. You can't imagine how many resources/memories that are extremely valuable to members of some communities exist solely on a single web server/service provider. I remember reading a post from Schneier's blog that says a website contains numerous posts of wine culture were gone forever when the hard drive failed, and one commenter said that he uses w3m/lynx CLI browsers, and records everything he reads to his hard drive so he would never lost a single piece of information he has seen.

Is it an act of little brother surveillance? Arguably, it can be seen as one. But is it justified? I would say yes, and even say we need more people doing this, systematically. Naturally, archive.org was born in this way.

But then it faces the same issue. On one hand, many archived information can be abused, on the other hand, the more archive-refusing people we have, the more damage to historical records is made.

I don't know how to solve this problem.

The only way I can think of, is (1) Cypherpunks were correct. Anonymity is crucial in the information age, and we should have more of it: never use True Name and reveal personal information unless absolutely necessary, use an anonymous network (e.g Tor) if possible, discard identities periodically (but if you delete posts, it still reverts to the original problem...), (2) Encourages further developments and applications of anonymity, and (3) Training people to assume every piece of information published publicly cannot be removed, may be abused, and they should be able to withstand all possible consequences of it. But now, "life" and "information" simply become inseparable, if you are active in a community you have to post something...

I don't know the solution.

---

Appendix 1: what you can see in an Usenet archive.

You can see people's reactions to the rumors that Apple would release new 68000-based machines, how Larry Wall was releasing patch-2.0, the debates about the audio fidelity of vacuum tube/transistor amplifier, how /bin/sh on System V was having a problem with "CFLAGS=-g make", the first hand perspective on the impact of Great Renaming, Richard Stallman announcing the GNU project and Linus's flamewar on microkernel with Tanenbaum, early Sci-Fi fandom culture posted from a 4.3-BSD machine (beta version!) and how it influenced the hacker culture, how the anti-spam movement gained momentum due to its intellectual challenges, raw discussions of fringe political movements (some interesting ones related to tech include the Cypherpunk movement, and Exopian, an early sect of transhumanism), FAQs on almost every subjects written by the active participants of the community who have probably spent hundreds of hours, some weird "emergent" memes/phenomena created out-of-nothing from the collective community, and also have a laugh on thousands of forgotten Internet memes, like alt.religion.kibology, Usenet Oracle.

The only downsize is: no external resources is accessible, and nobody is going to reply you. It feels like Otomo Katsuhiro's animation Memories, the protagonists in trapping inside a 3D Hologram simulation of the past, created by the supercomputer in the abandoned space station.