nyuuzyou/wikis huggingface dataset:
MediaCrush

MediaCrush was a media hosting service. The website accepted many types of files, including images, video, and audio. MediaCrush also converted GIFs into MP4s, resulting in smaller files and thus faster load times.http://web.archive.org/web/20140209122303/https://mediacru.sh/about
On January 28th, 2015, MediaCrush announced it was shutting down and would no longer accept uploads.http://web.archive.org/web/20150130040753/https://mediacru.sh/
== Shutdown notice ==
Published January 28th, 2015
MediaCrush is being shut down today. Before I tell you why, I want to clarify a few things:
* All content uploaded prior to today remains available
* The open source project is still alive and well
It's been a year and a half and we've come to the point where we can no longer continue this project. We have reached our storage capacity, and our ad revenue and donations are lower than ever. We cannot justify expanding our infrastructure and costs to continue losing money on this project. I'm extremely grateful to the folks who have been here for us, but it's time for us to move on to other things.
We will answer your questions on Twitter @mediacru_sh, and at our personal accounts @sircmpwn and @jdiezlopez. You can also participate in the relevant thread on /r/MediaCrush. Personally, we're going to switch to img.bi and pomf.se for our needs. You can find more alternatives to MediaCrush at Prism Break. Your upload history (if you enabled it) is still available here.
Thanks for your support, everyone.
Drew DeVault and Jose Diez, the MediaCrush founders
26,726,597 page views
11,100,380 users served
375,595 files uploaded
12,245 albums created
50 PB bandwidth used
2 exhausted founders
== Archiving ==
There was no official gallery or list of files, making archiving very difficult. Additionally, one of the founders had said that the content "won't stay up for a very long time".http://www.reddit.com/r/MediaCrush/comments/2tzuv0/mediacrush_is_shutting_down/co3va4e
Both co-founders dropped by #mediacrushed and an archiving plan was worked up. All of the content on MediaCrush was uploaded to archive.org. Additionally, Imgrush, a MediaCrush-based website, has imported the backups and is hosting the data on their website.https://www.reddit.com/r/MediaCrush/comments/2yb66y/access_your_mediacrush_files_on_imgrush/
== References ==
== External Links ==
* MediaCrush source code
* MediaCrush /transparency folder (includes financial statements and analytics)
* MediaCrush subreddit
* On the profitability of image hosting websites by Drew DeVault
Category:Image hosting
MediaFire

Mediafire is a file hosting service with file synchronisation features. It launched around June 2006.
On , users reported that they began receiving emails from MediaFire how they plan to classify accounts as abandoned if they fail to meet certain criteria, starting in January. This policy, however, had been in effect for many years prior, as later confirmed by MediaFire.
== Projects ==
* URL Submission Site: URLs submitted will be periodically added to the archiving queue. - as of 
* Anybody can queue items that are lower than 100 GiB in
Medium

Medium.com is a blogging website for people who'd like a Wordpress.com with more whitespace, less features, more barriers to access, more surveillance and more gambling their future.
As a VC-backed startup with no profitability in sight, it's likely to disappear suddenly and therefore it merits a permanent Deathwatch.
==Timeline==
Nieman Lab has compiled a very helpful timeline of Medium catastrophes (or "pivots", if you prefer VC terminology): https://www.poynter.org/tech-tools/2017/with-big-plans-to-staff-up-thinkprogress-is-leaving-medium-behind-update/
In March 2021, Medium leadership suggested that employees working for Medium publications take a "voluntary exit option" due an upcoming shift away from the publication model and towards a focus on individual writers.https://ev.medium.com/medium-editorial-team-update-8679bcb9fe81 As of 2021, Medium had 11 active publications: Human Parts, OneZero, Elemental, Forge, Gen, Marker, Modus, Heated, Zora, Level, and The Bold Italic.https://medium.com/active-publications/medium-owned-publications-631c665662ea
==Archival==
Medium is a walled garden, notoriously hostile to an open web, at times more than Quora. However, as of 2017 it was possible for the authors to export the content in a ZIP file and import it in a Wordpress site on Wordpress.com.
Websites run on Medium have also presented issues with archival even after abandoning it, see for instance ThinkProgress.
An increasing number of blogs and websites have relied on Medium as a backyard or garage sale site where to put articles too fancy for their usual social media channels but not serious enough for their main website. Therefore, despite not being clearly linked to or from a large part of the web, it can bring down with it a significant portion of history for other web properties.
=== URL discovery ===
https://medium.com/robots.txt links a standard https://medium.com/sitemap/sitemap.xml which provides lists of users (example), posts (example), lists (example).
=== Alternative frontends ===
Scribe and Freedium are alternative frontends to Medium that work without JavaScript. Some URLs on the web may link to them instead of the official Medium URLs.
==See also==
*Scribd
*Issuu
*Docplayer
*Blogger
Mega

Mega is a cloud storage and file hosting website, created by MegaUpload founder Kim Dotcom.
== Vital signs ==
From a Q&A session on Slashdot with Kim Dotcom:http://yro.slashdot.org/story/15/07/27/200204/interviews-kim-dotcom-answers-your-questions
Mega Technique
by Anonymous Coward
I've seen some criticism from open source advocates and hackers that Mega can't be trusted because the source isn't available.What assurance could you give someone to the point that their files may not be kept secret while hosted on your platform?
Dotcom: I'm not involved in Mega anymore. Neither in a managing nor in a shareholder capacity. The company has suffered from a hostile takeover by a Chinese investor who is wanted in China for fraud. He used a number of straw-men and businesses to accumulate more and more Mega shares. Recently his shares have been seized by the NZ government. Which means the NZ government is in control. In addition Hollywood has seized all the Megashares in the family trust that was setup for my children. As a result of this and a number of other confidential issues I don't trust Mega anymore. I don't think your data is safe on Mega anymore. But my non-compete clause is running out at the end of the year and I will create a Mega competitor that is completely open source and non-profit, similar to the Wikipedia model. I want to give everyone free, unlimited and encrypted cloud storage with the help of donations from the community to keep things going.
Additionally, Mega uses in-browser JavaScript encryption to hide file contents from the hosting server, which makes automated archiving extremely difficult. As of April 2015, any type of archiving has to done either manually or through Mega's API.
=== Items ===
* TODO: Scrape Google
* TODO: Scrape Bing
* TODO: Scrape DuckDuckGo
* TODO: Scrape Twitter
* TODO: Scrape Reddit
* TODO: Scrape links from MediaWiki wikis
* TODO: Scrape the Wayback Machine
* TODO: Scrape URLTeam dumps
== References ==
== External links ==
* Mega SDK documentation
* Mega Limited on GitHub
MegaSWF

MegaSWF was a media file hoster that started off as ShockWave Flash (swf file) hoster, similar to Newgrounds years earlier.
MegaSWF was a big repository of amateur-made minigames, fangames and flash files that Newgrounds does not have. Like on Newgrounds, SWF files could be played back (previewed) on the site and downloaded. MegaSWF later turned into an universal file host (also used for EXE, AVI, WMV, MP4), but still focussed on SWF minigames.
For a fee of $5 per month, they also offered a high-bandwidth “cloud hosting” plan which could be used by webmasters to embed content on their website.MegaSWF.com Wayback crawl of 2014-06-03 06:34:07MegaSWF.com/upgrade Wayback crawl of 2014-06-25 05:53:55
MegaSWF escaped the radar of ArchiveTeam entirely and perished in silence.2 attempts to sell the domain “megaswf.com” on Flippa.com: 110674 3854759
The website went down at some timepoint after February 8th 2015 before July 28th 2015.
== Archival ==
[[File:MegaSWF-20080726100435.png|thumb|right|First Wayback capture of MegaSWF.com's homepage at 2008/07/26 on 10h:04m:35s.]]
MegaSWF is partially but incompletely available on the Wayback Machine.
== References ==
*
MegaUpload

MegaUpload was a free file sharing website that allowed people to share files with one another. It was shutdown on 19th January 2012 due to copyright issues, and possibly a result of SOPA takedown. All files were lost in the blink of an eye, without any notices and stuff.
The Internet Archive does not have the site archived on the Wayback Machine due to robots.txt of MegaUpload, preventing the archiving of that website. Don't you hate robots.txt?
As of July 2013, the server showing the takedown notice is offline, thus whatever the Wayback Machine archived is currently available. Unfortunately, it's pretty useless mostly because of the good old MegaDownloadLimits. A list of some (mostly non-existent) files is available here.
A tribute:
* http://www.youtube.com/watch?v=o0Wvn-9BXVc
== See also ==
* Mega, the JavaScripty successor to MegaUpload
Megalodon.jp

Megalodon.jp is a Japanese archiving website. Outside of Japanese users, reddit users use it sometimes. In the past the /u/ttumblrbots and /u/snapshillbot bots supported the site and was behind a lot of the Megalodon.jp usage on reddit.
Unlike the Wayback Machine and archive.is--both use UTC +0 timestamps--megalodon.jp snapshots are timestamped in Japan Standard Time (JST), which is UTC +9.https://megalodon.jp/2022-0202-0859-06/https://time.is:443/JST
==Limitations==
As of 2022-01-23 UTC, megalodon.jp is able to save files which are less than 20 megabytes.* https://web.archive.org/web/20201108004046if_/https://files.catbox.moe/01q538.webm (20 MB) → https://megalodon.jp/?url=https%3A%2F%2Fweb.archive.org%2Fweb%2F20201108004046if_%2Fhttps%3A%2F%2Ffiles.catbox.moe%2F01q538.webm → https://megalodon.jp/pc/get_simple/decide → "エラー [\n\n] 取得対象のサイズが大きすぎます。" = "error [\n\n] The size to be acquired is too large."* https://web.archive.org/web/20201109012605if_/https://files.catbox.moe/0g3ql5.webm (19 MB) → https://megalodon.jp/?url=https%3A%2F%2Fweb.archive.org%2Fweb%2F20201109012605if_%2Fhttps%3A%2F%2Ffiles.catbox.moe%2F0g3ql5.webm → https://megalodon.jp/2022-0123-1624-17/https://web.archive.org:443/web/20201109012605if_/https://files.catbox.moe/0g3ql5.webm (short link: https://gyo.tc/1T5kv)
As of 2022-03-14 UTC, megalodon.jp only allows 60 URLs to be saved per 24 hours per IP address.https://megalodon.jp/?url=https%3A%2F%2Ftranslate.google.com%2F%3Fhl%3Dru%26tab%3DTT → https://megalodon.jp/pc/get_simple/decide → "同一のIPからの連続取得は制限されています。 [\n] 同一のIPから24時間に60回以上の取得は出来ません。" = "Continuous acquisition from the same IP is restricted. [\n] You cannot get more than 60 times in 24 hours from the same IP."
==References==
==External links==
* Guide to using Megalodon.jp - video tutorial
* reddit threads based on Megalodon.jp links
Memory of Mankind

Memory of Mankind is a project funded in 2012 by Martin Kunze. The main goal is to preserve the knowledge about our present civilization from oblivion and collective amnesia. Information is printed on ceramic tablets, then stored in the salt mine of Hallstatt, Austria. More than a simple archive project, it aims to create the "Time capsule of our era", letting people participate by allowing them to submit texts and images. In contrast to national archives, content for MOM is collected by anyone who takes part. It is a collective, "bottom-up" told history. 
== Archive ==
* https://www.memory-of-mankind.com/ - 
== See also ==
* Knowledge preservation initiatives
== External links ==
* 
* 
* https://www.facebook.com/MomMemoryOfMankind
Category:Knowledge preservation initiatives
Memory of the World Programme

Memory of the World Programme is an international initiative launched by UNESCO to safeguard the documentary heritage of humanity against collective amnesia, neglect, the ravages of time and climatic conditions, and willful and deliberate destruction. It calls for the preservation of valuable archival holdings, library collections and private individual compendia all over the world for posterity, the reconstitution of dispersed or displaced documentary heritage, and the increased accessibility to and dissemination of these items. 
== See also ==
* Knowledge preservation initiatives
== External links ==
* 
* 
Category:Knowledge preservation initiatives
Mercurial

Mercurial, also known by its command line tool hg, is a distributed version control system. Its development started at almost the same time and with similar goals as Git.
== Archival ==
When Bitbucket announced its deprecation and removal of Mercurial repositories, a reusable archive project was created that can archive Mercurial repositories in general. It simulates hg clone --stream URL. The resulting archives can be cloned again directly from the Wayback Machine, e.g. hg clone --stream https://web.archive.org/web/2id_/https://bitbucket.org/pygame/pygame.
== Repo cloning ==
From the hg docs:
In normal clone mode, the remote normalizes repository data into a common exchange format and the receiving end translates this data into its local storage format. --stream activates a different clone mode that essentially copies repository files from the remote with minimal data processing. This significantly reduces the CPU cost of a clone both remotely and locally. However, it often increases the transferred data size by 30-40%. This can result in substantially faster clones where I/O throughput is plentiful, especially for larger repositories. A side-effect of --stream clones is that storage settings and requirements on the remote are applied locally: a modern client may inherit legacy or inefficient storage used by the remote or a legacy Mercurial client may not be able to clone from a modern Mercurial remote.
hg clone produces a directory with a working copy, plus the .hg directory containing version control data. However, this is internally sent as a bundle, which if captured can be unbundled normally. 
hg network protocols (as of September 2020):
* streamclone.py
* statichttprepo.py
* wireprotocol.txt
Metadata warriors

"Metadata, you see, is really a love note – it might be to yourself, but in fact it’s a love note to the person after you, or the machine after you, where you’ve saved someone that amount of time to find something by telling them what this thing is. Lives have been absorbed getting metadata, and so there’s an entire field of computer study about this idea, and making your machines do the hard work for you. Google’s got some interest in this, I heard. If you could completely generate Metadata, life would be pretty awesome. But you can’t. Not really. Not completely.
"So, it basically comes down to me asking you, if the idea interests you, to sign up to be a metadata warrior, someone who will work with me to describe these items. I’ll help you find something personally interesting – some people really dig reading old computer manuals, others care about arcade stuff, and I’m sure there’s even more in what I’m adding to keep your attention up. I’m not asking you to do everything – even if you add a handful of stuff, that’s more than was there a week previous – and that’s helping."''
Welcome, Metadata Warriors!
This page is a central assignment and offer spot to do metadata entries for a number of interesting sets of items uploaded to archive.org. By taking possession of what interests you and adding descriptions, you can help make the world a better place, and begin the process of having these items become immortal. It's meaningful, and it's fun! 
The basic approach is:
* Choose one of the below projects
* Edit this page to indicate you wish you do the work
* Create a textfile with the URL of the items, and your description 
** (See this set or this set for examples.)
* Add as much or as little detail as you're comfortable doing - certainly the table of contents would be good, as well as any other information about the date, publisher, etc.
* Send this finished textfile to metadata@textfiles.com
* Your textfile will be integrated into the descriptions, and you will receive credit.
Current Assignments
Please place your name next to any sets that interest you. (Doing a portion of a range and then finishing there is OK.)
* Acorn Programs Magazine (5 Issues) I just finished and sent the email off for this one --BlueMax 00:39, 17 August 2012 (EDT)
* Analog Computing Magazine (79 Issues)
* Amtix Magazine (17 Issues)
* Computer Monthly Magazine (22 Issues)
* Micro 6502 Journal (76 Issues)
* Micro Adventurer Magazine (17 Issues)
* Your Spectrum Magazine (21 Issues)
* ZX Computing Magazine (40 Issues)
* Zzap64 Magazine (108 Issue)
Many more are coming.. check back often!
Michael S. Hart

Michael Stern Hart (March 8, 1947 – September 6, 2011) was an American author best known as the founder of Project Gutenberg, a project to make electronic books freely available via the Internet.
== Bios ==
* 
* Obituary at PG: http://www.gutenberg.org/wiki/Michael_S._Hart
== Websites ==
* http://pglaf.org/hart/
== Projects ==
* Project Gutenberg
* RepRap Project
== Works ==
* The History and Philosophy of Project Gutenberg
* The Project Gutenberg Mission Statement
* A Brief History of the Internet
* 
== Images ==
== Other ==
* 
Hart
Microsoft

thumbnail|right|300px|Microsoft is most famous for Windows, the world's most widely used operating system
Microsoft is an American multinational corporation that develops, manufactures, licenses and supports a wide range of products and services related to computing.
==FTP Server==
Microsoft has a large FTP server at ftp.microsoft.com which contains a large amount of old files (quite a few are from the 90's) and hasn't been updated in a while. It has gone down a few times and might be worth archiving.
===Microsoft Research FTP===
Microsoft Research also has their own ftp. Has a hidden directory, ftp.research.microsoft.com/downloads.
==Microsoft source code==
Internal repositories for proprietary source code at Microsoft have been subject to several claimed leaks.
*2004: Windows 2000 and NT 4 source code
*2017: Windows 10 source code 
*2020: Windows XP, Windows Server 2003, Xbox, Windows NT 3.5, Xbox Series X graphics source code
*2022: Bing and Cortana source code (bfcfbc5e631a309271c8773bd6781c1bd63b4387, 9500 MiB)
==Miscellaneous Dumps==
nickname's MSDN SHA-1 hash dump: http://0bin.net/paste/uo23scXEp6mPTWZM#-YUP2vlYfsqhpXmv1eNL4pX09SQdZoSySO21Gbw1iqE
Category:Microsoft
Category:Corporations
Microsoft Developer Network

Microsoft Developer Network (MSDN) is/was Microsoft's platform for developers, featuring a Library (documentation), Forums, Blogs, and a Gallery (community-contributed code samples). It was originally launched in 1992 (first on quarterly CD releases). Since 2015, Microsoft has been working on replacing it and TechNet with the new Microsoft Docs platform.
== Components ==
* Library: official technical documentation for Microsoft products (Windows, Visual Studio, etc.). The Library content was migrated into Docs in 2019 and is redirecting to there since January 2020.
* Forums: discussion platform with millions of threads. It is planned to replace this with Microsoft Q&A in mid-2020. Content will not be migrated, but the old forums will remain online in read-only form.
* Blogs: blogs related to particular products or by certain employees. The blogs were "archived" in July 2019 and are available at as of July 2020.
* Gallery (aka Code Gallery): code samples by the community. It was replaced by the in November 2019. Old content was apparently not migrated, but "the most actively engaged code samples" were placed in git repositories under the GitHub organisation.
* Channel 9: video channels, podcasts, interviews, etc. Partially migrated to Microsoft Learn.
== References ==
Category:Microsoft
Microsoft Download Center

The Microsoft Download Center is one of Microsoft's platforms to distribute software and patches. Announcements of changes and various removals can be found .
== 2020 removal of SHA-1-signed content ==
On 2020-07-28, Microsoft published the following announcement:
SHA-1 Windows content to be retired August 3, 2020
To support evolving industry security standards, and continue to keep you protected and productive, Microsoft will retire content that is Windows-signed for Secure Hash Algorithm 1 (SHA-1) from the Microsoft Download Center on August 3, 2020. This is the next step in our continued efforts to adopt Secure Hash Algorithm 2 (SHA-2), which better meets modern security requirements and offers added protections from common attack vectors.
SHA-1 is a legacy cryptographic hash that many in the security community believe is no longer secure. Using the SHA-1 hashing algorithm in digital certificates could allow an attacker to spoof content, perform phishing attacks, or perform man-in-the-middle attacks.
Microsoft no longer uses SHA-1 to authenticate Windows operating system updates due to security concerns associated with the algorithm, and has provided the appropriate updates to move customers to SHA-2 as previously announced. Accordingly, beginning in August 2019, devices without SHA-2 support have not received Windows updates. If you are still reliant upon SHA-1, we recommend that you move to a currently supported version of Windows and to stronger alternatives, such as SHA-2.
This announcement was hidden away in their community forums and only made less than a week before the removal. Notably, no notice was shown anywhere in the Download Center itself.
=== Archival ===
There does not appear to be any way to determine whether a particular file is affected without downloading and analysing it. Therefore, we decided to simply archive everything on the MDC. User:JustAnotherArchivist retrieved all info and download pages with qwarc (). The actual files were retrieved in the microsoft-download-center DPoS project () and partially by mgrandi (). Or1dow6 created an index of the former at .
A continuous archival of new files is planned by User:JustAnotherArchivist but not yet operational.
== References ==