nyuuzyou/wikis huggingface dataset:
Radikal

Radikal.ru was a Russian image and video host; it shut down on . According to its homepage it hosted nearly a billion images and nearly a million videos.
== Grab Project ==
The project got only the images; of the images, it got only those in the public 'gallery' (which, as far as we could tell, excluded 'private' images that could only be discovered from user pages, as well as those that could not be discovered at all except by guessing the URL); and of the images in the public 'gallery', it got only the public thumbnails (filenames suffixed with "t"), not the full images. This was partly to save space and partly to prioritize; in the end, there was no time for subsequent archival rounds of full-size images or non-image data.
The Radikal gallery API could be searched both by start/end date and by start/end ID (with IDs increasing in time but not sequential). Date matching had various problems (date queries did not always seem to pick up on images only a few seconds ahead of them, and creation dates per search were sometimes 4 or 8 hours off from those per metadata), while images were not distributed evenly around the ID space. The project therefore consisted of two item types: idrange, which took a range of image IDs and grabbed their metadata and the thumbnails of the images in that range; and daterange, which took a date/time range and queued a series of idrange items for each 20-minute interval inside that range.
Playback will not work; the main site's interface relied on POST requests, which the Wayback Machine cannot replay and which the project did not capture. Discoverability is also poor, since it is not obvious that a lost full-size image may exist as a thumbnail. However, the archived thumbnails were one of the options Radikal offered for embed code, so they may show up in external sites.
=== Results ===
Near the end Radikal's image servers experienced a bout of instability; to try to get around this, failing thumbnail items would first try to grab the alternate thumbnail, then complete without error even if that failed. The site shut down some time around , or a few hours past midnight on the 10th in Moscow and St. Petersburg. About 15.2% of the tracker items were complete.
RapidShare

RapidShare is a file sharing website, which shut down on March 31, 2015.
== Shutdown notice ==
Notice
Dear RapidShare Customers 
Kindly note that RapidShare will stop the active service on March 31st, 2015. Extensions of STANDARD PLUS and PREMIUM will be possible until February 28th, 2015. 
We strongly recommend all customers to secure their data. After March 31st, 2015 all accounts will no longer be accessible and will be deleted automatically. 
If you have any questions, please do not hesitate to send us an e-mail to support@rapidshare.com
Thank you for many years of trust. 
Your RapidShare Team
== Site structure ==
*https://rapidshare.com/files/251393042/Google_Earth_pro_5.0.1337.rar (redirects to url below which then downloads the file)
**https://rs602p2.rapidshare.com/cgi-bin/rsapi.cgi?sub=download&fileid=251393042&filename=Google_Earth_pro_5.0.1337.rar
=== Discovery ideas ===
*Try scraping rapid-search-engine.com for download links or ask its owners for the database In progress
*Get a list of valid download links from reddit. Done
*Scrape Google with the keyword "intext:rapidshare.com/files".
*Scrape URLs from the Wayback Machine. In progress
*Search in the expanded URLs derived from URLTeam? URLs have been grabbed from the torrent, URLTeam 2 results haven't been searched yet
== Archives ==
Started March 25, 2015, finished March 31, 2015, 186 GB saved.
Rawporter

Rawporter was an image hosting company based in Charlotte, NC that helped photographers sell their photos and videos. Using the free Rawporter app (either on iPhone or Android), users could receive location-based assignments from media partners and bloggers who would pay for the rights to use the photos or videos posted to the Rawporter website (usually the fee was $5-$25 USD.) In addition, users could sell pre-existing media through Rawporter.
== Shutdown notice ==
Updated News
We are pleased to announce Rawporter has entered into an exclusive business
partnership and will be joining a much larger organization. As part of that agreement we will
be shutting down our consumer services.
...
Rawporter will no longer be accepting photo and video submissions.
We will be purging the media files over the next couple of weeks. 
Please make sure to retain your original copies in case you decide to license them directly in the future.
We are very proud of all that has been accomplished and hope you enjoyed using our service. 
Please direct any questions you might have to info@rawporter.com
Sincerely,
Team Rawporter
== Archives ==
Very shortly after announcing that they were closing, Rawporter completely shut down web access to images, videos, user pages, etc. However, their media server on Amazon S3 was still up, so a list of images and videos on the S3 server was retrieved and downloaded.
Two archives of that list are available:
* S3 Rawporter grab 78.8GB (complete, in a tar file)
* Rawporter.com Panic Download 27.8GB compressed (all images, some videos, in a WARC file)
For user pages and media metadata, the Wayback Machine has some pages, but not many.
* https://web.archive.org/web/*/http://www.rawporter.com/*
=== Misc. ===
* Rawporter Facebook Page Panic Download
* Rawporter: How It Works Introduction Video
* Rawporter Demonstration at DEMO Spring 2012
== External Links ==
* @textfiles: I've been tipped off that @rawporter is deleting all videos and photos...
Category:Image hosting
ReactJS

ReactJS is a popular client-side JavaScript-based web app framework. It was first deployed to Instagramhttps://en.wikipedia.org/wiki/React_(JavaScript_library)#History, a site notoriously known to be inconvenient to crawl. Sites using ReactJS are inefficient to archive, since the content is only loaded after the scripts and style sheets rather than immediately on HTML-based sites, and some sites use HTTP POST to load the essential contentExample: https://cafemom.com/, meaning API queries can not be directly submitted to web archives. Sites using ReactJS usually need to be inefficiently rendered through a headless browser or crawled in a web archive format such as WARC or HAR. Machine-readable JSON code returned by API queries can usually be retreived through browsers' web developer tools, but since the code may be oddly formatted, such as on Everipedia with one property per paragraph, it could be necessary to hide junk using regular expressions to make the material consumable for reading.
Recommended Reading

Closer to the top are links to sites directly related to Archive Team projects and Internet preservation, while links towards the bottom are more general. There is also a Newsfeed of articles where people go off on the need to back up your stuff or issues Archive Team likes you to know about.
== Web 2.0 Bubble? ==
It seems like the 2.0 bubble is a bit more resilient than the 1.0 bubble. The name might not be as apt, but the sites could be doomed to suffer the same fate as their forebears due to the recession. These articles are useful because they make a head-count and attempt to survey the situation.
* (Erased in this delete query)
* "The Web 2.0 Bubble" - article at The Atlantic
* "11 troubled Web companies" - article at CNet
* "Web 2.0 bubble bursting" - article at VentureBeat
== A Gentler Way to Say BACK IT UP ==
* The Power to Fight Eviction by Phil Wolff of the Data Portability Project. January 16, 2009.
== Online Archives of Interest ==
* Internet Archive
* The National Archives
* Library of Congress
* Gutenberg Project produces free electronic books.
* Federal Web Harvest archives material from federal government websites and puts them online.
* The CyberCemetery is "an archive of government websites that have ceased operation."
* National Archives of the Netherlands is the official government archive of all kinds of sometimes ancient data, photos, videos, audio recordings etc. .
* Pandora is Australia's web archive.
* The Vatican has an interesting online library.
* Space Rogue maintains a museum of his old websites.
* DeathSpace: a collection of dead Myspace users.
* Search Engine Showdown - Finding Old Web Pages (list several sources for finding archived and cached web pages).
* OldVersion.com is an archive website that stores older versions of primarily Internet-related PC and Macintosh freeware and shareware application software (more info here).
* http://academicpreservationtrust.org/ (APT)
== Books and documents ==
* The Victorian Internet by Tom Standage
* Digital preservation collection at Zenodo
* http://www.digitalpreservation.gov
* https://www.digitisation.eu/
* http://www.digitizationguidelines.gov/
== See also ==
* Films and documentaries about archiving
Category:Archive Team
Recurring Events/Hacker Conferences

For CCC/Chaos events, check Chaos Computer Club#Events.
== Brucon ==
“BruCON is an annual security and hacker(*) conference providing two days of an interesting atmosphere for open discussions of critical infosec issues, privacy, information technology and its cultural/technical implications on society. Organized in Belgium, BruCON offers a high quality line up of speakers, security challenges and interesting workshops. BruCON is a conference by and for the security and hacker(*) community.”https://www.brucon.org/2024/faq/
* https://www.brucon.org
* https://files.brucon.org/
* https://www.youtube.com/@brucontalks
Past instances:
* http://2009.brucon.org/
* http://2010.brucon.org/
* http://2011.brucon.org/
* http://2012.brucon.org/
* http://2013.brucon.org/
* http://2014.brucon.org/
* http://2015.brucon.org/
* http://2016.brucon.org/
* https://2017.brucon.org/
Everything past that gets redirected to https://www.brucon.org/*
Schedules:
* sched.brucon.org (redirects to current schedule)
* https://brucon0x0a.sched.com/ (2018)
* https://brucon0x0b.sched.com/ (2019)
* https://brucon0x0c.sched.com/ (2020; requires login? maybe cancelled due to covid?)
* https://brucon0x0d.sched.com/ (2021)
* https://brucon0x0e.sched.com/ (2022)
* https://brucon0x0f.sched.com/ (2023)
== DEF CON ==
“DEF CON is one of the oldest continuously running hacker conventions around, and also one of the largest.”https://defcon.org/html/links/dc-faq/dc-faq.html
* https://defcon.org/
* https://info.defcon.org/
* https://dctv.defcon.org/
* https://forum.defcon.org/
* https://media.defcon.org
* https://discord.gg/defcon
* https://defcon.social/
* https://twitter.com/defcon
* https://www.facebook.com/defcon
* https://www.youtube.com/user/DEFCONConference
* https://www.instagram.com/wearedefcon/
* http://www.reddit.com/r/defcon
* https://mastodon.social/@DEFCON_TV@infosec.exchange
* https://twitter.com/DEFCON_TV
* https://store.eventcapture.com/collections/def-con
* https://noc.defcon.org/
* https://plus.defcon.org/
* https://shop.defcon.org/
* https://training.defcon.org/
Old event pages are kept below https://defcon.org/*, see https://defcon.org/html/links/dc-archives.html
== Hackers on Planet Earth (HOPE) ==
* https://hope.net/
* https://twitter.com/hopeconf
Past instances:
* https://i.hope.net/
* https://ii.hope.net/
* https://iii.hope.net/
* https://iv.hope.net/
* https://v.hope.net
* https://vi.hope.net/
* https://vii.hope.net/
* https://viii.hope.net/
* https://ix.hope.net/
* https://x.hope.net/
* https://xi.hope.net/
* https://xii.hope.net/
== ShmooCon ==
ShmooCon orga seems to upload their talks to the Internet Archive. They’re linked at the very bottom of the website, see for example here: https://archive.org/details/Shmoocon2018
Their old websites forever don’t seem to get archived, and the current page does not contain information about past events.
* https://www.shmoocon.org/
* https://twitter.com/shmoocon
* https://infosec.exchange/@shmoocon
* https://cfp.shmoocon.org - call for papers
* https://www.youtube.com/@0xdade/ - personal channel, but most uploads are ShmooCon talks
Referata

Referata is a wikifarm for semantic wikis.
For a list of wikis hosted in this wikifarm see: https://github.com/WikiTeam/wikiteam/blob/master/listsofwikis/mediawiki/referata.com
Referata doesn't provide regular dumps, but the owner is kind and happy we dump all their wikis: just update the list of wikis and dump them all every now and then. This farm is fast and easy.
== See also ==
* List of wikifarms
== External links ==
* 
* https://archive.org/search.php?query=referata%20subject%3Awikiteam
Category:Wikis
Regretsy

Regretsy was a website dedicated to highlighting bizarre, weird or offbeat items offered for sale on the handmade and vintage marketplace Etsy. During its run from September 2009 to January 2013, the site posted hundreds of items with snarky commentary, which eventually led to a book deal for the blogger April Winchell. The site also raised thousands of dollars for charity.http://knowyourmeme.com/memes/sites/regretsy
The shutdown of Regretsy was announced on , and the entire site contents were frozen on 2013-02-01. This "archive" appears to have been online until sometime in August 2013, when the site started redirecting to . This redirect was still in place as of . Since at least , the website has been replaced with a coming soon page for an archive of the website.
== Archives ==
The Internet Archive Wayback Machine could not display the archives to due robots.txt in 2014, but as of , they are accessible: https://web.archive.org/web/*/www.regretsy.com.
ArchiveTeam archives are available in WARC format:
* 
* 
No archives for http://cf4l.regretsy.com http://www.urbandictionary.com/define.php?term=CF4L are known to exist currently.
== References ==
Relay.im

Relay.im was a GIF-based mobile messaging service. It was acquired by Kik and shut down on December 15, 2014.
== Shutdown notice ==
We're joining Kik!
Relay was founded on the idea that content and conversation go hand and hand. We chose to focus on the most expressive and emotion-packed kind of content on the Web - the animated GIF. By deeply integrating GIF search and discovery into a mobile messaging app we strived to give people a richer and more visual way of communicating and expressing themselves.
Although a simple idea, GIF messaging resonated with a great number of people. Over the last year more than 700,000 people downloaded Relay and we're currently seeing over 10 million GIF messages sent every month.
Since the beginning of Relay, we were in admiration of a much bigger messaging company that also happened to be our neighbour, only 100km west on the 401. Kik is one of the last remaining independent messaging platforms and with over 185 million users and their innovative mobile platform, Kik is the market leader in content messaging. We're extremely excited to be joining the Kik team to help build new visual content experiences.
The Relay application will be shutting down, allowing us to focus on bringing the best parts of the Relay experience to the more than 185 million users on Kik's platform.
If you're a Relay user, you will be able to continue using the app until December 15th, 2014.
After this time, your messages, collections and all personal information will be permanently erased and you will no longer be able to sign into Relay. We're sad to say goodbye to Relay but stay tuned for great new things to come in Kik.
We'd like to thank our users, our investors and advisors, our friends and families, and our phenomenal team for helping make the Relay vision a reality.
Thank You.
— Jon and Joe, co-founders of Relay
== Site structure ==
Unfortunately, as of November 20, 2014, every single page on Relay's site redirects to the shutdown notice. However, the GIFs themselves have not been deleted and can be directly accessed, providing you have the URL.
*http://relay.im/i/87ltrA (redirects to the shutdown notice)
**http://sli.relay.im/0/J/R/0JRdX4j9ens-large.gif (usually a GIF, sometimes a JPEG)
***http://i.relay.im/images/0/J/R/0JRdX4j9ens-large.gif (redirects to the gif on sli.relay.im)
=== Crawls ===
*GIFs/JPEGs crawled through Google Cache
== Archives ==
*ArchiveBot saved 115.3 MB of Relay.im. The archives are available here. (look for items named "urls-paste.archivingyoursh.it-kukaxifore-shallow-20141129-201640-7pl27")
Category:Image hosting
Remix 3D

Remix 3D was a Microsoft website to share 3D Objects. It was shut down on 2020-01-10.
== Archival ==
Archived with chromebot recursively from the homepage in job bajov-hapad-pafis-havun. This data was once accessible through the Wayback Machine (homepage here), though playback of the main interface did not work correctly due to JavaScript. Since Chromebot's WARC files were removed from the Wayback Machine, the only way to access their contents is now directly.
User:Kyndigs partially saved a few of the largest users, including Microsoft's content, which was the largest contributor, archive located here: https://archive.org/details/remix3d.com_20191220000000
Rescuing optical media

Rescuing optical media can be difficult, due to the many incompatible formats and copy protections that were used. CDs are difficult to image at low-level because most drives do not give access to the raw data.
The following is a table of some available disc dumping tools.
== Software ==
Software 	Supported media 	Development status 	License 	Platforms supported	Drives supported 	Output format 	Latest Version	Website	Notes
Exact Audio Copy 	Audio CD 	Actively developed 	Proprietary	Microsoft Windows 	Most 	wav/flac + cue 	1.0 beta 3 	 	
X Lossless Decoder	Audio CD 	Actively developed 	GPL 	Mac OS X 	Most 	wav/flac + cue 	20130407 	 	
Morituri 	Audio CD 	Unmaintained 	GPL 	Linux 	Most 	wav/flac + cue 	0.2.3 	 	
whipper 	Audio CD 	Actively maintained	GPL 	Linux 	Most 	wav/flac + cue 	0.9.0 	 	fork of Morituri
RawDump 	GC/Wii Optical Disc 	Unmaintained 	Proprietary	Windows 	Certain Hitachi/LG 	"ISO" 	2.1 	 	
FriiDump 	GC/Wii Optical Disc 	Unmaintained 	GPL 	Windows and Linux 	Certain Hitachi/LG 	"ISO" 	0.5.3 	 	Includes documentation on dumping method
cdrdao 	CD-ROM 	Actively maintained	GPL 	Linux and Mac OS X 	Most 	cue/bin 	1.2.3 	 	Does not properly rip CDs with nonstandard data
Trurip 	CD-ROM 	Unknown 	Unreleased 	Windows 	Certain Plextor 	ccd/sub/img 	Unknown 	 	Supposedly supports SafeDisc and other forms of copy protection
DiscImageCreator 	CD-ROM, GD-ROM, DVD-ROM, others	Actively maintained	Apache 	Windows and Linux 	Certain Plextor/others	cue / multiple bin	20191116 	 	Believed to produce identical output as TruRip for most discs
Tools of the trade has a list of other tools for disc dumping.
Redump.org has assembled a guide for disc dumping, available at http://redump.org/guide/.
== Linux ==
* In most cases you can just create an ISO image with k3b.
* Using ddrescue (ddrescue -b 2048 -n /dev/sr0 image.iso image.log and so on) you can make an exact copy of any DVD/CD; intentionally corrupt sectors will just be replaced by zeros. You then need to remove encryption (including region protection) with dvdbackup. 
* Some people report good results with k9copy, not available in all repositories.
* See also this blog post which covers the preservation of CD-ROMs and DVDs using the readom, ddrescue and cdrdao tools, and audio CDs using cdparanoia.
* The omimgr tool is a simple GUI-based tool for recovering data from CD-ROMs and DVDs. It wraps around readom and ddrescue.
Category:Tools
Category:Physical media
ResearchGate

ResearchGate is a social network that allows researchers to upload and share publications. An account is required to request full-text of a publication, however if it's already been made publicly available it can be downloaded without making an account. Authors can remove publications after uploading them.https://explore.researchgate.net/display/support/How+to+make+content+private+or+remove+it
Each publication appears to be given a numerical ID.
== References ==
== External Links ==
* https://explore.researchgate.net/
* https://github.com/jaumebonet/RGcrawler
* https://github.com/kaleguy/scraper-api
* https://github.com/Ze1598/Scrape-Academic-Social-Networks
Resedagboken

The owners of Resedagboken.se (the Schibsted media mogul corporation) sent out a press release on the 7th of May 2012 [1], announcing the closing of Resedagboken.se citing dwindling profitability.
User registration has been closed and the site is going to be up to the 15th of June - unsure if it'll close after that. The press released mentioned it being up and in a read-write state for members to finish their journey diaries. It is still online as of the 1st of May, 2013.
== What's Resedagboken.se? ==
Resedagboken.se is a Swedish site where you can have a diary for your journeys. A user can have several diaries, with several posts in each diary.
The site is mostly in Swedish, but there seem to be some English crapversion available as well. Most/all of the user content is in Swedish.
Similar international sites; Travelpod.com, Travelblog.org, Tripbirds.com Gogobot.com
== Archival notes ==
Using a test user~
Member page: http://www.resdagboken.se/m/JockeOchCicci
On the member page there is;
user metadata to the left in a box, fields like username, gender, age, current journey, home region, how many travels, how many posts, how many visited places and such
a 'latest journeys' box which lists a few journeys, with a link to "All journeys" at the bottom
a 'latest pictures gallery' box, which has a "All images" link at the bottom of the box
a 'latest posts' box, which has a link to "All posts" at the bottom of the box
a map showing all places the user have tagged(?)
a 'latest logged in friends' box with links to the users
There's also a forum section and an article section of the site
== Links ==
News article in Schibsted-owned newspaper about the closure (Swedish)
Press release on Resedagboken.se (Swedish)
Retrospring

Retrospring is a question-and-answer site and an alternative to Formspring. Closed on . Relaunched shortly on . Finally closed again on . They seem to have opened back up on . And will close again at .
== 2015 closure ==
Closure was announced on on Twitter:
Due to personal problems and general burnout of the project leaders, Retrospring will shut down on 1st April (in 4 days)
Also, before you think it is:
No, it's not an april fools joke. (Bad chosen date, of course, but better at the beginning of the month and
announced instead of putting the site off suddenly without notice)
If you want to get all data associated with your user account, send an email using the email address that's associated with your (c)
(c) Retrospring account to nilsding@retrospring.net and wait a little while
Also, regarding the Patreon page, we already sent a deletion request for the page, but they seem to take a while.
If you want to get sure not to pledge more out of accident, please cancel your patronship!
== 2015 relaunch ==
Somehow, the site went back mere 18 days after the announced shutdown.
 
Retrospring is back, and now entirely open to developer contributions, help us improving and fixing the service!
https://github.com/Retrospring/retrospring
"Why I decided to open up Retrospring again": https://web.archive.org/web/20190808015037/https://medium.com/@pixeldesu/why-i-decided-to-open-up-retrospring-again-f6b6e2bfdc11
Apparently, they "can guarantee" Retrospring won't go down again.
== 2016 closure ==
Retrospring closed again, this time for good, on . This happened without an ArchiveTeam member noticing, so no action was done.
== 2017 relaunch ==
Retrospring reopened again on .
== 2025 closure ==
The 2025 closure was announced in a blog post on :
After about ten years of providing a social Q/A experience to you, it is with a heavy heart that we announce the closure of https://retrospring.net services on the 1st of March 2025.
== References ==