nyuuzyou/wikis huggingface dataset:
Ficlets

From the site: "Tiny fictional snippets that tell a short story. Each author adds to the larger narrative." Ficlets was shut down on January 15, 2009, however, the site http://ficly.com was launched in order to provide the same service.
An archive of the site's content was reuploaded to the ficlets memorial site by the original creator, Kevin Lawver. Despite what he said in the quote, it appeared to include the stories marked as mature as well. The memorial site was thrown into the ArchiveBot on 2017/05/21.
== Backup Tools ==
* Wget
Also of note:
 
Comment from the creator of Ficlets (2008/12/03) I've already written an exporter and have all the stories (the ones not marked "mature" anyway). I have pretty much all of the author bios too. Since I was smart enough to insist that AOL license all the content under Creative Commons, I'll be launching a "ficlets graveyard" on 1/16 so at least the stories that people worked so hard one will live on. This guy might be worth contacting
== Vital Signs ==
Dead.
== Who's Working On It? ==
Lore is grabbing it.
Joseph is grabbing it.
FileHorst

FileHorst was a file hosting service founded by the operators of the image hosting service Abload in the year 2014. It shut down at the end of June 2024.
The name of the site is a portmanteau of "file host" and the German first name "Horst". 
== Shutdown ==
The site ran stable until September 2023, when the operators deactivated the uploading of new files due to financial difficulties. On April 21th, 2024, the site announced that it will be shutting down on June 30th, 2024. In the blog post, the operators said they decided against selling the site because "the risk of a wrong development seems too great."Blog - filehorst.de (2024-04-23)
== References ==
Category:Excluded from the Wayback Machine
FileTrip

FileTrip was a file sharing website specialised in homebrew ROMs and related material. It shut down on 2019-03-31.
== Archival ==
FileTrip was archived in a series of ArchiveBot jobs:
* The site except for the actual downloads: 
* The downloads from s#.filetrip.net that were ignored in that job:
** Everything except MP4s: 
** MP4s: 
* Download links under filetrip.net/.../dl-:
** 
** 
** 
** 
* Redirect targets from the /dl- jobs:
** Some of these URLs redirected to files under filetrip.net/f/, and due to the --no-parent wpull flag used in ArchiveBot, the redirect wasn't followed, so they had to be retrieved separately.
** 
** 
** 
** 
** 
** 
** 
** 
** 
** 
** 
The entire site including all downloads is available in the Wayback Machine. Start browsing the site here.
Fileplanet

In 2012 FilePlanet announced it was no longer hosting new content, and "is in the process of being archived [by IGN]."
FilePlanet hosted tens of thousands of game-related files (demos, patches, mods, promo stuff, etc.). These tend to be larger files, ranging from 10MB patches to 3GB clients.
===The archival===
After first downloading files by iterating IDs on the public website fileplanet.com and upload those in chunks to archive.org as well as scouting the web for other public URLs, we got FTP access to the storage servers by the staff. Thanks!
https://archive.org/details/archiveteam-fileplanet is the collection.
Unpacked and sorted it amounts to about ~120k files at ~10TB. The "ftp2" files (another ~300k files at a total of ~1.2TB) cannot be shared publically since there are private files mixed in, we saved them to IA anyways so maybe in the future we can sort them out. If you are looking for files from Fileplanet that are not included in the public archives, contact User:Schbirid with archived URLs that prove their previous availability to the public, e.g. via archived fileplanet.com pages.
File:Fileplanet ftp structure.png|FTP structure
File:Fileplanet ftp restructured File Size Statistics.png|Size statistics
File:Fileplanet ftp restructured File Age.png|Age statistics
File:Fileplanet ftp restructured File Type Statistics.png|File type statistics
File:Fileplanet ftp restructured Largest Files.png|Largest files
There is a half-assed search interface available at https://www.quaddicted.com/stuff/fileplanet/fileplanet.php?filename=yourfilenamehere and a directory browser at https://www.quaddicted.com/stuff/fileplanet/fileplanet.php?directory=/some/dir/here/
===Related items===
* /fileinfo/ pages and the embedded images/thumbnails from the grab by IDs: https://archive.org/details/FileplanetFiles_fileinfo_pages_images
* /download/ pages and download logs from the grab by IDs: https://archive.org/details/Fileplanet_index.htmls_and_logs_scraped_by_id
* http://blog.fileplanet.com: https://archive.org/details/FileplanetBlogFileplanetCom
* http://www.fileplanet.com/fileblog/archives/: https://archive.org/details/FileplanetFileblog
Fileplanet/uploadingfilestoia

Brainstorming on how we can upload the files to IA items.
Remember not to upload the ftp2 stuff publically!
x-archive-meta-title: "Fileplanet_Path_with_underscores". Without the ftp1/2/3 bit, so eg "ftp1/102011/Yes_Man_Dynamic_Theme.7z" would become the item "102011_Yes_Man_Dynamic_Theme.7z", "ftp1/fpnew/patches/prorally2001_v11.exe" would be "fpnew_patches_prorally2001_v11.exe". This might need some care about special characters that IA does not support for item names.
x-archive-meta-description: For now just put the path there. So basically the item name but with special characters intact. TODO later is to add the real metadata we got, shaqfu has a sqlite db with it, otherwise use the fileinfo item: http://archive.org/details/FileplanetFiles_fileinfo_pages_images
x-archive-meta-date: Not sure what format it supports, but this should be the file's original timestamp.
x-archive-meta-year: See above.
x-archive-meta-subject: gaming;software;gaming software;fileplanet;gamespy;ign;planetnetwork
x-archive-meta-collection:archiveteam-fileplanet no idea if this would work with s3 upload
x-archive-meta-mediatype:software (not always correct, maybe check for filename extensions like avi, mov, mp4 etc to set it to movies for those)
Remember not to upload the ftp2 stuff publically!
 #!/bin/bash
 
 # traverse through subdirectories, generate metadata
 # supply eg ftp1/102009/ as argument, it will then upload that directory
 
 parentdirectory=$(dirname $1) # NO trailing slash!
 subdirectory=$(basename $1)
 echo "is ${parentdirectory}/${subdirectory} the directory you want to upload?"
 read
 
 commonheaders='--add-header x-archive-auto-make-bucket:1 --add-header x-archive-meta-noindex:true --add-header "x-archive-meta-subject: gaming;software;fileplanet;gamespy;ign;planetnetwork" --add-header "x-archive-meta-collection:archiveteam-fileplanet" --add-header "x-archive-meta-mediatype:software"' 
 # mediatype:software is not always correct, maybe check for filename extensions like avi, mov, mp4 etc to set it to movies for those?)
 ## nah, underscor said software :)
 
 tempfile="/tmp/fileplanet_ListOfFiles"
 
 echo "Generating a list of files to upload"
 find ${parentdirectory}/${subdirectory} -type f > ${tempfile}
 
 while read file
 do
 	file=$(echo ${file}| sed "s/\.\///") # remove ./
 	echo "Now uploading ${file}"
 	
 	datetime=$(ls -l --time-style=long-iso "${file}" | awk '{print $6" "$7}')
 	year=$(echo ${datetime} | grep -Eo '[0-9]{4}')
 	
 	date="--add-header x-archive-meta-date:\"${datetime}\""
 	year="--add-header x-archive-meta-year:${year}"
 	
 	filename=$(basename "${file}")
 	title="--add-header x-archive-meta-title:\"Fileplanet Archive: ${filename}\""
 	desc="--add-header x-archive-meta-description:\"${filename}, mirrored from its original location in ${file}\""
 	
 	# from famicoman
 	# IA supports alphanum and _-.
 	itemname=$(echo "Fileplanet_${file}" | tr ' ' '_' | tr -d '[{}(),\!:?~@#$%^&*+=;<>|]' | tr -d "\'" | sed 's/\//_/g')
 	
 	echo "s3cmd ${commonheaders} ${date} ${year} ${title} ${desc} put \"${file}\" s3://${itemname}"
 	echo "#################"
 	
 done < ${tempfile}
 
 rm ${tempfile}
FilmMusic.io

FilmMusic.io is a music-centered social media platform based in Germany. It was likely founded in 2019.https://filmmusic.io/ page footer It is similar to SoundCloud in functionality, however all music is licensed under Creative Commons BY-SA 4.0 and people who wish to publish music have to be approved first, presumably to create a barrier of required quality.Standard License - FilmMusic.iofilmmusic.io/faq 
Similarly to SonudCloud, users can follow other users, rate tracks, and post comments.
== Status ==
As of 2023, there are no signs of the site shutting down anytime soon, however, it is excluded from the Wayback Machine. Given that the site contains freely licensed music and no unethical or illegal content, the exclusion was presumably manually requested by the site operators.
In mid-2023, YouTube erroneously temporarily blacklisted FilmMusic.io as a spam site and took down videos containing a URL to the site in their description.YouTube case - filmmusic.io As of late 2023, the issue appears to have been resolved, given that videos containing FilmMusic.io appear in search results again.filmmusic.io - YouTube (search results)
== References ==
Category:Audio Category:Excluded from the Wayback Machine
Finding subdomains

There are several ways to attempt to find subdomains for a given domain.
# The methods listed on Site exploration
# Use Merklemap: https://www.merklemap.com/ (CLI, gratis API)
# Use SecurityTrail: https://securitytrails.com/ (subdomains requires auth, bugmenot has working logins) (Cloudflare JS)
## Browser console based API scraper: securitytrails-domain-scraper.js (useful when there is more than one page)
# Use Subdomain Finder: https://subdomainfinder.c99.nl/ Paid API also available.
# Use Subdomain Center: https://www.subdomain.center/
# Use DNSdumpster: https://dnsdumpster.com/
# Search Chrome User Experience Report origin lists, which contain domains collected using telemetry in the Chrome browser. See https://archive.org/details/crux_origin_list
# Use Cisco Umbrella (OpenDNS) top domains lists: http://s3-us-west-1.amazonaws.com/umbrella-static/index.html
# https://osint.sh/subdomain/ (Cloudflare JS)
# Certificate transparency logs: https://crt.sh/ as well as https://www.merklemap.com/
# Software options:
## Subfinder, which includes several of the above methods: https://github.com/projectdiscovery/subfinder
## assetfinder: https://github.com/tomnomnom/assetfinder
## Knockpy: https://github.com/guelfoweb/knock
## dnsenum2: https://github.com/SparrowOchon/dnsenum2
## dnsmap: https://github.com/resurrecting-open-source-projects/dnsmap
## gobuster: https://github.com/OJ/gobuster
## Sublist3r: https://github.com/aboul3la/Sublist3r
## Altdns: https://github.com/infosec-au/altdns
## Subenum: https://github.com/42zen/subenum
## AMASS: https://github.com/OWASP/Amass — A powerful tool for in-depth subdomain enumeration, leveraging various APIs, web scraping, and DNS resolution
## The Harvester: https://github.com/laramies/theHarvester — Gathers subdomains using search engines, Shodan, and other OSINT sources
## subdomains-top1million-110000.txt: A wordlist of popular subdomains for brute-force enumeration. Use with tools like gobuster or Sublist3r for effective DNS brute-forcing
# Twitter search
# Archive.Today, with asterisk: https://archive.today/*.example.org
# Additional methods: https://blog.appsecco.com/a-penetration-testers-guide-to-sub-domain-enumeration-7d842d5570f6
Firefox Marketplace

Firefox Marketplace was an online marketplace of applications for Mozilla's failed Firefox OS.
== Shutdown ==
On February 28, 2018, it was announced that Firefox Marketplace would be shut down on March 30, 2018:
The Marketplace will shut down on March 30th, 2018. If there are any apps that you would like, and have not downloaded yet, please do so before that date.
== Structure ==
Mozilla has a JSON API backend for the marketplace; documentation can be found here: http://firefox-marketplace-api.readthedocs.io/en/latest/
For example, https://marketplace.cdn.mozilla.net/api/v2/feed/get/?cache=21600&dev=firefoxos&lang=en-US&limit=10®ion=fi&vary=0 displays all of the application data for the front page of the site. 
From there we can take 2048 as an example, we can take the value of manifest_url, which gives us the URL to download the app: https://marketplace.firefox.com/app/d77a62a6-3128-471d-9f97-845d9772be04/manifest.webapp
The actual download URL is stored in the package_path value in the manifest, e.g. "package_path": "https://marketplace.firefox.com/downloads/file/264351/2048-1.7.zip".
To get the rest of the information of an app the value of the slug field can be used, eg: https://marketplace.firefox.com/api/v2/fireplace/app/2048~/?cache=1&dev=firefoxos&lang=en-US&limit=24®ion=fi&vary=0
A dump of app metadata from shortly before the shutdown is available at (). This is only a list of apps; the manifests, actual app, and images are not included.
Flash

Adobe ended the life of the multimedia plugin and player called "Flash" at the end of 2020, and began blocking its use in the following year. In doing so, it back-stabbed decades of created content. Browsers removed support for the plugin shortly after its discontinuation in Firefox 85 and Chromium 88.
This working page is meant to gather information on this situation and create possibilities for prolonging Flash, even as an open-source player of content already created.
== Projects ==
* Ruffle is an open source Flash emulator built in Rust. Browser plugins, as well as a standalone player application, are available.
* Flashpoint are collecting Flash content, and have written a standalone launcher and web server you run locally to play them. They respect take-down requests from content owners.
* Clean Flash Player is a distribution of the official Flash player with community patches to remove Adobe's kill switch.
* Data Horde's Flash Player Emergency Kit provides links to various workarounds and Flash-related projects.
== Various Articles and Sources ==
* Adobe Finally Kills Flash Dead, Wired Magazine, July 2017
* Adobe Will Finally Kill Flash in 2020, The Verge, July 2017
* Release notes for final version of Flash, 
== References ==
Flashback

Swedish vBulletin forum, statistics:
* 1 126 024 members
* 58 458 207 posts.
No images. A thread can be accessed via https://www.flashback.org/tTHREAD_IDpPAGE_NUM. PAGE_NUM can be omitted if = 0. Latest threads can be found at https://www.flashback.org/nya-amnen. A user page can be accessed via https://www.flashback.org/uUSER_ID. Latest user ID can be found on the top right of each page, "XXXXXXX medlemmar".
Flibusta

flibustaWikipedia article in Russian 
is a strictly non-commercial"Life after flibusta" - Novaya Gazeta: because librusec went commercial, Stiver (flibusta's founder) decided to take a principled stance and create a non-commercial project, read the paragraph at "«Либрусек», видимо, под давлением жизненных обстоятельств".
Russian-language shadow library with a long history. In 2009 it took the contents of the previously open lib.rus.ec librarylibrusec Wikipedia article in Russian
and set on its own path. While the library gained prominence (and notoriety) for hosting copyrighted books, it has built a community and provided a place to review books and talk to other readers on the forums. It could be described as the Russian TPB for books. Some known authors have been participating in the community toohttps://flibusta.is/node/68684.
The site has been banned in Russia at ISP level for copyright infringement years ago. Various mirrors came up, both official and not:
* flibusta.net - redirects to .is (2024-11-01)
* flibusta.is - current official domain
* flisland.net - Wikipedia article claims "no book text access" through this domain
* official TOR and I2P mirrors
== Project founder's death ==
On September 23rd, 2024https://flibusta.is/node/681117https://habr.com/ru/news/852644/ the project's founder Stiver posted publically about his hospitalization and the found brain tumor. In the same post he marked the end of Flibusta ("and himself") and said the servers are paid for a couple weeks in advance. Later an update was added that "the servers are paid for, the website is being supported and the status is stable". On October 22nd, a post-mortem posthttps://flibusta.is/node/684900 was published to announce his medically assisted death on the 20th.
Overall, the communication appears sparse or publically invisible. Therefore the status should remain uncertain/endangered for the foreseeable future.
== Archivation scope ==
* Book info pages: metadata, reviews (comments) and user scores
* Forum: close to 500k posts
* (?) Users' reading lists are available after login
* Basically everything except the book downloads themselves. The site is poorly structured, exploration will be needed to understand what's hidden where.
== References ==
Flipnote Gallery World

Flipnote Gallery World is Nintendo's (Japan-exclusive, except DSi Gallery) animation sharing service for Flipnote Studio 3D on the Nintendo 3DS.
It hosts user-created flipbook-style animations (known as Flipnotes) in a proprietary KWZ format, which is partially documented at .
Of particular interest is the DSi Gallery section, which contains almost all Flipnotes ever uploaded to Flipnote Hatena - its worldwide predecessor for the Nintendo DSi - in aforementioned KWZ format (unfortunately not compatible with Flipnote Studio for Nintendo DSi), except for those Flipnotes whose creators opted out of inclusion into the DSi Gallery. (The Flipnote Hatena servers have since been shut down, although successfully reverse engineered prior.)
Flipnote Gallery World has been reverse engineered by Kaeru Team / Flipnote Collective.
== Amazon S3 Buckets ==
All content is stored on open Amazon S3 buckets. (As of Nov 2021, these S3 buckets appear to be down.)
Bucket name 	Bucket URL	Description
jkz-static-tokyo	 	Static content, mainly UI images but also includes certain event Flipnotes created by Nintendo
jkz-dsidata 	 	DSi Gallery - Flipnotes from Flipnote Hatena, transcoded to the Flipnote Studio 3D KWZ format. (appears to be partially saved with various captures from 'liveweb')
jkz-image-tokyo 	 	Contains Flipnote comment image data.
jkz-data-tokyo 	 	Contains Flipnote data in the Flipnote Studio 3D KWZ format.
Flogão

Flogão was an outdated Fotolog-esque social media website similiar to Instagram. It was created in 2004, had been dead at least since 2013, and was shut down on June 24th 2019. The overwhelming majority of activity that User:Igloo was personally able to find there dates from 2005 to 2008, and all of these nostalgic memories of thousands of users, historical material, and funny stuff were permanently lost in 2019.
== Structure ==
Users appear in the format https://www.flogao.com.br/USERNAME/. Under here, there are several elements, favorites (where other pictures are shown when a user has marked them "favorite"), profile (the users profile, typically with some kind of outlink), blogs (blog entries take the format USERNAME/blog/[0-9]+), photos (photos uploaded to the site). The latter have a unique ID and appear in the format https://www.flogao.com.br/USERNAME/[0-9]+.
It is not known how many accounts there were on the site. One estimate was over 1 million.
== Archival ==
* ArchiveBot (didn't get far before the site shut down)
=== Other attempts ===
* 2019-06-09: https://old.reddit.com/r/DataHoarder/comments/bykfd2/need_urgent_help_in_archiving_an_old_website_that/, There are currently a number of uncoordinated efforts on the go here.
== References ==
== Links ==
*
Floraverse

Floraverse is a webcomic and Creative Commons-licensed fictional universe.
Forbidden Flora is the adult counterpart.
Due to controversy surrounding the author, it is likely the materials will go down. A large part of their previous work, PMD-Explorers, has already been lost.
===Websites===
* https://floraverse.com/ 
** Disqus comments hidden. The individual URLs were put in ArchiveBot as . Wayback Machine example
* https://apps.veekun.com/flora-cutscenes/ - Interactive visual novels and chromebot:1d579ebd-6447-441d-b931-1e46283ad713
** https://apps.veekun.com/flora-cutscenes/res/ - 
* https://www.patreon.com/floraverse/ - - supporter content 
* https://floraverse.deviantart.com/ - but DeviantArt doesn't like ArchiveBot
* https://forbiddenflora.com/ (adult content) - - 
** Disqus comments: 
* https://www.patreon.com/forbiddenflora/ (adult content) - - supporter content 
* https://floraverse.bandcamp.com/ - ?
* http://community.floraverse.com/ - Floraverse forum, currently under a login wall with no way to register. Sanqui sadly lacks an account.
* https://twitter.com/floraverse - Floraverse Twitter account 
* https://floraverse﻿.﻿tumblr.com/ - Floraverse Tumblr account, currently passworded. 
* https://forbiddenflora﻿.tumblr.com/ - (adult content) Forbidden Flora Tumblr account, currently passworded. 
* https://www.youtube.com/channel/UCRNwFQZ5p_9NRjJN3PRQdeg - Floraverse YouTube channel - 
** Internet Archive upload: https://archive.org/details/FloraverseVideos
* https://glitchedpuppet.com/ -
Foodily

Foodily.com closes and trashes the recipes of all its users.
== Transition to Popcart ==
We’re pleased to announce that Popcart will now become our core business. That’s right. From today forward, this company will be focused on helping everybody online get their recipe ingredients purchased in an instant. We believe it’s the right time to put all of our energy into unlocking more user value around shopping for recipe ingredients.
Foodily will be moving their core business from sharing recipes to publishing a tool that allows recipe sharing sites to let their users add the recipe's ingredients to their online grocery shopping cart.http://blog.foodily.com/2015/05/01/taking-popcart-from-0-to-360/
== Announcement 2015-05-08 ==
Service announcement about your Foodily Account
We’re delighted to announce Foodily.com is moving homes and joining Mindspark, a division of IAC. When we founded Foodily, we set out to build a place where everyone can easily socialize around new recipes to cook and we are thrilled to continue this mission with IAC’s global scale and expertise.
We’d like to thank each of our wonderful users who have helped contribute to Foodily since our start 4 years ago. We will begin transitioning the Foodily.com website and mobile applications to the Mindspark team over the next 30 days.
When you visit Foodily, you’ll be asked to log in and confirm your account to keep your faved recipes and lists. Please log in by May 30th. After the transfer, you’ll be able to use Foodily in the same way that you use it today.
Login now to keep your recipes
If you have any questions, please reach out to us Email: support@foodily.com. If you know others that use Foodily – remind them that they need to login by May 30th to hang on to all their amazing recipes.
Thanks again for all the support and we look forward to continuing this Foodily relationship at our new IAC home.
Yours truly,
Andrea, Sami, Hillary, Phillip, Dipenra, Jisha, Dan, John, Jeff, Paul, Eric, Ryan and Julien
Questions? Support@foodily.com 
==References==
Category:Websites
Forever 21

On September 29, 2019, Forever 21 filed for Chapter 11 bankruptcy protection. 
== List of Websites ==
* https://www.forever21.com/us/shop?changecountry=US
* https://www.rileyrose.com/us/shop?refsite=rr
* https://www.forever21.com/ca/shop?changecountry=CA
* https://www.forever21.com/eu/shop?lang=en&changecountry=EU
* https://www.forever21.com/uk/shop?changecountry=UK
* https://www.forever21.co.jp/shop
* https://www.forever21.com/mx/shop?changecountry=MX
* http://www.forever21.co.kr/Default.aspx
* https://www.forever21.in/
== Notes ==
Forever 21's website does work properly without JavaScript enabled (namely, product images do not load).