nyuuzyou/wikis huggingface dataset:
Wiki-Site

Wiki-Site is a wikifarm.
For a list of wikis hosted in this wikifarm see: https://code.google.com/p/wikiteam/source/browse/trunk/listsofwikis
This farm offers API, but applies very strict throttles and captchas in addition to being quite slow; best results have currently been reached with a --delay of 200 seconds.
If you see yourself in a loop of HTTP errors, stop everything for 3600 seconds or more before restarting.
Do not run uploader.py at the same time! Do not visit or query the website from the same machine at the same time!
== Command ==
Concretely, you can apply something like the following patch and then run while true; do python launcher.py wiki-site.com ; sleep 3600s; done in a screen. Be ready to make more local patches to reduce requests (e.g. to saveIndexPHP() and friends) and work around blocks.
73,77c72,73
<
< # time.sleep(60)
< # Uncomment what above and add --delay=60 in the dumpgenerator.py calls below for broken wiki farms
< # such as editthis.info, wiki-site.com, wikkii (adjust the value as needed;
< # typically they don't provide any crawl-delay value in their robots.txt).
---
>
> time.sleep(400)
80c76
< subprocess.call('./dumpgenerator.py --api=%s --xml --images --resume --path=%s' % (wiki, wikidir), shell=True)
---
> subprocess.call('./dumpgenerator.py --api=%s --delay=200 --xml --images --resume --path=%s' % (wiki, wikidir), shell=True)
82c78
< subprocess.call('./dumpgenerator.py --api=%s --xml --images' % wiki, shell=True)
---
> subprocess.call('./dumpgenerator.py --api=%s --delay=200 --xml --images' % wiki, shell=True)
== See also ==
* List of wikifarms
== External links ==
* http://www.wiki-site.com
Category:Wikis
WikiApiary

WikiApiary is a wiki that lists and monitors thousands of wikis running MediaWiki, along with wiki farms, extensions and skins. WikiApiary was started on .
Has been down for several months as of , see https://phabricator.wikimedia.org/T304558. As of , it displayed a "We haven't died" message on the main page linking to a mailing list post explaining the downtime. As of , the site is back online, though still somewhat slow, with a second mailing list post noting that they have updated MediaWiki but are still looking into database performance issues.
== Status ==
As of , it has metadata for 25,000 wikis.
It is online, its MediaWiki XML was saved on . The metadata for monitored sites is not published yet.
== See also ==
* List of wikifarms
== External links ==
* 
* https://github.com/WikiApiary/WikiApiary
Category:Wikis
WikiForge

WikiForge is a MediaWiki wiki farm that was founded in March 2023.
It operates as the paid counterpart of WikiTide but is legally a separate legal entity. It shares a GitHub organisation with WikiTide along with a Phabricator instance.
== History ==
WikiForge was founded by a former Miraheze site reliability engineer and was then proposed as a premium counterpart to Miraheze and approved by a community vote. Following a major disagreement between various Miraheze volunteers regarding the global ban of a former Steward, WikiForge broke off and formed WikiTide as their free version, staffed by many former Miraheze volunteers.
A number of Miraheze wikis migrated to WikiForge afterwards and some to WikiTide.
== Backups ==
WikiForge does not publish public backups of their wikis until WikiTide.
Like Miraheze and WikiTide, WikiForge offers the DataDump extension on all its wikis which allows wiki administrators to create their own text and image dump.
== External links ==
* 
Category:Wikis
WikiLeaks

WikiLeaks is a website dedicated to obtaining classified information and leaking it to the public. Their most notable leak is Cablegate, which was 250,000 classified cables between the world's politicians.
== Vital signs ==
Considering the information on the site, (and that PayPal (for donations) and Amazon (for hosting) refused to service them for said information during the Cablegate scandal) WikiLeaks should be considered in at least some danger at all times. Keep an active eye on this one boys and girls.
== Obtaining data from it ==
Wikileaks is aware they could be taken down at any time, so they try to make their information easily downloadable and spreadable. They made Cablegate available for download via torrent, for example.
== External links ==
* http://wikileaks.org
* http://46.59.1.2/Mirrors.html
* http://www.archive.org/details/wikileaksarchive
* http://www.wlstorage.net is a file repository for your downloading of everything ever released by Wikileaks
WikiTide

WikiTide is a non-profit MediaWiki wiki farm that was founded in June 2023. As of August 2023, they host almost 200 wikis.
It operates as the free counterpart of WikiForge but is legally a separate entity due to non-profit laws. It shares a GitHub organisation with WikiForge along with a Phabricator instance.
== History ==
Following disagreement with a global ban imposed on a former Steward by the Miraheze Trust and Safety team, many longtime volunteers left Miraheze to form a new wiki farm which sought to address foundational issues they saw at Miraheze.
Major Miraheze wikis like the Audiovisual Identities Database and Polandball Wiki sided with the departing volunteers and moved (or planned to move) from Miraheze to WikiTide. A number of other wikis also migrated afterwards, including Rosetta Code.
== Backups ==
WikiTide self-dumps their wikis monthly at the beginning of the month. They have an archive.org account where they upload wiki dumps.
Like Miraheze, WikiTide offers the DataDump extension on all its wikis which allows wiki administrators to create their own text and image dump.
A public list of all wikis is available.
== External links ==
* 
* 
Category:Wikis
Wiki Loves Monuments

Wiki Loves Monuments (WLM) is a public photo competition around cultural heritage monuments, organized by Wikimedia chapters, groups and local Wikipedia volunteers. The public takes photos of monuments, upload those to Wikimedia Commons, and then they can be used in Wikipedia and elsewhere. The goal is to make the world's heritage monuments visible for the world wide public. 
== Archive ==
* Blog: 
* Database: , 
== See also ==
* List of monument databases
== External links ==
* http://www.wikilovesmonuments.org/
* https://commons.wikimedia.org/wiki/Commons:Wiki_Loves_Monuments
* https://commons.wikimedia.org/wiki/Commons:Monuments_database
Category:Architecture
Wikibooks

Wikibooks is a wiki for the creation of free content e-book textbooks and annotated texts. 
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wikibooks/
== Archive ==
* Wikibooks items
* Wikibooks ZIM format
== See also ==
* List of book databases
== External links ==
* https://www.wikibooks.org/
Category:Wikis
Category:Literature
Wikidata

Wikidata is a collaboratively edited knowledge base hosted by the Wikimedia Foundation. It is intended to provide a common source of open data which can be used by Wikimedia projects such as Wikipedia, and by anyone else, under a public domain license. This is similar to the way Wikimedia Commons provides storage for media files and access to those files for all Wikimedia projects, and which are also freely available for reuse. Wikidata is powered by the software Wikibase.
== Dumps ==
Official downloads:
* Wikidata:Database download
* https://dumps.wikimedia.org/other/wikidata/ (JSON)
* https://dumps.wikimedia.org/wikidatawiki/ (XML)
On Internet Archive:
* subject:"wikidatawiki"
== See also ==
* Wikipedia
* Wikidata lists
* WikiTeam
Wikimedia Incubator

Wikimedia Incubator is a wiki that hosts various test instances of Wikimedia sites in new language under a prefix system before they get their own subdomains.
== Download ==
* https://dumps.wikimedia.org/incubatorwiki
== Archive ==
* Wikimedia Incubator items
* Wikimedia Incubator ZIM format
== External links ==
* https://incubator.wikimedia.org/
Category:Wikis
Wikinews

Wikinews is a free-content news source wiki. The site works through collaborative journalism.
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wikinews/
== Archive ==
* Wikinews items
* Wikinews ZIM format
== See also ==
* List of newspapers
== External links ==
* https://www.wikinews.org/
Category:Wikis
Wikiquote

Wikiquote is a vast reference of quotations from prominent people, books, films, proverbs, etc.
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wikiquote/
== Archive ==
* Wikiquote items
* Wikiquote ZIM format
== See also ==
* List of book databases
== External links ==
* https://www.wikiquote.org/
Category:Wikis
Category:Literature
Wikisource

Wikisource is an online digital library of free-content textual sources on a wiki.
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wikisource/
== Archive ==
* Wikisource items
* Wikisource ZIM format
== See also ==
* List of book databases
== External links ==
* https://www.wikisource.org/
Category:Wikis
Category:Literature
Wikispaces

Wikispaces is a wiki farm.
== Vital signs ==
Wikispaces is closing down. End-of-service dates:
* Classroom and Free Wikis: 31st July 2018
* Plus and Super Wikis: 30th September 2018
* Private Label Wikis: 31st January 2019
== Wikitext of the latest revision ==
We're exporting the plain text version of every page of every wiki, starting from the directory of users.
* Collection: https://archive.org/search.php?query=subject%3A%22wikispaces%22%20AND%20subject%3A%22wikiteam%22
* Script: https://github.com/WikiTeam/wikiteam/blob/master/wikispaces.py
== Data saved ==
* 200,000+ wiki dumps added to Internet Archive using WikiTeam tools
* 400,000+ wikis added to Wayback Machine using ArchiveTeam Warrior
Category:Wikis
Wikispecies

Wikispecies is a comprehensive free content catalogue of all species with over 600,000 articles.
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wikispecies/
== Archive ==
* Wikispecies items
* Wikispecies ZIM format
* 
== See also ==
* List of species databases
== External links ==
* https://species.wikimedia.org/
Category:Science
Category:Wikis
Wikispot

Wikispot was a wiki farm with an own wiki engine, which got superseded by LocalWiki and was scheduled to close on April 1, 2015http://web.archive.org/web/wikispot.org/2015_Shutdown_Notice but was up until July 27, 2015 23:35 UTC. It started to redirect to localwiki.org then. Later that year a static copy of the website was restored.
:"No promises here, but time permitting, the wikispot.org service will be set to be a 100% static site, meaning some of the material will remain accessible for an indeterminate period of time. Editing and account creation will not continue to work, nor will viewing private or otherwise protected pages."
From a private email: «We migrated 90% of the data to LocalWiki, and most of what remains is of..dubious quality».
== Archiving ==
Was put into ArchiveBot on June 29, 2015. Fucked up, not saved subdomains.
user:bzc6p started crawling it on 2015-06-30.
A fair amount (~80%, rough estimate) of the content (wikis and their pages) got saved until the shutdown date, with revisions and such, in WARC format. (This wiki engine is at the moment not supported by WikiTeam tools.) https://archive.org/details/wikispot_org_2015_07.
However, probably everything on the main domain (wikispot.org) got saved by the first, ArchiveBot run: http://archive.fart.website/archivebot/viewer/job/4c8up
Category:Wikis
Wikitravel

Wikitravel is a free travel guide.
Internet Brands disabled the MediaWiki API on the site in mid-2012 in a failed attempt to prevent a fork. Several languages of former Wikitravel content have now been imported to Wikivoyage, a Wikimedia Foundation project. The procedure for downloading Wikivoyage is the same as for Wikipedia or other WMF content.
== Backups ==
* WikiTeam backup progress
Category:Wikis
Wikiversity

Wikiversity is a project that supports learning communities, their learning materials, and resulting activities.
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wikiversity/
== Archive ==
* Wikiversity items
* Wikiversity ZIM format
== See also ==
* List of book databases
== External links ==
* https://www.wikiversity.org/
Category:Wikis
Category:Literature
Wikivoyage

Wikivoyage is a free web-based travel guide for travel destinations and travel topics written by volunteer authors.
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wikivoyage/
== Archive ==
* Wikivoyage items
* Wikivoyage ZIM format
== See also ==
* Geography
== External links ==
* https://www.wikivoyage.org/
Category:Wikis
Category:Geography
Wikkii

Wikkii is a wikifarm. It hosts about 3000 wikis. It also operates a few other wikifarms located in different domains to allow users to have a different domain name for their wikis.http://wikkii.com/wiki/Start_a_Wiki
Wikkii also operates Wikkii.net, which is a service for advanced users to install their wikis by themselves so that they can maximize 
the amount of customization they could do on their wikis. Wikkii.org is also operated by Wikkii, to allow users to create a few pages instead of creating a completely new wiki.
For a list of wikis hosted in this wikifarm see: https://code.google.com/p/wikiteam/source/browse/trunk/listsofwikis
== Backups ==
* Wikifarm backups are in progress
* Wikkii/Twitter account grab (@wikkiicom)
* TODO: http://wikkii.com/forums/index.php
== See also ==
* List of wikifarms
== References ==
== External links ==
* http://wikkii.com
Category:Wikis
Wiktionary

Wiktionary is a dictionary with over 6 million entries from over 4,000 languages.
== Download ==
* https://dumps.wikimedia.org/
* https://download.kiwix.org/zim/wiktionary/
== Archive ==
* Wiktionary items
* Wiktionary ZIM format
== See also ==
* List of language databases
== External links ==
* https://www.wiktionary.org/
Category:Languages
Category:Wikis
WildWorks

WildWorks, formerly known as Smart Bomb Interactive, is an American game development studio most well-known for creating MMOs for children.
WildWorks has recently been embroiled in a controversy due to their latest MMO, Cinder, heavily utilizing NFT technology based on the Solana blockchain, as well as heavily reusing assets from Fer.al despite previous statements from the company stating that only some assets would be reused. As a result of this controversy, the company has gone radio silent (with the exception of their aggressive promotion of Cinder), locking comments on their social media pages in an attempt to contain the backlash. Their CEO has also been known to repeatedly lie to users so it's not advised to consider his word reliable.
== Fer.al ==
Released into closed beta on December 11th, 2019 and into open beta on May 20th, 2020, Fer.al has been stuck in its beta phase for the last two years. Over the past several months, updates have been stagnating and reports from players indicate that the game is rotting in its bugs and glitches. Due to the recent controversy, the admins of the official Discord server have gone radio silent, and mistreatment prompted the moderators to resign en masse. Many players have left the game in protest. The community speculates that the game is likely to be sunsetted soon. This MMO is at the highest risk of closure.
== Animal Jam (Play Wild) ==
Released as Animal Jam - Play Wild in December of 2014, it'd later have its name changed to Animal Jam. Updates have been stagnating over the past several months and more bugs and glitches have been creeping in over time, similarly to Fer.al. It is at a high risk of closure due to the recent controversy.
== Animal Jam Classic ==
Animal Jam Classic is the original version of Animal Jam developed in partnership with National Geographic and released on September 9th, 2010. Originally a Flash-based MMO, it would later be converted into a desktop client in anticipation of Flash's death. Updates to the game have been stagnant over the last few months and more bug and glitches have been creeping in over time. Like WildWorks' other MMOs, it is at high risk of closure due to the recent controversy.
== Cinder ==
Cinder is the infamous NFT-based MMO at the center of the controversy embroiling WildWorks. It has not been released yet, but is at high risk of closure upon release.
Category:Corporations
Category:Gaming
Wildscreen Arkive

Wildscreen Arkive, also stylised as ARKive, is an encyclopaedia/collection of video and photo recordings of species. It is shutting down on 2019-02-15. As of 2019-02-02 20:10 UTC, it stores 96515 photos and 9238 videos on 16046 species.
== Shutdown notice ==
Posted on 2019-01-25 on the blog:
Arkive launched in 2003 and has helped over half a million people every year from over 200 countries, learn and discover the wonders of the natural world.
However, as a small conservation charity, Wildscreen can no longer financially sustain the ongoing costs of keeping Arkive free and online or invest in its much needed development. Year on year it has become ever more challenging to raise the required funds to keep Arkive living, breathing and growing, and though we have many loyal followers, the number of website visitors has halved over the past 5 years.
Therefore, we have had to make the very hard decision to close the Arkive website on 15 February 2019.
While it’s sad to say goodbye, we will be focusing all our energy on our core charity, Wildscreen, ensuring that we continue to support our global community of natural world storytellers, year-round, and more than ever before.
Thank you for all your support, long may you continue to explore and learn about our amazing natural world.
The Wildscreen Trustees.
== References ==
Win-Raid Forum

Win-Raid Forum is a collection and discussion place for BIOS/UEFI modding, modded storage drivers, BIOS/UEFI ROM files and CPU microcode updates.
== 2021 shutdown turned migration ==
On November 14, 2021, founder of Win-Raid Forum, Dieter, announced in a pop-up that the forum will be closing in the near future (probably at the end of 2021). A post soon after the popup was added gives some reasons for the the forum's closure, and affirms that it will be closing "at the end of the year". On 2021-11-21, it was announced that a plan for migrating the forum was being developed; this was confirmed again on 2021-12-20 with the addition that the forum would not close at the end of the year. On 2022-04-14, it was announced that the forum would migrate to a Discourse instance hosted by Level1Techs in the near future. A redirect to that Discourse instance was put in place on 2022-05-13.
== References ==
WinAmp

Winamp is known for its popular MP3 player.
== Shutdown Notice ==
Winamp.com and associated web services will no longer be available past December 20, 2013. Additionally, Winamp Media players will no longer be available for download. Please download the latest version before that date. See release notes for latest improvements to this last release.
Thanks for supporting the Winamp community for over 15 years.
At time of writing, they are "re-energizing" for a new Winamp.
== Archives ==
The archives cover sites: 
* http://www.winamp.com/
* http://dev.winamp.com/
* http://forums.winamp.com/
* http://blog.winamp.com/
Winamp.com grab (November 20, 2013)
Download.nullsoft.com grab (November 20, 2013)
Skins and Plugins/Customize directory (November 20, 2013)
Arkiver: Crawl is going to be uploaded soon.
Forums:
* Threads 1-100000
* Threads 100001-200000
* Threads 200001-300000
* Threads 300001-400000
A complete query is available.
Windows Live Spaces

Windows Live Spaces was Microsoft's blogging/social networking service, a part of Windows Live.
On September 27, 2010, Microsoft announced that Windows Live Spaces would be shut down on March 16, 2011Changes are coming to Windows Live Spaces. Users were given the opportunity to download their Space, migrate it to Wordpress.com or let Microsoft delete it along with any other remaining Spaces on D-Day.
== Archival Project ==
ArchiveTeam is working to archive as much of Windows Live Spaces as possible. If you are able to help, please visit the talk page for co-ordination.
== Trivia ==
* Although there were 7,000,000 profiles on Windows Live Spaces,Over 500,000 Windows Live Spaces blogs migrated to WordPress.com only 1,000,000 of them had been moved to Wordpress.com by March 2, 2011Over one million new blogs on WordPress.com, but time is running out - a mere 14% of the total.
* Swicher has gathered some statistics during his effort to download Spaces.
== References ==
Category:web hostings
Category:Microsoft
Word Count Journal

__NOTOC__
WordCountJournal.com was last seen on June 10, 2011. Since then the site no longer responds. Archive Team made a copy.
== About Word Count Journal ==
A wonderful site where you can write short journal articles about iPhone unlocking, Joomla development in India and other web marketing topics. Or as WCJ so eloquently put it:
Word count journal is a new blog format where you write one word your first day, two words the second, three words the third, etc. By the end of a non-leap year you'll have written a total of 66,795 words, more words than most novels.
Wonderful site full of spam. No wonder they're closing it down.
== Archiving status ==
There is not too much information on the site. Alard is downloading users, groups, journals and images.
Working with ARCHIVE.ORG

The Internet Archive has enormous resources at its disposal, and shares many parallel goals with Archive Team. There are some advantages to making as much of Archive Team's data saves available to ARCHIVE.ORG, especially as regards the Wayback Machine, a mechanism to be able to browse older web materials going back years. Where possible, Archive Team works with ARCHIVE.ORG, and get the love going.
__TOC__
== Headers and Logs ==
The most striking difference between Archive Team and ARCHIVE.ORG is that while Archiveteam traditionally considers header and logging information to be a nice hat trick if you have the time, ARCHIVE.ORG absolutely needs it to import into their Wayback Machine.
How? See The WARC Ecosystem.
== The Archive.org "Archiveteam" Collection ==
Archive.org currently has an Archive Team Collection, which consists of site-grabs, older archives, and various rips/mass downloads from websites and Archive Team activities. Right now, that collection is primarily administered by Jason Scott — sending him e-mail at jason@textfiles.com with something you think that collection should have is probably the best way to go about things.
Category:Tools
World

Everything.
== Arts ==
* List of architecture databases
* List of book databases
* List of monument databases
* List of movie databases
* List of music databases
== Geography ==
* List of geographic databases
* List of Reddit subs by country and territory
* List of Twitter hashtags by country and territory
== GLAM ==
Galleries, Libraries, Archives and Museums.
* ArchiveGLAM
* List of knowledge projects
* Knowledge preservation initiatives
== History ==
* List of disasters
* List of elections
* List of wars
== Language ==
* List of language databases
* List of Reddit subs by language
* List of Twitter hashtags by language
== Science ==
* List of astronomical databases
* List of biological databases
* List of chemistry databases
* List of diseases databases
* List of scientific literature databases
* List of species databases
== Technology ==
* List of hardware databases
* List of social networks
* List of software databases
* List of patents databases
Category:Archive Team