nyuuzyou/wikis huggingface dataset:
Atomicgamer

Atomicgamer and its hosted sites have shut down in July 2015.
http://www.doomworld.com/vb/doom-general/73690-serious-time-doomworlds-host-is-shutting-down/
Thanks to the support to Atomicgamer staff, Schbirid got access to the Atomicgamer files and uploaded all of it to https://archive.org/details/atomicgamer (~9.3 Terabytes, ~433k files, from early 2000s to 2015).
== Shutdown notice ==
There is currently no official shutdown notice yet, only unofficial communication. 
http://www.doomworld.com/vb/post/1397407:
Hey all, I'm a guy from TF / AG. I don't have much to add really that Linguica hasn't already laid out.
- The main reason we're shutting down is, of course, money.
- The secondary reason is that the passion is gone for my brother and I and has been for awhile so fighting to keep it alive sounds exhausting. It has been 17 to 18 years.
- The end date isn't finalized yet. It's not days, but it's not months either. The sooner the better.
- We're willing to help out as reasonable to make the transition not suck. I don't think there's any particular asshole-ish desire to keep our hosted sites' domain names from them.
Even if the lights did switch off tomorrow, we do own the physical servers and I'm sure we could find someway to get the data back into your hands in this sort of worse case scenario. We could mail a tape backup over or something. :p
-Brian
== Sites in danger ==
http://www.atomicgamer.com/ Game database, reviews, big file database with lots of ancient files.
=== Network sites ===
Linked on http://www.atomicgamer.com/network.php:
http://www.civfanatics.com/ safe, http://forums.civfanatics.com/showthread.php?t=550228
http://www.curmudgeongamer.com/ seems hosted elsewhere
http://www.doomworld.com/ safe, http://www.doomworld.com/vb/doom-general/73690-serious-time-doomworlds-host-is-shutting-down/
http://www.liberatedgames.com/ should be simple to grab
http://www.legendofzelda.com/ seems hosted elsewhere
http://www.linuxgames.com/ wordpress
http://www.nma-fallout.com/ seems hosted elsewhere
http://www.totalwar.org/ safe, http://forums.totalwar.org/vb/showthread.php?149312-Important-Our-host-is-shutting-down
http://www.zeldadungeon.net seems hosted elsewhere
=== Other sites ===
http://www.beyondunreal.com/ safe, the admin is maintaining it elsewhere
http://www.inside3d.com/ (Should be safe, Schbirid is closely connected)
http://www.toybattle.com/ seems to be by one of the owners
=== Subdomains to grab ===
http://sleague.civfanatics.com/index.php/Main_Page mediawiki, use wikiteam's tools
http://modiki.civfanatics.com/index.php/Main_Page mediawiki, use wikiteam's tools
http://old.civfanatics.com/ big but simple wget
http://heretic.linuxgames.com/ simple wget, archivebot?
http://civcomm.civfanatics.com/ looks simple, might by kinda big
Atw.hu

ATW.hu is a Hungarian web hosting service provider that was launched on 2003-08-02.http://web.archive.org/web/20030810205717/http://atw.hu/ Since the beginning, they have been offering free as well as paid webhosting plans as a sustainable business model.
ATW seems to be one of the most stable Hungarian web hosting providers, at least among those that also offer a free plan. They have never done a mass deletion of websites. The company itself seems to be profitable according to balance sheets.
== Site reconnaissance ==
Freely hosted websites are under subdomains of atw.hu. The available space for a website is 500 MB as of 2020.
Unfortunately, there is no complete index of websites freely hosted by ATW. A per-category toplist is available, but only the first few hundred websites are listed in each category.
If we can believe the own statistics of ATW, even the top freely hosted websites are very rarely visited.
As of 2024, the free webhosting plan doesn't seem to be available from the redesigned atw.hu main page, only under secure.atw.hu, which must be the remnant of the old design. Not tested, though, whether it actually works. Existing free websites still seem available, though.
== Notes ==
Category:Web hosting
Axfc Uploader

Axfc Uploader is a beloved Japanese file hosting service. Files can be hidden behind a password, which is often provided by the uploader anyway in the query string of the download URL ("?key=XYZ"), or in the same paragraph of text ("パス：XYZ"), but in the latter case sometimes described with prose to deter foreigners from downloading. Files may be accompanied by a captcha.
It is unreliable, with speculation that it has finally shut down whispered regularly every time.
BBC News Social Media

On 15 July 2020, the BBC announced that they "would close most of [BBC News'] social accounts to focus on core services like @bbcnews, @bbcworld and @bbcbreaking".
Currently the timescale and scope of the purge is unknown. It is believed that this only affects BBC News social media accounts, not other non-News BBC accounts.
Many if not most (if not all) of the Twitter accounts at least are still up and tweeting as of late August 2022.
== List of BBC Twitter Accounts ==
=== Twitter Accounts ===
* BBCAfrica
* BBCArabic
* BBCBreaking
* BBCNews
* BBCNewsEnts
* BBCParliament
* BBCR1
* BBCRadio2
* BBCRadio3
* BBCRadioCymru
* BBCRadioLondon
* BBCRadioScot
* BBCRadioWales
* BBCSomali
* BBCSport
* BBCSportWales
* BBCWorld
* BBCWorld
* bbc5live
* bbcalba
* bbcarabicalerts
* bbcasiannetwork
* bbcmundo
* bbcnewsjapan
* bbcorkney
* bbcpersian
* bbcshetland
* bbcworldservice
* cbbc
* BBCJersey
=== Facebook Accounts ===
bbcalba, BBCAsianNetwork, BBCR2, bbcradio1, BBCRadio6Music, bbcradiowales, bbcnews, bbcradioshetland, bbcpersian, bbcradiocymru, BBCR2, bbcgenome, bbcradiocymru2
=== Instagram Accounts ===
bbcasiannetwork, bbcradio2, bbcradio1, bbcnews, bbcpersian, bbcradiocymru
Bambuser

Bambuser was a live streaming service.
== History ==
In 2017 it announced its shutdown on January 2018.
* "The community will officially cease operation on 22/01/18, after that date, entry to the platform for non-paying users will be denied. All "Premium" customers on set-term contracts will retain access to the service for the duration of their existing contracts, and customers paying on a subscription basis will retain use of the service until 31/05/2018."
Some time later, the service was relaunched, but the content from the previous version isn't available.
== Archive ==
About 1 TB of content related to 15M movement was archived on Internet Archive.
== External links ==
* Bambuser
Bandcamp

Bandcamp is a very popular site for independent musical artists to post their music, for purchase and free streaming. It was founded in 2007, and has made money since 2012. It's not in evident danger right now, but it would still be good to grab the metadata, so if/when it is in danger, we can more efficiently buy single copies of as many different tracks as possible.
The full list of artists can be found by paging thru the (currently 3,581) pages of https://bandcamp.com/artist_index . An ArchiveBot job was done to save a full copy of this (including the 100px square image for each artist) on April 15, 2021.
Each artist has a subdomain, like brigandband.bandcamp.com with up to three subpages: /music, /merch, and /community,
Every artist also has an {artistname}.bandcamp.com/sitemap.xml, which includes all of that artist's albums and singles.
Each album has a separate URL, like echoschildren.bandcamp.com/album/as-good-as-any which displays (and allows streaming of) the whole album, as well as containing metadata about the album. Each track also has a separate URL, like blacklilithrecords-12artistes.bandcamp.com/track/argent-roi-querelle which allows streaming of the individual track, and may have extra information about, including lyrics. If an artist only has one album, /music redirects to /releases, which is an alias for the artist's most recently released album. 
Full size album covers are linked from the album and track pages, and hosted at, for example f4.bcbits.com/img/a3109377707_0.jpg (the number after the dash can be changed to return different sizes of the image).
== Existing Archives ==
=== The Vapor Vault ===
The Vapor Vault is a collection on the Internet Archive that is actively preserving Free or "Name your own Price" releases from Bandcamp, that fall into the Vaporwave or one of its subgenres.
The metadata of those items contain the release URL in the "source" field, which could be used to create a list of already archived releases.
As a possible fallback, they do have a GitHub account providing a list of labels and artists, which possibly could be used to create exception rules for likely already archived releases. It does not seem this public mirror is necessarily kept up to date all the time though.
== Software ==
=== vapor_vault archiver ===
The vapor_vault archiver is used by the Vapor Vault, but does not seem to be made public yet. From their GitHub account: "In the future, portions of the software behind this project may be made public, and this account is the space where that will happen."
Bayimg

Bayimg is an imagehosting platform from the people behind piratebay.org
It was unstable and announced to be offline some time ago and is now back, but for unknown time.
== Going offline ==
Bayimg went offline, when the servers of piratebay got raided. https://torrentfreak.com/pirate-bay-what-raid-police-never-got-our-servers-150921/
In , the TPB Team announced, that Bayimg will return, but only for a short amount of time. See here: https://torrentfreak.com/pirate-bays-image-hosting-site-bayimg-returns-for-a-bit-160425/
The Site is now online ever since, but it is not sure, how long it will stay that way.
== How can I help? ==
=== Running a Warrior ===
You can start up a Warrior and there select bayimg. (If you don't really care what you are archiving, select ArchiveTeam's Choice instead, as at some points ArchiveTeam may prioritize another project.)
=== Running the script manually ===
If you use Linux and you're a bit familiar with it, you can try running the script directly.
The instructions can be found at github.com/ArchiveTeam/bayimg-grab.
Some additional information
Don't forget to replace YOURNICKHERE with your nickname.
The number after --concurrent determines how many threads run at the same time. You can increase this number if your resources (RAM, CPU, bandwidth) are sufficient. However, if you constantly see messages about rate limiting, there is no need to increase the concurrency.
If you want to stop the script, please do it gracefully if possible. To do so, create an empty file named STOP in the folder of the script (terminal command: touch STOP). The script finishes the current item(s) and stops only after that. (If you kill the script immediately, the items get broken, and they will need to be reassigned to another user.) – Before starting the script again, don't forget to remove the STOP file.
If you see "Project code is out of date", kill the script, go to its folder (cd bayimg-grab) and issue git pull https://github.com/ArchiveTeam/bayimg-grab. After the updating has finished, re-launch the script.
=== Donating to the Internet Archive ===
Content downloaded by the ArchiveTeam will be uploaded to the Internet Archive, where it will be stored and be available – hopefully – forever. However, storing it costs thousands of dollars in the long run. So, if you can afford, please consider donating to the Internet Archive, so that this piece of history can be kept for us all. http://archive.org/donate
=== Do you like our cause? ===
If you want to help in other projects, want to learn more about ArchiveTeam, or even help in development in general, navigate to the Main Page of this wiki, from there you can reach a lot of information. The Team consists of volunteers working on the projects in their free time, so helping hands (and resources) are always welcome.
Bebo

Bebo was a popular social network founded by Michael and Xochi Birch back in 2005. The platform celebrated its people, their friends, and creativity.
Here’s a short history on the company:
* 2005 - Bebo, an early social network was founded by husband-and-wife team Michael and Xochi Birch in January 2005 at their home in San Francisco.
* 2005 (9 days after launching) - Bebo hits 1 Million Users.
* 2005 - After numerous questions about why the name is Bebo, Michael makes up an answer (Blog Early Blog Often). Real answer? Bebo was short, snappy, and utterly nonsensical.
* 2006 & 2007 - We built Bebo mobile, groups and the infamous whiteboard amongst other features.
* 2008 - Sold to AOL.
* 2010 - Sold to Criterion Capital.
* Today - Bought back by the original Founders.
* Tomorrow - We start re-inventing Bebo.
== Bebo 2.0==
* FAQ Screenshot
* Relaunch video: https://www.youtube.com/watch?v=Lm9J8Glk0bE (NSFW)
=== Archive Site Structure (Bebo 1.5) ===
* Michael Birch's 
** archived profile: http://archive.bebo.com/Profile.jsp?MemberId=1
** Wall: http://archive.bebo.com/Wall.jsp?MemberId=1 (NSFW)
*** &PageNbr=2
** Comments: http://archive.bebo.com/c/profile/comments?MemberId=1
** Blog: http://archive.bebo.com/Blog.jsp?MemberId=1
** Poll: http://archive.bebo.com/Polls.jsp?MemberId=1
A sampling of 1000 random IDs between 1 and 11100000000 revealed 0% of profile IDs are valid with a margin of error of 3%. This test appears to be correct as Wikipedia states there are ~11 million registered accounts which means 0% of profile IDs are valid.
== How can I help? ==
The project can be run in the Warrior VM.
The scripts also can be run manually. Instructions are located at github.com/ArchiveTeam/bebo-grab.
== Archives ==
A project began to save some profiles but it was stopped because they kept banning us from brute-forcing all the profiles. But what was saved was uploaded to archive.org however: archiveteam_bebo
== See Also ==
*
BetaArchive

BetaArchive is a site that hosts betas and abandonware. It was formed after OSBetaArchive shut down. As of December 2023, the collection totals 116 TB.
==FTP Server==
The core of the whole site. To access it, you need to be in the FTP Access Group on BetaArchive's forums (guidelines are here). Some of what's on the FTP can be found elsewhere, but there's a lot of unique content on the FTP that could get lost if BetaArchive ever permanently went down.
Users have a 50GB/Day limit on downloading which resets at 00:00 GMT. Any script designed to mirror the FTP data must take this into account.
The FTP server was replaced by HTTP(S) downloads through the web interface on .
==Forums==
phpBB based forums for the site. In order to access the Servers Discussion forum, you need to be in the FTP Access Group, and to access the Donators Discussion Forum, you (obviously) need to be in the Donators group.
There is also a VIP discussion area in the forums. How one becomes access to it is not clearly specified.
==Wiki==
Uses MediaWiki. Contains information on betas and abandonware. 
==Image Uploader==
Meant for uploading images to use on the forum. BetaArchive provides an archive of all the images uploaded to it here.
==Screenshot Gallery==
Contains screenshots of betas and abandonware.
== References ==
Bilibili

Bilibili (哔哩哔哩), affectionately known as the B-site (B站), is a Chinese video hosting website, originally catering to the otaku community. It has also expanded into other ventures, such as hosting anime (番剧) and livestreams (直播).
Videos have danmaku-style comments (弹幕) in the style of Niconico, as well as "normal" video discussion (评论).
Videos IDs formerly were numeric and began with "av" (aid, avid). In 2020, they were replaced by a "BV" (bvid) identifier that was swiftly identified as an obfuscated base58 system. Videos up to av99999999 were sequential, and videos IDs after that (if converted to av-format) are random.https://www.zhihu.com/question/381784377 (Note: This algorithm cannot handle avid >= 29460791296, see also: https://github.com/SocialSisterYi/bilibili-API-collect/issues/740)
Videos can have multiple "staffs" attached alongside the uploader(owner), as well as the role of each author, such as 【洛天依原创曲】夏虫【2021官方生贺曲】 which has 7 authors (uploader; composer; lyricist; tuner; animator; planner; planner). curl https://archive.org/download/BiliBili-BV1Hf4y1L7MF_p1-FM1L4H1VB/BV1Hf4y1L7MF_p1.info.json | jq .data.View.staff and jq .data.View.owner
Some videos appear to be region-limited (China only), such as 洛天依&方锦龙《茉莉花》破次元合作【bilibili晚会单品】 which appears in the suggested column of https://www.bilibili.com/video/BV1wU4y1F7XL/ but behaves as a deleted video for this writer.
Videos may belong by default to playlists, such as 【洛天依原创曲】月华舞【2023官方生贺曲】 which belongs to "洛天依11周年生日会" as shown on the right-hand side.
Some videos have multi-P (sub-videos/episode/chapter, 多P) functionality enabled. such as 中国音乐地图之听见广西 侗族大歌 which contains 25 videos for a total length of 01:12:28 as advertised in the thumbnail. Each individual video has a unique cid (content_id). They can be individually danmakued on, but cannot be individually discussed. For the most videos that don't have multi-P enabled, they default to P1 (e.g. https://m.bilibili.com/video/BV1Hf4y1L7MF?p=1 or https://m.bilibili.com/video/BV1Hf4y1L7MF/?p=1 is https://m.bilibili.com/video/BV1Hf4y1L7MF).
Another type of video collection appears as one item in an uploader's homepage, but is actually a collection of individual videos, for example at https://space.bilibili.com/374727603/video.
Videos can belong to "festivals" or other features, in which case the default URL will be redirected to a special URL, such as https://www.bilibili.com/video/BV1Lm41197Rw/ → https://www.bilibili.com/festival/VSF2024live?bvid=BV1Lm41197Rw or https://www.bilibili.com/video/BV1fZ4y147QZ/ → https://www.bilibili.com/bangumi/play/ep515815.
Users can issue posts (动态)The naming of /dynamic is an funny legacy programming naming typology, because both "feed" and "dynamic" could be translated as "动态" even though their meanings in the context have absolutely nothing to do with each other., similar to YouTube community posts.
Users can also post videos as a 动态, which will only appear in the 动态 posts timeline, and not as part of one's uploads. For example, from .
Users can also post audio (音频) and 2 types of articles (图文 and 专栏).
== See also ==
* AcFun
* Niconico
Category:Video hosting
Bintray

Bintray is a software distribution platform by JFrog. It closed on 2021-05-01 but is still serving (some) content for the time being.
== Account of grab ==
OrIdow6 was the main author of the Bintray grab script, and procrastinated in the process of writing it. This led to less data being captured than might have otherwise happened. Items were at first users, which included normal user pages, all their repositories etc., the index of the downloads for that user, and non-CDN hosted download files for that user; and CDN-hosted download files.
When the site shut down, normal user pages/metadata stayed up, and some downloads stayed up (perhaps it was cached); so download listings and files were split off into their own items, using a confusing hack to effectively requeue failed downloads through backfeed. This enabled downloads to cycle around until they hit a machine that was able to grab them. After a few days, these too stopped being served, and only some official/paid downloads remain(ed).
Things to avoid in the future:
* Waiting too long to finish the grab script.
* Putting huge chunks of the download section, which had a very simple structure, in single items, instead of splitting it up.
BitTorrent DHT

The BitTorrent DHT (Kademlia) is a decentralized alternative to trackers for BitTorrent. However, it can also be used to discover torrents and build an index. While downloading the contents would be prohibitively expensive (and have legal issues), the metadata is valuable and only 200-300gb in size.
The following bash oneliner can be used to download all torrents that coppersurfer.tk has peers for:
 mkdir torrents
wget http://coppersurfer.tk/full_scrape_not_a_tracker.tar.gz -O - | tar --to-stdout -xz | xxd -ps -c1 | tr -d "\n" | LC_ALL=C grep --only-matching -P "32303a[0-9a-f]{40}64383a636f6d706c65746569(3[0-9])+6531303a646f776e6c6f6164656469(3[0-9])+6531303a696e636f6d706c65746569(3[0-9])+6565" |grep -v "646f776e6c6f6164656469306531303a696e636f6d706c65746569306565" | cut -c 7-46 | sed 's/^/magnet:?xt=urn:btih:/g' | sed 's/$/\&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969/g' | aria2c -d ./torrents -i - --bt-metadata-only=true --bt-save-metadata=true -j 100
This can obviously be used for other trackers as well, for an incomplete list of trackers sorted by indexed torrents see . Note that some trackers do not publish their scrape files, and some publish them in a non-standard format. Also see for another list and links to some more lists.
== DHT crawling ==
*http://labs.boramalper.org/magnetico/
*https://github.com/kevinlynx/dhtcrawler2
*https://github.com/FlyersWeb/dhtbay
*https://github.com/danfolkes/Magnet2Torrent
== DHT indexers ==
These have large databases that should be archived, as some of the torrent metadata is probably unavailable by now. 
List: https://opentrackers.org/links/publicly-tracked-torrents/#searchengines 
Note that most of the Chinese indexes are run by the same person/group/organization.
== Vuze DHT ==
There are two competing BitTorrent DHTs, the one used in Vuze/Azureus (Vuze DHT) and the one used in all the other clients (Mainline DHT/Kademlia).
There are no Vuze DHT indexing/archival projects. It should be easier, as Vuze DHT shares information more readily and has a pseudo-search engine build in the client. On the other hand, the only implementation is in Java.
== Data dumps ==
*publicbt.com daily dump from 2012-02 to 2012-08 (background)
Category:Peer to peer
Bitbucket

Bitbucket is a version control repository hosting service, marketed mostly towards proprietary and enterprise software but with a substantial FLOSS presence.
== Mercurial repositories ==
It announced on that it would be ending Mercurial support to focus exclusively on Git. Creating new Mercurial repositories was disabled on , and all Mercurial repositories and API were to be removed on .The original sunset date was , but on this was pushed back due to Coronavirus. The actual removal happened in mid-August 2020.
=== Archival ===
Our archival was based on an enumeration of Mercurial repositories from Bitbucket's search API after the February lockdown. Repositories were still writable until they were made read-only in early July. Although the API returns an updated-on field, it is not clear whether this is the repository or its metadata.
The project was split into two parts: the actual hg repositories were retrieved through the Mercurial project (developed for this but reusable for hg repositories in general), and bitbucket covered the web interface (issues, pull requests, wikis, etc.). Apart from around 200 odd repositories, we managed to archive everything successfully.
=== Statistics ===
* Total repos online: 245,068
* Total reported size (fairly accurate): 5.23 TiB (does this include hg compression?)
* Mean reported size: 22.4 MiB
* Median reported size: 205 KiB
* Maximum reported size: 14.4 GiB
=== Existing discussion and tooling ===
* Forum thread
** Some user questions
** Atlassian's response
* https://github.com/clach04/bitbucket_tools
* https://github.com/philipstarkey/bitbucket-hg-exporter
== Site structure ==
Some API requires auth, some does not. Rate limits are documented here.
== References ==