nyuuzyou/wikis huggingface dataset:
BlackBerry World

The BlackBerry World App Store, or simply BlackBerry World, is an app store for BlackBerry devices.
== Shutdown ==
On , BlackBerry announced that BlackBerry World would shut down at the end of 2019:
While we are pleased to announce continuing support for BB10 and BBOS users for at least another two years, current device owners should be aware that we will be closing some ancillary services such as the BlackBerry World app store (12/31/2019), the BlackBerry Travel site (February 2018), and the Playbook video calling service (March 2018).
However, on , BlackBerry extended support for beyond 2019:
Today, we can proudly say that we are extending that commitment and will continue to support critical infrastructure and services for BB10 as well as network access for BBOS devices beyond the end of 2019.
On , BlackBerry announced that it would discontinue BlackBerry devices and a range of software, applications and services on , including BlackBerry World:
As another milestone in the BlackBerry journey, we will be taking steps to decommission the legacy services for BlackBerry 7.1 OS and earlier, BlackBerry 10 software, BlackBerry PlayBook OS 2.1 and earlier versions, with an end of life or termination date of January 4, 2022.
== References ==
Blipfoto

Blipfoto is a cloud photo hosting service, established in 2004.https://www.scotsman.com/news-2-15012/how-blipfoto-is-growing-from-small-leith-beginnings-into-1bn-company-1-2769334 The company went into liquidation on March 11 2015http://www.bbc.co.uk/news/uk-scotland-scotland-business-31927236 although the website continues to operate while a buyer is sought.https://www.blipfoto.com/entry/2024545103963492314 Described as "a major player in the Slow Web movement" https://cassandra.co/tech/2014/02/07/first-fridays-joe-tree-founder-and-ceo-of-blipfoto, Blipfoto is thought to encompass at least 3.4 million photoshttps://www.thenational.scot/news/14897152.concern-over-future-of-social-media-site-blipfoto/ and 22 million comments.https://en.wikipedia.org/wiki/Blipfoto Blipfoto was bought around March 25, 2015 by Jeffrey Hecktman Chairman and CEO of Hilco Global and Bobby Sager a Director at Gordon Brothers. https://www.blipfoto.com/entry/2027531207289340134 Blipfoto was bought by Blipfuture CIC in February 2016.https://en.wikipedia.org/wiki/Blipfoto
== Photos ==
Photos appear to be hosted on cloudfront.net URLs. Individual photo pages have numeric URLs like [https://www.blipfoto.com/entry/2024559920535307081]. 
== Usernames ==
User pages exist in the form of [https://www.blipfoto.com/Wendles56]
Chip's initial Google/DuckDuckGo/Yahoo scrapes sorted and uniq'd [http://paste.nerds.io/raw/oxolaxaqiv]
== Comments ==
Comments are loaded on scroll from /comments and are JSON formatted (not counting the while to prevent JSON Hijacking). e.g. https://www.blipfoto.com/entry/2019428284378382362/comments
== Tags == 
Photos can be tagged and retrieved via search - e.g. [https://www.blipfoto.com/search/entries?q=%23bootees]. A very small list of 'popular' tags is visible at [https://www.blipfoto.com/tags]
== Places ==
Photos can be viewed by places - [https://www.blipfoto.com/places] -- e.g. [https://www.blipfoto.com/place/glasgow]
== References ==
Category:Image hosting
Blog.nl

blog.nl was a blogging platform where journalists posted interesting topics and articles in a wide variety of fields of expertise (including everything from politics to sex). At its peak, over 100 blogs ware active. Slowly, over the years, it died down, with its last post in 2018.
==Sub domains==
*industrie.blog.nl		
*glamour.blog.nl		
*hypotheken.blog.nl		
*wereldnieuws.blog.nl		
*nltaal.blog.nl		
*koken.blog.nl		
*mail.blog.nl	
*seks.blog.nl		
*speelgoed.blog.nl	
*paranormaal.blog.nl		
*koffie.blog.nl		
*zappen.blog.nl		
*wintersport.blog.nl		
*circus.blog.nl		
*videoclips.blog.nl		
*kinderspul.blog.nl		
*jongeren.blog.nl		
*toneel.blog.nl		
*images.blog.nl		
*reclamewereld.blog.nl		
*zeeland.blog.nl		
*ondernemen.blog.nl		
*snooker.blog.nl		
*nieuwemedia.blog.nl		
*beauty.blog.nl		
*barcelona.blog.nl		
*hoax.blog.nl		
*wijn.blog.nl		
*newyork.blog.nl		
*latin.blog.nl		
*groen.blog.nl		
*auto.blog.nl		
*media.blog.nl		
*lifestyle.blog.nl		
*portugal.blog.nl		
*50plus.blog.nl		
*wetenschap.blog.nl		
*frankrijk.blog.nl		
*games.blog.nl		
*technologie.blog.nl		
*test7.blog.nl		
*nba.blog.nl		
*india.blog.nl		
*amerika.blog.nl		
*cinema.blog.nl		
*celeb.blog.nl		
*gezondheid.blog.nl		
*mijngeld.blog.nl		
*friesland.blog.nl		
*katenhond.blog.nl		
*bollywood.blog.nl		
*hollywood.blog.nl		
*feyenoord.blog.nl		
*dance.blog.nl		
*thee.blog.nl		
*fotografie.blog.nl		
*religie.blog.nl		
*communicatie.blog.nl		
*relatie.blog.nl		
*animatie.blog.nl		
*zuidoost-azie.blog.nl		
*turkije.blog.nl		
*spanje.blog.nl		
*blogonline.blog.nl		
*secretaresse.blog.nl		
*fctwente.blog.nl		
*alternative.blog.nl		
*radioactive.blog.nl		
*vtroonswisseling.blog.nl		
*politiek.blog.nl		
*oostenrijk.blog.nl		
*bank.blog.nl		
*voetbal.blog.nl		
*musical.blog.nl		
*minimal.blog.nl		
*hotel.blog.nl		
*travel.blog.nl		
*webmail.blog.nl	
*americanfootball.blog.nl		
*ctrl.blog.nl		
*duurzaam.blog.nl		
*christendom.blog.nl		
*sieraden.blog.nl		
*meiden.blog.nl		
*amstelveen.blog.nl		
*sc-heerenveen.blog.nl		
*fcgroningen.blog.nl		
*hemaverzekeringen.blog.nl		
*boeken.blog.nl		
*yaboeken.blog.nl		
*kinderboeken.blog.nl		
*billen.blog.nl		
*pensioenen.blog.nl		
*wielrennen.blog.nl		
*wonen.blog.nl		
*zappen.blog.nl		
*shoppen.blog.nl		
*besparen.blog.nl		
*dieren.blog.nl		
*karpervissen.blog.nl		
*sportvissen.blog.nl		
*schaatsen.blog.nl		
*powervrouwen.blog.nl		
*fashion.blog.nl		
*cartoon.blog.nl		
*arbo.blog.nl		
*griep.blog.nl		
*hiphop.blog.nl		
*nlpop.blog.nl		
*bizar.blog.nl		
*zwanger.blog.nl		
*bier.blog.nl		
*tweedekamer.blog.nl		
*filmpjes.blog.nl		
*fitness.blog.nl		
*dieet.blog.nl		
*gadget.blog.nl		
*recht.blog.nl		
*spiritualiteit.blog.nl		
*eropuit.blog.nl		
*huizenmarkt.blog.nl		
*kunst.blog.nl		
*vrouw.blog.nl		
*ajax.blog.nl		
*gay.blog.nl		
*baby.blog.nl		
*bizniz.blog.nl
Category:Blogging
Blog.pl

Blog.pl was one of the first and largest blog platforms in Poland, established in 2001 as an independent project and later acquired by the mainstream web company Onet.pl in 2006. The site was set to be closed on 2018-01-31 or 2018-02-28 (see below). Users were able to export the content and images of their blogs until 2018-02-28http://www.blog.pl/pomoc/50.
Blog.pl is not to be confused with Blox.pl.
== Shutdown ==
Originally, the shutdown was planned for 2018-01-31. Until 2018-01-24, the homepage included this notice:
 Informujemy, że 31 stycznia 2018 platforma blog.pl zostanie zamknięta.
 [We inform you that on 31 January 2018, the platform blog.pl will close.]
On 2018-01-24 or 25, Onet announced that the blogs would be exportable until the end of February due to popular demand by replacing the above notice with the following text and in an FAQ entry.
 W związku z Waszymi prośbami zdecydowaliśmy się wydłużyć możliwość archiwizacji blogów do 28.02.2018 r
 [In accordance with your requests, we decided to extend the possibility of archiving blogs until 28.02.2018]
As of 2018-02-06, all blogs were still online, even though the relevant FAQ entry on their website still mentioned 2018-01-31 as the shutdown date of the blog subdomainshttp://www.blog.pl/pomoc/49.
On 2018-03-01, blog.pl started redirecting to Onet.pl.
== Site structure ==
Every blog has its own subdomain under a number of domains, including blog.pl, blog.onet.pl, piszecomysle.pl, and crazylife.pl. There is a catalogue of the blogs registered in the system. The catalogue can be refined through categories and tags. However, it does not appear to be possible to discover all blogs through the catalogue as each query is limited to 100 pages of results.
The platform is based on WordPress.
== Archival efforts ==
Due to extremely strict rate limiting (persistent IP ban when the request rate is higher than two per second just once, with a reCAPTCHA to get unbanned) and the lack of ability to run warrior projects currently, Blog.pl cannot be archived properly. As explained above, it is also not easily possible to discover all blogs on the platform. Nevertheless, there was an attempt at archiving at least the homepage of each blog; roughly 100k of these were retrieved successfully.
== References ==
Category:Blogging
Blogger.hu

:Not to be confused with Blogger.com.
Blogger.hu is a Hungarian blog hosting service. It was launched on 2010-04-22https://gephaz.blogger.hu/2010/04/22/hurra-elindultunk by Generál Média, and sold in 2013 to Epicenter Market Ltd. incorporated in the UK. (This is the company that also "operates" myVIP.)
== Site reconnaissance ==
The website seems to be abandoned by staff since 2014. Some users are still making posts, but registration of new users has apparently been disabled in July 2023.
Blogs are hosted under a subdomain of blogger.hu. Some blogs are linked from the main page, but there is no index of blogs otherwise. (A "next blog" link is present on most blogs, but this doesn't seem to be a random link, but just one of a handful blogs.) Fortunately, user IDs are sequential, and user profile pages list their blogs. This way all users and blogs are discoverable.
Some blogs are restricted, and visible only to registered users approved by the blog owner.
=== Discovery results ===
As of December 2024, there are:
* 38,110 blogs
** of which 1753 are restricted ("locked")
* 74,826 users
== Archiving ==
user:bzc6p started the preparations of archiving all blogs and users in December 2024.
Discovery is complete, see results above. Preparation of archive scripts are nearly finished, however, testing had to be stopped, as the service has been broken since 2025-01-02 14:58 UTC.
Archiving is scheduled to start after archiving of cafeblog.hu finishes (est. 2025 Q1 or Q2).
== References ==
Category:Blogging
Blogter.hu

Blogter.hu was one of the most popular and developed free blogging services in Hungary in the second half of the 2000s. Started in 2005, gained good popularity and collected a good community around itself. However, from 2010, technical problems (timeouts) started to occur and support seemed to disappear.
From 2012, the site was more unavailable than available. (At least for some users; others could and did use it.http://www.netkutatasok.hu/2012/02/gemius-bloghu-48-szazalek-freebloghu-17.html) In autumn 2014, the situation went critical, and pages couldn't be loaded a single time. As of December 2014, blogter.hu is also disappearing from Google search results.
The company running the site (Blogter.com Nemzetközi Kft.) has been in a terrible financial situation for years.http://e-beszamolo.kim.gov.hu/kereses-Default.aspx Considering this and that the site has been bleeding out slowly and losing its visitors steadily, we can assume that blogter.hu is gone for good.
== Archives ==
No complete archive was made. But see the Wayback Machine that kept making snapshots.
== References ==
== Further reading ==
http://onlinemarketing.blog.hu/2008/11/24/blogter_az_1096_napon
Category:Blogging
Blox

The last remaining large Polish blog platform, owned by Agora SA. Not to be confused with Blog.pl.
== Shutdown ==
The platform was going to be closed on April 29, 2019 http://blox.blox.pl/2019/02/Zamkniecie-serwisu-Bloxpl.html Indexes were:
* http://www.blox.pl/html?page=Top1000Index2
* http://www.blox.pl/blog/tags/index
As of August 4, 2023, the site is dead.
Brazil

=== 2018 Brazil elections ===
Bolsonaro wins October 2018 elections. We archive some government sites. See ArchiveBot/Governments/Brazil and ArchiveBot/2018 Brazilian general elections.
=== 2019 .gov.br domains renaming ===
"Brazilian government has announced they're discontinuing *.gov.br websites in favor of a single gov.br/* model. All sites must be migrated by december/2020. Starting june/2019, they'll deny new domain registrations. This will also affect mobile applications, which will now have a single publisher. For example, mctic.gov.br will be gov.br/mctic."
Bre.ad

Bread was a URL shortener and monetization website that allowed sharing of links. The shortlinks would sometimes redirect to a page with an advertisement and a personal note, or Toast, from the original sharer of the link. It would then redirect to the destination URL. Clicking on the Toast would show other people who liked the Toast.
== Yahoo! ==
We've been acquired by Yahoo!
We are excited to announce that Yahoo has acquired Bread!
When we launched Bread in 2011, our goal was to help social media influencers and publishers better monetize their online content. We built the first digital platform that delivered beautiful and engaging advertising across social media, desktop, and mobile devices.
In Yahoo, we found a company that shares our vision. We are thrilled to join Yahoo’s advertising team in Sunnyvale where we will be working on developing next-generation solutions for social and mobile publishers and advertisers.
For the next 30 days, until November 11, we will support Bread links that our publishers created in the past. We highly recommend our publishers swap out their Bread links with new links from bit.ly.
Also, as of today, we will be shutting down access to our core products, Bread Social and Bread Oven. We appreciate our partners' understanding as our team makes the exciting transition to Yahoo.
We'd like to extend a special thank you to our investors, our friends, our families, and our partners who supported us unconditionally from the beginning.
Best,
Alan Chan
CEO
== Shortlinks ==
:See URLTeam
== External Links ==
* Lady Gaga and 50 Cent Lend Names to URL Shortener Bre.ad
* Yahoo Acquires Bread, Will Shut Down The URL Shortener That Earned You Money
== Archive ==
https://archive.org/details/urlteam_bread
Category:Yahoo! Category:URL shortening
Brightkite

Brightkite was a text-based social networking service, similar to Twitter in its early years. It was founded in 2007 and let users post short messages using a mobile app and SMS.BrightKite - Wikipedia
According to Adrian Roselli, the site blocked the Wayback Machine through its robots.txt file around the beginning of 2016.Stop Throwing Away Your Content — Adrian Roselli (July 20, 2016)Tweet by Adrian Roselli on January 10, 2016 As of 2024, the site is manually excluded from the Wayback Machine.https://web.archive.org/web/*/brightkite.com
== References ==
Category:Excluded from the Wayback Machine
Bulletin board system

While bulletin board systems (BBSs) are mostly historical, there are still some alive today and some are still on FidoNet and other similar networks. Like the SmolNet, they are hard to archive, because they are usually accessed using dial-up, telnet, rlogin, ssh, SmolNet or other protocols, which aren't representable with the WARC format. Some BBSs do have web or FTP gateways, but often they are just gateways to the telnet interface, rather than websites with URLs that can be archived. BBSs may have associated Forums.
A list of bulletin boards with web access:
 
https://www.ipingthereforeiam.com/bbs/
A list of lists of bulletin boards:
 
http://www.synchro.net/sbbslist.html
Buzzly

Buzzly.art is an art website similar to DeviantArt. Early-mid March 2022, it has been undergoing "staff" infightinghttps://drive.google.com/drive/folders/1ViMihqI8aXjLldy4a9SDfv0_Aa5uAXaQ?usp=sharinghttps://twitter.com/buzzlyarts/status/1503876974556553218#m and a user exodus (see image).
== Site Structure ==
A "user" (login) can have multiple "accounts" (public-facing profiles). The main objects under users are submissions (images, audio, and text) as well as blog posts. Most of the site's functionality is done through GraphQL through POST. Restricted material (NSFW and hidden-to-guests, though we are only interested in the former) is entirely made so, as far as I (OrIdow6) can tell, through client-side hiding; this includes metadata as well as media. There is apparently no way to mark individual submissions as hidden-to-guests, only an entire accounts' content.https://hackint.logs.kiska.pw/archiveteam-bs/20220320#c314214
Estimated size, of submissions audio and images, is between 114 and 203 GiB (95% confidence interval).
CNET

CNET is a major technology news and review website. Since its founding in 1994, it has changed its parent company several times.CNET – Wikipedia
When "CNET UK" was merged into the main "CNET TV" entity, the social media channels of "CNET UK" were taken down. The Twitter account was set to private, and all YouTube videos were made unlisted, which in turn lead to them becoming private in YouTube's purge of all unlisted videos from before 2017.https://twitter.com/cnetukhttps://www.youtube.com/user/cnetuk/aboutiPhone 5 vs Samsung Galaxy S4 destruction test by CNET UK (unlisted as of August 2016, private since July 2021)
The CNET Forums with reportedly over half a million forum topics ceased operations in early 2021 after a read-only period since December 2020.
It appears that product pages with specification sheets and more importantly user reviews have been purged in September 2021. For example, here is a 2015 archive of the specification sheet of an apparatus, with a "user reviews" link on the page. As of January 2022, a giant red "404" appears on screen. See more here – apparently someone noticed the purge in September 2021 and rescued as much as possible from Google Cache.
== References ==
CNET Forums

CNET Forums were part of the popular CNET online magazine. According to its own numbers, there were over 530k forum topics.
== Shutdown notice ==
Thank you for being a valued part of the CNET community. As of December 1, 2020, the forums are in read-only format. In early 2021, CNET Forums will no longer be available. We are grateful for the participation and advice you have provided to one another over the years.
Thanks,
CNET Support
== Archives ==
* Complete qwarc archive of forum and thread pages (no images etc.) by User:JustAnotherArchivist: 
* Incomplete ArchiveBot crawl:
CSGO Lounge

CS:GO Lounge is a site which numerous Counter-Strike: Global Offensive players list items they want to trade for something else, similar to the likes of Craigslist. It also provides item betting on select pro matches, the latter of which presumably makes up a significant part of its traffic.
== Vital signs ==
Not terribly likely to go away due to it being a household name in the CS:GO community, unless Valve were to cave to calls from some to crack down on the item betting part of the site. UPDATE: THEY DID: https://store.steampowered.com/news/22883/
As a result of Valve's crackdown, both Lounge sites' betting areas have since shifted to being a general pro match tracker, but without the betting.
== URL Structure ==
Profiles: 64-bit Steam ID used, such as "profile?id=76561198040048374".
Trades: increments by 1 for each new trade made, such as "trade?t=90024860". Older trades will instead have "oldtrade?t=<xyz>", this currently encompasses everything under 40000000, anything that is 40000000 and above uses "trade?t=<xyz>".
Match pages: increments by 1 for each new match posted, such as "match?m=5962". Older matches will instead have "oldmatch?m=<xyz>" like trades, currently encompasses 2600 and under, everything 2601 and over uses "match?m=<xyz>".
A theoretical pain point in archiving would be handling comments on the match pages, which are handled through Disqus. Otherwise, ArchiveBot should be able to easily chew down on it.
== See also ==
* Dota 2 Lounge
Category:Video games
CTGP-R

CTGP-R (aka Chadsoft; previously CTGP) is a mod for Mario Kart Wii. While the mod itself is easily downloaded (as is every single update made), there is also an extensive ghost database with over four million ghosts. A normal web crawl would not work correctly as it uses XHR to load the leaderboards.
There is a web client in addition to the Wii client. The web client uses XHR to fetch JSON.
Example URLs: 
200cc DS Yoshi Falls fast time leaderboard: https://chadsoft.co.uk/time-trials/leaderboard/14/8C854B087417A92425110CC71E23C944D6997806/04.html (there is a "Load All" button at the bottom)
 200cc DS Yoshi Falls fast lap leaderboard: https://chadsoft.co.uk/time-trials/leaderboard/14/8C854B087417A92425110CC71E23C944D6997806/04-fast-lap.html (there is a "Load All" button at the bottom)
Mii profile page: https://chadsoft.co.uk/time-trials/players/1F/401154EB4C8882.html
Ghost page: https://chadsoft.co.uk/time-trials/rkgd/CF/0F/CCB3BBD6ACD5591FC092310D0373B26978A0.html
Lists of leaderboards can be found on the side box on the page.
The JSON endpoints can be found pretty easily in the Network inspector.
Any scrapers need to keep in mind that the website is hosted on a residential connection, and the server isn't particularly fast. The main maintainer isn't against scraping.
== Vital signs ==
Very stable. Outages are fairly uncommon. Ghost database is slower than usual after updates. No sign of it going away any time soon. Supports itself financially with Twitch subscriptions.
The maintainer is active on Discord. Important updates from this Discord are also posted to an unofficial, community-run Twitter account.
CUE! -See You Everyday-

The mobile game CUE! -See You Everyday- announced its closure schedule on Feb. 27 2021 (Official Website, Twitter). Service will be ended on 12:00 PM JST @ Apr. 30 2021 and the game will not be accessible afterwards.
Considering the game is heavily story-focused, archiving the game assets will help players get an idea of its core content, and possibly even a fan revival project, considering the scripting was mostly in very readable JSON.
== Workflow ==
* Basic datamining reveals plain text assets crimoviemanifest and crisoundmanifest, apparently file lists for CriWare ADX 2 and Sofdec;
* Set up MiTMProxy, intercept and analyze traffic;
* CDN base address revealed to be https://cdn.cue-liber.jp/; request for master file list CustomiOSManifest.gz / CustomAndroidManifest.gz intercepted;
* Non-Criware assets seem to have a hash attached to the file names, IL2CPP reverse-engineering reveals the algorithm to be Unity's Hash128() (Sagilio);
* Datamine previously intercepted master file lists (gdzhong);
* Populate URL lists with rules (Hash128 suffixes to Unity assets, none to Cri ones) (gdzhong);
* Test the URL lists while crawling the CDN; filter out 404s and recheck link for fixing;
* URL list fixing & integration.
== Archivebot Jobs ==
iOS assets archiving: 
404 fixes for iOS assets: 
Android assets archiving: 
404 fixes, round 2: 
Master manifest archiving: , 
Article source from tenyuhuang
Category:Online Games