nyuuzyou/wikis huggingface dataset:
No Agenda

No Agenda is a podcast hosted by Adam Curry and John C. Dvorak and takes place twice a week on Thursday and Sunday mornings. The show is a conversation on recent news and media memes.
==Links==
* Official website
* "No Agenda" permanent torrent backup archive on GitHub - magnet for episodes 1-500
* "No Agenda" permanent http backup archive
* Text summaries of No Agenda episodes by K8TIY
* No Agenda Player - Annotated Web Player & Search for the Show
Nokia Memories

Shutting down on January 12, 2015.
== Shutdown notice ==
FAQ - What happens to my cinemagraphs at memories.nokia.com after 12 January 2015?
All data stored at memories.nokia.com will be deleted as a part of the online service ramp-down taking place on 12 January 2015. Please check your previously shared cinemagraphs in the Shared view in Lumia Cinemagraph prior to 12 January. All locally stored cinemagraphs will remain intact on your phone in the Album view (Saved view) of Lumia Cinemagraph after 12 January.http://www.nokia.com/ca-en/support/faq/?action=singleTopic&topic=FA144076
== Site structure ==
*http://memories.nokia.com/en/images/c52a6cc0-8193-435d-b2c5-e34431f53b07 (the ID for the main item is different than that of the jpg/gif/mp4)
**http://media.memories.nokia.com/media/5e28f7a2-eef0-40cc-b800-b12186b8a2ae_430x768.jpg
**http://media.memories.nokia.com/media/5e28f7a2-eef0-40cc-b800-b12186b8a2ae.gif
**http://media.memories.nokia.com/media/5e28f7a2-eef0-40cc-b800-b12186b8a2ae.mp4
===Crawls===
*Combined Google/Bing crawl
*URLTeam crawl
*Crawl reddit.com/domain/ for memories.nokia.com and media.memories.nokia.com: 140 urls.
*Twitter crawl for 'media.memories.nokia.com' raw Tweets (284).
*Twitter crawl for 'memories.nokia.com': raw Tweets (22317)
** Processed URLs (memories.nokia.coma and media.memories.nokia.com)
== Archiving report ==
ArchiveTeam saved ~21,000 cinemagraphs (175 GB) on 2014-12-30, in just two hours.
== Archives ==
* https://archive.org/details/archiveteam_nokiamemories_20150119143518
* https://archive.org/details/archiveteam_nokiamemories_20150119143410
* https://archive.org/details/archiveteam_nokiamemories_20150119143624
== References ==
Category:Nokia
Category:Image hosting
Nokia Trailers

Nokia Trailers is, as its name would suggest, a trailer website. Shut down on January 2, 2015.
== Shutdown notice ==
Thank You!
Dear friends, Nokia Trailers will close services on 31st of December 2014. You can try Xbox Video app which brings the latest movies and TV shows to your Windows Phone 8.1 and makes it easy to watch what you love wherever you are.
== Site structure ==
Some trailers are on www.nokiatrailers.com and some are on staging.nokiatrailers.com. The trailers on www.nokiatrailers.com use JWPlayer, whereas the trailers on staging.nokiatrailers.com link directly to the video.
* http://www.nokiatrailers.com/trailer/_fD6YIb-ErQ (11 characters, alphanumeric with dashes and underscores)
** http://solutions.futurice.info/xa/files/get/trailer_movie_image/344_default_2afc1697b84a4cbc89fb77d28a01aa4b?info_platform=Flash+Player&info_timestamp=1417663157158&info_token=82e1ba8e0df7111aef87ecdc6c0a8d2cdee552fc (small poster)
** http://solutions.futurice.info/xa/files/get/trailer_trailer_video/344_651_default_b951b46942061ca6c643342d277e1dd6?info_platform=Flash+Player&info_timestamp=1417663488987&info_token=b079afe0c9a6cc92f2965f5e9e1bcddb623ba758 (redirects to the url below)
*** http://s3.amazonaws.com/xa-cdn-production/TRAILER_TRAILER_VIDEO/344_651_default?AWSAccessKeyId=AKIAIKLCII45X7XARDPA&Expires=1417663481&Signature=Vl3Vo8928SeJj%2BFK6MtLRNoETL8%3D (trailer)
* http://staging.nokiatrailers.com/trailer/ajxdxN3XKKU (11 characters, alphanumeric with dashes and underscores)
** http://solutions-staging.futurice.info/xa/files/get/trailer_movie_image/62_default_88b0f7a84f130e9f3f06846ca2844a24?info_platform=Flash+Player&info_timestamp=1417662770658&info_token=0d76a2a21da996510f2244b9502d4165e71391da (small poster)
** http://solutions-staging.futurice.info/xa/files/get/trailer_movie_image/62_large_bb6112244addba8e1414dfbf307342cf?info_platform=Flash+Player&info_timestamp=1417662770628&info_token=e2faabe7c3d8aa8078de3ea109523b7d0b2e6cf1 (large poster)
** http://solutions-staging.futurice.info/xa/files/get/trailer_trailer_video/62_78_default_a73bf739b814a0af045259c031bd34f7?info_platform=Flash+Player&info_timestamp=1417663387329&info_token=9da78fe889eb316fb206a92b579076d112390cb8 (redirects to the url below)
*** http://s3.amazonaws.com/xa-cdn-staging/TRAILER_TRAILER_VIDEO/62_127_default?AWSAccessKeyId=AKIAIKLCII45X7XARDPA&Expires=1417663527&Signature=Gp%2BXST6bnqnH2zV3kdBloHhxeU0%3D (trailer, there can be more than one)
===Crawls===
*Google crawl
*Twitter crawl: raw tweets
**Filtered URLs
==Archives==
*ArchiveBot grabbed 8.4 GB of Nokia Trailers. The archives can be found here. (look for items named urls-raw.githubusercontent.com-nokia_trailers_twitter_google_crawl.txt-inf-20150101-000116-9v6ly)
Category:Nokia
Category:Video hosting
Nolblog.hu

Nolblog.hu was a blogging platform, primarily for readers of the leftist Hungarian newspaper Népszabadság. As of January 2016, it hosted more than 3000 blogs.
On December 31, 2015 Mworks Print Zrt. announced that nolblog.hu would be discontinued on January 31, 2016.
The site got cut off at 00:28 CET on February 1, 2016, but came back online about 8 hours later, and was finally shut down on February 2 in the afternoon.
The above applies for the *.nolblog.hu subdomains, hosting the individual blogs. The nol.hu/nol_blog main page (that is and has been the destination of the redirect from nolblog.hu) has been restructured, and now shows entries of the most popular users of the old Nolblog, so they could keep on blogging. For the other users, however, the line has been cut.
Mediaworks did not tell the reason for the shutdown. The site was not used by many people, was not really updated in the last years, but there were often harsh conflicts between the users, causing need for the administrators to intervene. Also, there were no ads on the site, so running it was probably lossy.
Users consisted mainly of elderly people, forming a basically good community.
The site provided exporting. The exported blogs may be imported to other blogging platforms.
== Archiving ==
user:bzc6p saved the blogs. However, some of the users deleted all their articles in the last days, so some content may be missing from the archives.
Archive files in WARC format can be found here: https://archive.org/details/nolblog_hu_2016_01
== Record ==
It is not the first shutdown done by Mediaworks: they discontinued the NolTV service on June 30, 2015 – it was a video hosting service, mainly used by Népszabadság Online, but they had been using YouTube for their videos lately, so they did not find it important to keep the site up.
On October 8, 2016, Mediaworks suspended both the print and online issue of Népszabadság, as they found its business model unsustainable. As of that date, all content (news) was deleted from their website, and only a press release is shown on the main page.
:"Despite revenue growth and management’s cost-cutting measures, Népszabadság has so far been unable to achieve economic success, and management’s priority must be to resolve this, finding the best future business model. [...] In order to achieve and concentrate fully on this priority task, all operations of Népszabadság (including print and online) will as of today be suspended until the new form is decided and can be implemented."http://web.archive.org/web/20161008112021/http://nol.hu
== Source ==
http://hirkut.hu/index.php/vege-februarban-megszunik-a-nolblog/
Noob.hu

noob.hu was a popular Hungarian one-click image-sharing service. It started in 2007 (?), and soon became popular – users admired its speed, easy handling, and reliability (not deleting pictures).
However, in 2012, they suspended their operation for some months, and after that, they placed a message on the website that the site had been closed. The images are still available, though.
== Site structure ==
Image URLs (since 2009): noob.hu/<YYYY>/<MM>/<DD>/<FILENAME>.<EXT>, where YYYY-MM-DD is the upload date.
Thumbnails: noob.hu/<YYYY>/<MM>/<DD>/tn/<FILENAME>.<EXT>, where YYYY-MM-DD is the upload date.
There seem to have been an older system (dating back to 2007) with the URL structure noob.hu/<YY>/<MM><DD>/<FILENAME>.<EXT>, but those pictures seem to be unavailable now.
== Archiving status ==
Unfortunately, robots.txt prevented Wayback Machine (and even Google) from scraping the site.
user:bzc6p has saved the pictures for which he could find links on the internet.
== Archives ==
~13,500 pictures from 2009-07-22 to 2012-07-26, what could be discovered, with corresponding thumbnails: https://archive.org/details/noob_hu_images, in two batches (WARC files), 6.8 GiB total.
Category:Image hosting
North Korea

=== Domains and subdomains ===
* List in Wikipedia
=== Movies ===
* DPRK Cinema
* DPRK Movies Complete List English By Year
* Elufa TV
* North Korean Movies (Complete list)
* http://northkoreanfilms.com/
=== Music ===
* DPRKconcert
* DPRK Music Fan (closed)
* DPRK Music
* MANGYONGBONG92
* Moranbong Band HD
* NK Media
* Takenakanim
=== Other ===
* DPRK Now
* sdmedianet
Notepad.cc

Yet another pastebin, from the website's about page:
notepad.cc is a service by Jacob Bijani
It was closed some time after the official deadline (February 1st, 2016)
=== Items ===
Items are in the format:
 http://notepad.cc/ITEM
or
 http://notepad.cc/share/ITEM
* Google achip scrape
* Bing achip scrape
* DuckDuckGo - No Results
* TODO: Scrape Yandex
* TODO: Scrape Baidu
* TODO: Scrape Twitter
* Reddit achip scrape
* TODO: Scrape links from MediaWiki wikis
* Open Directory Project - No Results
* Scrape the Common Crawl Index: index server results
* Wayback Machine achip scrape
* URLTeam dumps scrape1
* TODO: Scrape a list of subdomains from DNSdumpster.com (if applicable)
* TODO: Scrape a list of subdomains from pentest-tools.com (if applicable)
* Suggestion: Scrape google (and other search engines) for possible passwords
=== Project Status ===
Partially saved, 223 MB compressed WARC on archive.org. There's no information on how complete this grab is.
Nupedia

Nupedia was the predecessor of Wikipedia, an expert-written encyclopedia. It was online from March 2000 until September 2003. At the time of its closure, there were 24 finished articles on Nupedia with many more being made.
== Backup ==
Wayback Machine:
* Main Site
* CVS Web
* Download old snapshots
== Vital signs ==
Dead.
== See also ==
* Wikimedia Commons
* Wikia
* Wikis
* GNUPedia
* Wikipedia
* Citizendium
== External links ==
* http://nupedia.com
Category:Wikis
Nwnyet

== The story ==
Over the years UK ISPs have been bought and sold so many times trying to keep track is a mess. Someone decided it was time to delete pages from the 1990s so http://www.telinco.co.uk and http://www.nwnet.co.uk/ and the user pages they host are being deleted.
== The Plan ==
We are searching for links to these sites by going through the common crawl corpus, wayback machine, google, and bing. In addition, brute force methods are being employed for url discovery.
* The found urls are on our etherpad
* telinco.co.uk subdomain list
The collected urls were downloaded using wget and uploaded to 3 items on the Internet Archive.
Category:ISP hosting
OWASP

OWASP (Open Web Application Security Project) is a worldwide not-for-profit charitable organization focused on improving the security of software.
As of 2019, OWASP is in the process of dismantling most of its online presence.
== Mailing lists ==
Mailing lists were shut down in early 2019. Some were migrated from mailman to Google Groups. HTML archives were kept (scroll down past the initial splashscreen).
== Website ==
Since at least 2006, the wiki https://www.owasp.org/ has been the main web presence of OWASP.
During 2019 it was announced that the wiki would be shut down. According to a mailing list discussion, only part of the pages will be migrated: "After your chapter or project page is done, there is a www-community repository which would include any files from the wiki that are not currently in a project or chapter or board/staff policy area", but it seems that the OWASP foundation itself will only "Ensure top 500 pages are migrated".
A list of URLs was shared.
Category:Wikis
Obsidian

Obsidianhttps://obsidian.md/ is a note taking app using markdown files for the text backend. Its focus is on networked notes accessible via links.
== Published Notes ==
Obsidian offers a paid service to generate and publish sites based on a user’s selected noteshttps://obsidian.md/publish. These pages are then shared on https://publish.obsidian.md/username/, like for example: https://publish.obsidian.md/test/.
=== Archiving ===
Those published pages almost completely consist of Javascript, so Archivebot will not be able to discover all pages published by that user when grabbing https://publish.obsidian.md/username/.
However, each user has its own sitemap in its directory, listing all the notes they published. This means Archivebot will be able to grab a user’s pages when using https://publish.obsidian.md/username/sitemap.xml as entry point. This will grab the embedded resources and outlinks as well, and even the Markdown files behind the pages.
Occupy movement

The Occupy Movement is an international movement originating in the United States demanding greater freedom, substantial reversal of the maldistribution of wealth within every country, and an end to corporate-controlled politics. It draws inspiration from the Arab Spring, the 2011 tent protests in Spain, Israel, and elsewhere, and has seeds in the Hoovervilles of the Great Depression, and, some have argued, the Schoemehlville politically-inspired homeless encampment of St. Louis in 1985.
The movement has no official website. However, one website that many Americans recognize as a great resource and record for Occupy Wall Street is:
http://occupywallst.org
The various local and national Occupy branches generally have their own websites, Facebook pages, Twitter feeds, etc.
==Some places we might start at as far as the archival process==
* Recorded Livestream footage
* Photographs of protest signs
* Minutes from General Assemblies and Working Group meetings
* The various Occupy websites
==External Links==
*OWS YouTube Archive
*Internet Archive's OWS mainpage
*occupyarchive.org
*Occupy Wall Street's own self-archival project (although, since the website is not technically official, neither is the archive, technically)
*Site grabs of Occupy Writers, Occupy Musicians, Occupy Filmmakers
Oceania

Oceania is a geographic region comprising Australasia, Melanesia, Micronesia and Polynesia.
== Countries ==
* Australia
* Federated States of Micronesia
* Fiji
* Kiribati
* Marshall Islands
* Nauru
* New Zealand
* Palau
* Papua New Guinea
* Samoa
* Solomon Islands
* Tonga
* Tuvalu
* Vanuatu
=== Other territories ===
* Cook Islands
* Niue
== Projects ==
Oddshot.tv

Oddshot.tv is a site that lets users create short clips of streams from various sites in an instant fashion as a stream was ongoing that users could then share. It was very popular amongst Twitch users due to its ease of use before Twitch introduced Clips. The site still remained popular as it also supported making clips from YouTube and Periscope streams where native clips aren't supported.
== Shutdown ==
On February 9th 2018, Oddshot announced it was closing down the following Monday due to the site becoming too expensive to maintain:
Oddshot has provided a platform for users to capture & discover video highlights from live streams on websites such as Twitch, YouTube, Facebook, Periscope & more for a few years now. For our lifespan, we relied solely on VC funding, which resulted in growth MoM (Month on Month) being one of our core values.
Mid 2017 the team looked into traditional methods to gain revenue to help extend the lifespan of Oddshot, however, with the growth of ad-block we quickly became aware that ads would not be feasible.
Over the last year, since introducing upload to the platform, we noticed more and more unsavory NSFW content being uploaded, which quickly became almost impossible to moderate. The frontpage in which we used to love everyday, seeing the best daily / weekly / monthly video highlights became a page we avoided and hated.
We want to thank the community who supported us over the years. I for one, have loved working on the Oddshot project & have experienced so much in a short space of time.
== Content ==
A lot of content that Oddshot hosts can be relatively easily found elsewhere. Most clips generated on the site come from tournament channels, which Twitch tends to give indefinite storage as an exception to their broadcast retention policy, and many tournaments also upload their stuff to YouTube. As Oddshot allows for making clips of any channel, there are bound to be clips that aren't as easily replaceable. The main concern when it comes to tournament streams would be link rot due to Oddshot's ubiquity before Twitch Clips.
Although the site's purpose is to host short clips as opposed to full broadcasts, a large amount of clips is still likely to result in a large amount of data. It's unknown if Oddshot uses deduplication for storage of overlapping clip content as many users will rush to make a clip of a moment they just witnessed.
Category:Video hosting
Odysee

Odysee was a service for syncing and sharing photos. Acquired by Google, shutting down February 23, 2015. Now the domain is used for a video hosting site.
== Site structure ==
TODO
* http://odysee.com/s/541/093f6d0f
** https://du6ocwh1wy27z.cloudfront.net/v2/sq?e=web&v=m&p=141421312332df3a2b70c2cd6cac90241c21c85fb4
Category:Image hosting
Video hosting websites
Old-games.com

old-games.com is a website hosting nearly 12,000 computer games from the 1980s, 1990s and 2000s.
They offer free downloading of two games per day (at 5 KB/s speed), and they have two subscription plans that offer 1 day or 30 days of unlimited downloading for a modest one-time payment.
What they do is obviously illegal, but they might avoid lawsuits as the company behind the site (San Pedro Software) is incorporated in Belize.
It is unknown whether all or any of the software provided there is genuine and working, but according to some comments of a GOG forum thread,https://www.gog.com/forum/general/is_oldgamescom_a_scam they are. Here is also suggested that the website has a copy of several titles that are not available anywhere else, including GOG, Steam or torrent sites.
So from the point of view of an archivist, this website seems to be a precious software archive.
== Related websites ==
The same company also operates old-pc-games.com and free-game-downloads.mosw.com, that are archives of mostly abandonware.
== References ==
Category:Software
OldVersion.com

OldVersion.com is an archive website which stores and distributes older versions of freeware and shareware application software. OldVersion.com was founded by Alex Levine and Igor Dolgalev in 2001.
== Vital signs ==
Very few updates in recent years (as of 2021), with no indication of activity from the site's maintainers.
==Archives==
* https://archive.org/details/oldversion.com-windows-2019-10-01
* https://archive.org/details/oldversion.com-android-2019-10-01
* https://archive.org/details/oldversion.com-mac-2019-10-01
* https://archive.org/details/oldversion.com-linux-2019-10-01
* https://archive.org/details/oldversion.com-games-2019-10-01
Olympe

Olympe was a French free webhosting service, that ceased operations on June 6, 2016.
== Shutdown ==
According to their Twitter page,https://twitter.com/OlympeNet and the notice on their websitehttps://www.olympe.in/end (as of 2016-06-05, unknown when it was published), they have had financial problems, that is the reason for the shutdown.
The detailed notice is as follows:
On June 4, the following short notice was posted on Twitter:https://twitter.com/OlympeNet/status/739083198089580544
On June 6, 2016, olympe.in disappeared, leaving no notice either on their main page or on their Twitter account.
== Archives ==
ArchiveTeam was able to discover 4,229 websites, of which 1,523 could be saved (36%), that is 3 GiB of content. This data can be found on IA in the WBM and under .
== References ==
Category:Web hosting
OpenCourseWare

MIT OpenCourseWare is a compilation of courses from the Massachusetts Institute of Technology. More than 2000 courses are available on the website. Other universities around the world publish their courses on the website, OCW is not exclusive to MIT.
The license of the courses use to be CC-BY-NC-SA, however, the website now has its own set of requirements for any courses to be posted. http://ocw.mit.edu/help/faq-intellectual-property/ has more information for the curious.
== Backup tools ==
* Wget
== Vital signs ==
Seems stable.
== Internet Archive collection ==
* https://archive.org/details/mit_ocw
== External links ==
* http://ocw.mit.edu
OpenSolaris

OpenSolaris was an open-source operating system based on Solaris.
== The News ==
Oracle is shutting down opensolaris.org and related sub domains on March 24, 2013.
Site map: http://hub.opensolaris.org/bin/view/Main/site-map/
== Subdomain List ==
* http://hub.opensolaris.org - main page and the wiki
* http://src.opensolaris.org - Source repo search site
* http://repo.opensolaris.org/ - Source repos
* http://mail.opensolaris.org - Mailman mailing lists
* http://defect.opensolaris.org - Bugzilla
* https://cr.opensolaris.org - Code reviews
* https://static.opensolaris.org - Static hosted files
== Taken offline before we started ==
* http://pkg.opensolaris.org/
* http://jucr.opensolaris.org/
* http://pkgfactory.opensolaris.org/
* http://test.opensolaris.org/
* http://bugs.opensolaris.org/
* http://poll.opensolaris.org/
== The Plan ==
Who is downloading what:
* http://hub.opensolaris.org - grabbed 2 different ways. pending upload to the IA.
* http://src.opensolaris.org - chronomex, verifying download
* http://repo.opensolaris.org/ - chronomex, verifying download
* http://mail.opensolaris.org - backed up and uploaded to the IA.
* http://defect.opensolaris.org - backed up and uploaded to the IA.
* https://cr.opensolaris.org - backed up and uploaded to the IA.
* https://static.opensolaris.org - backed up and uploaded to the IA.
OpenStreetMap

OpenStreetMap (OSM) is a collaborative project to create a free, editable map of the world.
== Vital signs ==
Stable.
== Archive ==
* Wikis: https://archive.org/details/wikiteam?and%5B%5D=openstreetmap&sin=
* osmdata collection at IA, updated daily
* 
== Mirrors ==
* Maps: https://wiki.openstreetmap.org/wiki/Planet.osm
== External links ==
* https://www.openstreetmap.org/
Category:Wikis
Category:Architecture
Category:Geography
Open Library

Open Library is an online project intended to create "one web page for every book ever published". Created by Aaron Swartz, Brewster Kahle, Alexis Rossi, Anand Chitipothu, and Rebecca Malamud, Open Library is a project of the non-profit Internet Archive.
== Dumps ==
https://openlibrary.org/developers/dumps
== Attacks by publishers ==
On June 1, 2020, four major book publishers filed a lawsuit against the Internet Archive and the Open Library, stating that "IA has brazenly reproduced some 1.3 million bootleg scans of print books, including recent works, commercial fiction and non-fiction, thrillers, and children’s books"Publishers File Suit Against Internet Archive for Systematic Mass Scanning and Distribution of Literary Works, after the Open Library started its Temporary National Emergency Library in response to the Covid-19 pandemic. The Internet Archive's founder, Brewster Kahle, responded by calling the lawsuit "disappointing" and stating, "We hope this can be resolved quickly".Publishers sue Internet Archive over Open Library ebook lending
On June 10, the Internet Archive closed the NEL two weeks early, stating that they were closing it early due to the lawsuit.Temporary National Emergency Library to close 2 weeks early, returning to traditional controlled digital lending
== External links ==
* https://openlibrary.org/