nyuuzyou/wikis huggingface dataset:
Gawker

Gawker is an American blog [...] focusing on celebrities and the media industry. The blog promoted itself as "the source for daily Manhattan media news and gossip." (Wikipedia)
In August 2016, following a bankruptcy filing as a result of a lawsuit, Gawker ceased operationshttp://gawker.com/gawker-com-to-end-operations-next-week-1785455712, though its website remained online. It was bought in 2018 in a bankruptcy auction by Bryan Goldberg and relaunched in 2021.
In November 2023, Gawker was acquired by Meng Ru Kuok.https://variety.com/2023/digital/news/gawker-sold-meng-ru-kuok-caldecott-music-group-1235791943/ The Gawker digital archive was not included in this purchase and all articles have been removed from the website.https://slate.com/business/2024/02/messenger-gawker-vice-media-layoffs-sites-deleted-why.html
GeoCities Torrent Patch

Geocities torrent information.
== THE GEOCITIES TORRENT PATCH ==
Somewhere deep in the months-long process of uploading the GeoCities torrent from the seeding machine, a disk failure happened and a corruption occurred. A (relatively) small number of files were corrupted, meaning that the torrent wouldn't be able to complete. Note: The original data was not lost, just the compressed files. In total, this was less than 300mb of files, but one of them was part of a much larger fileset (E-n, roughly 5gb in total), which until we've tested just swapping out the file, should be assume to be non-functional. 
A new set of files are being compressed to replace these broken files, and are currently being hosted here.
The original torrent link on piratebay.org: http://thepiratebay.org/torrent/5923737/Geocities_-_The_Torrent
Category:GeoCities
GeoCities URL Lists

* swebb's current url list: http://badcheese.com/~steve/ALL-GEO-SEEDS-20090730.txt.bz2 (259M) Same url list that archive.org is using
* sods list : - over 700,000 unique GeoCities sites (not pages), I don't have the ability to download them, hopefully some of the downloaders can make use of this.
(Probably no real use for these anymore, but they'll be good historical references for anyone interested.)
* Geocities biglist
Category:GeoCities
GeoNames

The GeoNames geographical database is a database of country, city, town and landmark names. The database can be actively searched. Any result can be viewed in Google Maps and a list of Wikipedia entries related to the location.
== Archive ==
* (2020-06-20)
== See also ==
* List of geographic databases
== External links ==
* http://www.geonames.org
* http://download.geonames.org/export/dump/
Geograph Britain and Ireland

The Geograph Britain and Ireland project aims to collect geographically representative photographs and information for every square kilometre of Great Britain and Ireland.
As of August 2016, 12,585 contributors have submitted 5,039,791 images covering 275,835 grid squares, or 83.1% of the total.
==Archives and mirrors==
* The Internet Archive has a mirror of some Geograph data and images (incomplete)
* The British Library's UK Web Archive initiative preserves snapshots of Geograph from time for its historical significance.
* A substantial number of the images (a little less than half) have been copied to the Wikimedia Commons.
All photographs and descriptions are under a Creative Commons Attribution-Share-Alike licence, so it's likely that the images have been copied to many other places, too.
==Vital signs==
Stable, with sufficient stable mirrors and archives to be considered safe for now.
== External links ==
* Database dumps
* Image dumps (torrents)
* Source code
Category:Image hosting
Geometry Dash

Geometry Dash is a video game with a lot of user-created content.
== Archival info ==
The admin/developer of the game has specifically said on the official Discord server that he doesn't mind bots, but they will be IP-banned if they go too fast due to performance issues. Spambots are also banned ASAP, of course.
The internal API is terrible. Incomplete community-made API documentation can be found at docs.gd-programming.org (slightly more complete documentation is on the site's github repo - but this is still far from complete).
Songs are hosted on Newgrounds, except for some songs important to the game's community that got removed from Newgrounds (which are hosted on Geometry Dash's servers).
Gfycat

Gfycat is a user-generated content short video hosting company founded by Richard Rabbat, Dan McEleney, and Jeff Harris. As of May 2020, the site is owned by Snap Inc., makers of the Snapchat app. It was a pioneer of the video alternative to GIF. On , the site's TLS certificate expired, rendering it inaccessible unless HSTS and certificate verification are manually disabled by the client. On or , a notice was added to the homepage announcing that Gfycat would shut down on .
== November 2019 deletion ==
On they announced on Twitter and Reddit that they are removing some old and unpopular content on . After ArchiveTeam started working on the archival, Dan McEleney accused ArchiveTeam of a DDoS attack and threatened with legal action on . We were able to work with the Gfycat team afterwards and managed to archive all affected ~19.1 million uploads (to the degree that they were archivable, as the list also included IDs that always resulted in 403 errors on trying to retrieve the files, which according to Dan has been the case for a long time due to failed uploads).
== 2023 shutdown ==
The following notice was added to the homepage on or :
The Gfycat service is being discontinued. Please save or delete your Gfycat content by visiting https://www.gfycat.com and logging in to your account. After September 1, 2023, all Gfycat content and data will be deleted from gfycat.com
== Technical notes ==
* Gfycat has an API, which is documented at .
* Uploads use an ID made up of two adjectives and one animal name; the two lists are published and , respectively, though not all entries appear to be in use as of November 2019.
** There are some collisions in the adjective combinations. Gfycat used to have the IDs capitalised as AdjectiveAdjectiveAnimal, but this was changed to a lower-case adjectiveadjectiveanimal in some places (e.g. on the website, but not internally for the files). Adjective combinations like grim+yearly and grimy+early may therefore partially collide. A full list of potential collisions can be found at , though because not all adjectives are in use (see above), only four of these are actually possible as of Nov 2019: Grim+Yearly/Grimy+Early, Slim+Yearly/Slimy+Early, Firsthand+Some/First+Handsome, and Secondhand+Some/Second+Handsome.
Category:Video hosting
Ghostbin

Ghostbin was a service intended for sharing code, as of there were approximately 644000 pastes. In December 2018 the owner announced that it would be shutting down or changing drastically in February. Sometime between and there was a notice posted on the site saying that it will be shutting down in May 2019. The site was made read-only on and disappeared after late August 2019. Since September 2020, the site is operational again with a different code, no old pastes, and presumably a different owner.
== External links ==
* https://github.com/bigshebang/ghost_scraper
== References ==
Gifninja

Gifninja was an online GIF making and sharing site which allowed users to compose animated GIFs from multiple still images, and to upvote, downvote, and comment on GIFs. Submissions could be sorted by most recent, and by vote and view counts for a day, week, and month. The site operated since the mid-2000s until late 2013, with the final Wayback capture of the site being live being from October 19th that year.2006-09-01, 2013-10-19 Some GIFs have been archived by the Wayback Machine.http://web.archive.org/web/20120329172232/http://gifninja.com/animated-gifs/729184//hurr-durr-dog The percentage of saved and lost GIFs is currently unknown.
Gigaom

Gigaom was a tech blogging company. The blog offered news, analysis, and opinions on startups, emerging technologies, and other technology related topics.
On March 9, 2015, Gigaom announced that they had ceased operations. On May 26, 2015, Knowingly Corp announced that they had acquired Gigaom.com and would "relaunch the site on August 15, 2015."https://gigaom.com/2015/05/26/gigaom-com-acquired-by-knowingly-corp/
== Shutdown announcement ==
Mar. 9, 2015 - 5:57 PM PDT
A brief note on our company
Gigaom recently became unable to pay its creditors in full at this time. As a result, the company is working with its creditors that have rights to all of the company’s assets as their collateral. All operations have ceased. We do not know at this time what the lenders intend to do with the assets or if there will be any future operations using those assets. The company does not currently intend to file bankruptcy. We would like to take a moment and thank our readers and our community for supporting us all along.
— Gigaom managementhttps://gigaom.com/2015/03/09/about-gigaom/
== Archives ==
Gigaom websites and various subdomains were thrown into ArchiveBot:
* gigaom.com
* about.gigaom.com
* accounts.gigaom.com
* events.gigaom.com
* go.gigaom.com (not fully archived)
* research.gigaom.com
* search.gigaom.com
* support.gigaom.com
* techjobs.gigaom.com
* gigaom.libsyn.com] (podcasts)
* Gigaom on SoundCloud (podcasts)
* [ Gigaom on SoundCloud (comments and metadata)
== References ==
== External links ==
*
Giphy

Giphy is a GIF sharing site. It was acquired by Facebook (now Meta) in May 2020.https://news.knowyourmeme.com/news/facebook-to-buy-giphyhttps://reclaimthenet.org/facebook-giphy-sale-privacy/ Apparently, it was to have been assimilated into Instagram.https://about.fb.com/news/2020/05/welcome-giphy/https://medium.com/@giphy/giphy-to-join-facebook-as-part-of-the-instagram-team-e7ea8d32d7b6
In October 2022, the UK's Competition and Markets Authority ruled that Meta must divest itself of Giphy, which Meta has agreed to do after a lengthy battle in which the CMA initally ruled it must do so in November 2021, and a failed attempt to appeal its decision in June 2022.https://www.cnbc.com/2022/10/18/facebook-parent-meta-ordered-to-sell-giphy-by-uk-competition-regulator.html As of late February 2023, Giphy has yet to be sold or spun off.
== References ==
GitHub Downloads

As posted on the Internet Archive details:
In December of 2012, the social code-sharing website GitHub announced that they would no longer be allowing uploads of "just files" into repository-affiliated "download" sections on their 3.7 million current repositories. This feature was used for a variety of purposes, including providing pre-compiled binaries, support documentation, and other contextual items related to the code being hosted. The decision was described by GitHub this way:
Goodbye, Uploads
In addition to providing downloadable source code archives, GitHub 
previously allowed you to upload files (separate from the versioned files)
in the repository, and make it available for download in the Downloads Tab.
Supporting these types of uploads was a source of great confusion and
pain – they were too similar to the files in a Git repository. As part of
our ongoing effort to keep GitHub focused on building software, we are
deprecating the Downloads Tab.
The ability to upload new files via the web site is disabled today.
Existing links to previously uploaded files will continue to work for the
foreseeable future.
Repositories that already have uploads will continue to list their downloads
for the next 90 days (tack on /downloads to the end of any repository to
see them).
The Downloads API is officially deprecated and will be disabled in 90 days.
GitLab

GitLab is an open-core and git-based software forge which calls itself a DevOps platform. There is a large public instance as well as many independently-run small ones. Gitlab.com is an instance of the forge hosted by GitLab Inc., a publicly listed company. Thousands self-hosted forges exist, relying either on the open-source licenses or on the paid licenses for the proprietary editions and support.
== Vital signs ==
Early August 2022, GitLab (the main instance) apparently made plans to delete repositories created on free accounts that had been inactive for more than a year, in order to decrease their hosting costs.https://www.theregister.com/2022/08/04/gitlab_data_retention_policy After people complained, GitLab announced that they instead going to address the old-repository problem through internal technical measures.https://twitter.com/gitlab/status/1555325376687226883
== Discovery ==
Repositories have numerical IDs. They can be used through https://gitlab.com/api/v4/projects/{id}.https://hackint.logs.kiska.pw/archiveteam-bs/20220804#c324451 Assuming that the ID of the most recent project is the highest, somewhere between 4% and 13% of IDs have projects at them (95% confidence interval).Quick sample; "most recent" ID from tech234a, see the IRC logs
== Data portability ==
GitLab can import projects from GitHub, Bitbucket Cloud, GitLab exports, Gitlab.com, FogBugz and Gitea. The import is needed in particular for the data which is not in the git repository itself, like issue reports.
Such import capabilities are available for example on https://framagit.org/ .
== Archiving ==
Software Heritage and Codearchiver can be used to save the code on GitLab instances. ArchiveBot can save the non-code parts, but a lot of ignores are needed. The API path https://gitlab.example.com/api/v4/projects can be used to determine if there are public repos or not.
== References ==
== External links ==
* https://wiki.softwareheritage.org/wiki/Code_hosters
Gitter

Gitter is an open source chat system mostly used by FOSS projects and communities.
In March 2017 it was acquired by GitLabhttp://blog.gitter.im/2017/03/15/gitter-gitlab-acquisition/https://about.gitlab.com/blog/2017/03/15/gitter-acquisition/. In September 2020 it was acquired by Element, the company responsible for Matrixhttps://element.io/blog/gitter-is-joining-element/https://about.gitlab.com/blog/2020/09/30/gitter-moves-to-element/. The Gitter ecoystem is being migrated to the Matrix networkhttps://matrix.org/blog/2020/09/30/welcoming-gitter-to-matrixhttps://blog.gitter.im/2020/09/30/gitter-element-acquisition/.
There are static HTML pages of rooms available at gitter.im/{group}/{room}/archives. Each date has an individual page (for example, https://gitter.im/gitter/gitter/archives/2013/12/04).
== Archiving == 
* https://github.com/minrk/archive-gitter
* https://github.com/boneskull/gitter-export-room
* https://github.com/jbarth-ubhd/download-gitter.im-chat
== External Links ==
* https://developer.gitter.im/
== References ==
Category:Social networks
Glottolog

Glottolog provides a comprehensive catalogue of the world's languages, language families and dialects. It assigns a unique and stable identifier (the Glottocode) to (in principle) all languoids, i.e. all families, languages, and dialects.
== Archive ==
* https://glottolog.org/ - 
* https://github.com/glottolog/glottolog - 
== External links ==
* https://glottolog.org/
Category:Languages
Gmane

Gmane is a mailing list archive & email-to-news gateway for a whole lot of free software mailing lists (and other mailing lists as well). It's been running since 2002, with 14,920 mailing lists & a total of 155,913,672 messages in the archive, as of October 2015.
On July 28, 2016, Lars Magne has declared that he may shut down the web servers, but he has stated he is willing to deliver the database and control of the gmane.org domain to any interested parties.
== Possible closure ==
== Possible leads ==
List of mailing lists hosted here
Goo.gl

goo.gl is Google's URL shortener. It will shut down on .
== Shutdown timeline ==
* : Google announces the deprecation of goo.gl and the transition to a new platform (Firebase Dynamic Links).
* : Anonymous users and people who haven't used the shortener before can no longer create new shortlinks.
* : No new shortlinks can be created anymore. Existing shortlinks continue to resolve.
* : The timeline for full shutdown is announced.
* : An interstitial page is beginning to roll out, warning users that the links will be broken in the future.
* : The service will be shut down.
== References ==
Google Answers

Google Answers was Google's attempt at a Q&A site, launched in April 2002. It wasn't as popular as they had intended, so it was closed to new activity on December 2006. Google still has an archive available, and it should probably be backed up before it disappears for good.
Archive Team's RichardG saved a copy for posterity. You can find it over at the Internet Archive.
Category:Q&A
Category:Google
Google Baraza

Google Baraza (also known as Google Questions and Answers) was a Q&A service designed to replace Google Answers. It later shut down on June 23, 2014, and left a public archive behind. This archive was scheduled to be deleted on April 30, 2015, and was actually removed some time in May 2015.
== Site structure ==
*http://www.google.com/baraza/en/thread?tid=009241deff6deee3
**http://www.google.com/baraza/en/fhistory?fid=009241deff6deee30004a4ecdc10793e (history for an individual post)
*http://www.google.com/baraza/en/label?lid=6bb539a0d62b5bf7
*http://www.google.com/baraza/en/user?userid=09917256578240167148
*http://www.google.com/baraza/en/labelusers?lid=2ba73dfbe84c4940
*the following pages can be (ab)used for discovery:
**http://www.google.com/baraza/en/topics DONE
**http://www.google.com/baraza/en/labels DONE
**http://www.google.com/baraza/en/users DONE
**individual user and label pages can be used for discovering threads, individual thread pages can also be used for discovering users TODO (likely as a warrior project)
*unique content is located at google.com/baraza/en/, google.com/baraza/fr/, and otvety.google.ru/otvety/
**all sites have the same structure
== Archiving report ==
It got thrown into ArchiveBot ( & (en), Russian and French jobs don't exist).
May need to be a warrior job as SimpleBrain has been getting redirect login messages.
Warrior project started on 2015-04-25, ArchiveTeam downloaded the content in a few days.
== Archives ==
https://archive.org/details/googlebaraza
Category:Google
Google Books

Google Books is a Google service providing access to books. Books may be from its modern Google Play book marketplace; or scanned and OCR'd by Google and available because it is in the public domain; or scanned and OCR'd but withheld from public viewing because it is either still in copyright () or was evaluated incorrectly.
Scanned books are shared with HathiTrust. () Books that are incorrectly withheld can be released if disputed. () Bad scans can be reported (for example, if the straightening algorithm produced a wobbly disaster), and they will be fixed if possible (meaning that Google has master scans that are not public). ()
Google Books will challenge you with a classic Captcha if you click on more than one download PDF or EPUB link within a short time frame.
The legacy Google Books viewer (sporadically replaced since 2021 with an inferior "modernized" viewer) has a dropdown menu in the top left and top right for OCR EPUB download (), PDF download, and OCR text view (, top right only).
Category:Google
Google Books Ngram

Google Books Ngram is a Google Labs service that allows a person to scan Google's book database under several categories or "corpus"es (an example of a corpus being "American English", "British English", "French", et cetera) for specific words or phrases, and displays the percentage amount of said phrases' appearance in a line graph.
== Vital Signs ==
Stable. The Internet Archive keeps a public archive of the datasets (note, this is currently access restricted)
== External links ==
* https://books.google.com/ngrams/
* https://storage.googleapis.com/books/ngrams/books/datasetsv3.html
Category:Google
Google Business Sitebuilder

A website hosting service by Google for businesses in Africa and parts of Asia. Shutting down on .
== Shutdown notice ==
Q. What are the timelines for the change?
Google Business Sitebuilder websites for users who signed up through the any of the following programs, will stop being visible to visitors on : Get Nigerian Business Online program, the Getting Kenyan Businesses Online program, the Getting African Businesses Online, the South Africa Woza Business Online, the Get Malaysian Business Online, and the Bisnis Lokal Go Online.
You will still be able to log in to your Google Business Sitebuilder admin account, to retrieve photos and text if you wish to move them to a different website tool, at least until .https://support.google.com/businesssitebuilder/answer/6098405
== Site structure ==
Sites exist as subdomains of the following domains:
* bisnisgoonline.co.id
* gnbo.com.ng
* indiagetonline.in
* kbo.co.ke
* getafricaonline.com
* getmybusinessonline.com.my
* wozaonline.co.za
=== Items ===
* Google scrape
* Bing scrape
* Twitter scrape
* MediaWiki scrape
* Common Crawl scrape
* URLTeam scrape
== References ==
Category:Google
Category:Web hosting
Google Fusion Tables

Google Fusion Tables was "an experimental data visualization web application to gather, visualize, and share data tables."https://support.google.com/fusiontables/answer/2571232?hl=en.
Google Fusion Tables is no longer be available since December 3rd, 2019. This includes all access to the table data and visualizations for the tablehttps://support.google.com/fusiontables/answer/9185417. By default, tables are exposed publically, however, without a link they are hard to discover.
== Anatomy of a table ==
The fusiontable UI has 3 tabs: Rows, Cards, and a Map (see project image).
* Rows contain all the data formatted similarly to how a google spreadsheet looks, except with some cell contents hidden
* Cards contain all the data in a print-friendly view
* Map contains a map with special filters defined in ways to make pretty visualizations
Archiving the data itself is fairly trivial, on the other hand, I'm not sure how feasible it is to archive the map visualization.
== Archiving a table ==
A Table consists of several rows of data, which can easily be exported (along with metadata) as a zip file as long the creator did not make export function private.
So far, there seems to be 3 "categories" of table:
* Visualization / Card and export is public -> easy to archive
* Visualization / Card is public, export is private -> May be possible using the Card / Print-friendly view
* Visualization / Card is private or invalid table id -> :(
== Adding tables to the archive ==
Fill out this form.
== Google Fusion Table archivers ==
* https://github.com/paulwalko/fuslontable: Calls the export endpoint. If export fails table id is added table error file otherwise data zip file is created.
== References ==
Category:Google