DOI: 10.5281/zenodo.13377084
title: A Versioned Literature Corpus derived from Biodiversity Heritage Library hash://md5/53e144641ffded6800dea502a8bb47ed

description: THIS DESCRIPTION IS A WORK IN PROGRESS, THE CONTENT OF THIS VERSIONED CORPUS IS FINAL.

Biodiversity Heritage Library (BHL, https://biodiversitylibrary.org) contains hundreds of thousands of digital works related to biodiversity. This publications contains a versioned subset of metadata associated to specific titles (see below), covering over 10k items with references to copies of their associated pdfs. 

Included titles are:

Records of the Indian MuseumRevue suisse de zoologieBulletin of the Museum of Comparative Zoology at Harvard CollegeJournal of mammalogyProceedings of the Zoological Society of LondonArchivos do Museu Nacional do Rio de JaneiroThe journal of the Bombay Natural History SocietyProceedings of the Biological Society of WashingtonBulletin of the British Museum (Natural History) ZoologyAtti della Società Italiana di Scienze Naturali e del Museo Civico di Storia Naturale in MilanoAtti della Società italiana di scienze naturali e del Museo civico di storia naturale di MilanoBonner zoologische Beiträge : Herausgeber: Zoologisches Forschungsinstitut und Museum Alexander Koenig, BonnZeitschrift für Säugetierkunde : im Auftrage der Deutschen Gesellschaft für Säugetierkunde e.VAnnals of the Carnegie MuseumRecords of the Western Australian MuseumFieldiana. ZoologyOccasional papers of the Museum of Natural History, the University of KansasZoologischer AnzeigerProceedings of the United States National Museum
description: Files included in this publication are:

HEAD - described the signature of this literature corpus as a MD5 hash.

titles.txt - list of a the BHL titles considered in this corpus

items.txt - list of items considered in this corpus 

as well as the following files named after the content their contain using the md5 hash algorithm [1]:

3e437559b980d2e88daf3c05ec2f4d77
70f6ac67e5fffa937106e6814a3364ad
c71376e752134950cf96e1e5467ce8d5
0502e4ea67c725e22f71aef16b164303
c06de184c76c2a8a586c903a5e7ca582
4d71f93adf6d6b1ec1f06bf726318029
99cbba7ff89fed781368d2b557900bc3
45c0336103993c893d1ed56b9ddbcbd9
a28a615337c2c187a5d3286923642ad6
a250d215282393ad43494dd9de11da4a
f206133d0b42fc9126e36a30654748ec
63af62d86d0f3d4d26bfd534bf7282bb
ac44c9ac6746a9fe2babaac45ec58860
e19ad69093efab2b86c3ca04de8f95ba
53e144641ffded6800dea502a8bb47ed
a6dbf5d82868e0fece05f47c7e3a42e7
9379bb3c6b6f91b7da72231a2881dbb5
b855da1ec4dd0600c8fd736a0f413ec2
016c9f11f52e6ce67c7399a4d588c2eb
01ae1d4fc5dae07417d07ea15b1ebcbb
1fb70a2c683eb7a5545900bc6668950f
description: This part is a technical description that defines this corpus and their associated contents.

History

The (version) history of this corpus can be queried by:

preston history\
 --algo md5\
 --anchor hash://md5/53e144641ffded6800dea502a8bb47ed

to produce:

<hash://md5/53e144641ffded6800dea502a8bb47ed> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/b855da1ec4dd0600c8fd736a0f413ec2> .
<hash://md5/b855da1ec4dd0600c8fd736a0f413ec2> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/7290c3e847ed1d10e47e4fd12188b752> .
<hash://md5/7290c3e847ed1d10e47e4fd12188b752> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/3e437559b980d2e88daf3c05ec2f4d77> .
<hash://md5/3e437559b980d2e88daf3c05ec2f4d77> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/352fa9f7e46576462cf7840b2992de0d> .
<hash://md5/352fa9f7e46576462cf7840b2992de0d> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/ac44c9ac6746a9fe2babaac45ec58860> .
<hash://md5/ac44c9ac6746a9fe2babaac45ec58860> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/d86a121f36f8e6f081a20803444bc1aa> .
<hash://md5/d86a121f36f8e6f081a20803444bc1aa> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/1fb70a2c683eb7a5545900bc6668950f> .
<hash://md5/1fb70a2c683eb7a5545900bc6668950f> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/63af62d86d0f3d4d26bfd534bf7282bb> .
<hash://md5/63af62d86d0f3d4d26bfd534bf7282bb> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/b9014b0b403516b1e852748d72633c7d> .
<hash://md5/b9014b0b403516b1e852748d72633c7d> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/f206133d0b42fc9126e36a30654748ec> .
<hash://md5/f206133d0b42fc9126e36a30654748ec> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/98fbf06892fcf919bc2107446147cc4a> .
<hash://md5/98fbf06892fcf919bc2107446147cc4a> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/a28a615337c2c187a5d3286923642ad6> .
<hash://md5/a28a615337c2c187a5d3286923642ad6> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/e19ad69093efab2b86c3ca04de8f95ba> .
<hash://md5/e19ad69093efab2b86c3ca04de8f95ba> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/feb6470b553aa9e104a6d7114a424a05> .
<hash://md5/feb6470b553aa9e104a6d7114a424a05> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/a445e6eb1138710be4b93db45ab7b4a9> .
<hash://md5/a445e6eb1138710be4b93db45ab7b4a9> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/016c9f11f52e6ce67c7399a4d588c2eb> .
<hash://md5/016c9f11f52e6ce67c7399a4d588c2eb> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/a250d215282393ad43494dd9de11da4a> .
<hash://md5/a250d215282393ad43494dd9de11da4a> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/0502e4ea67c725e22f71aef16b164303> .
<hash://md5/0502e4ea67c725e22f71aef16b164303> <http://www.w3.org/ns/prov#wasDerivedFrom> <hash://md5/d268444ddf44545c53e6bf4635b3ae57> .
<urn:uuid:0659a54f-b713-4f86-a917-5be166a14110> <http://purl.org/pav/hasVersion> <hash://md5/d268444ddf44545c53e6bf4635b3ae57> .

 

Volume

The total volume of this corpus can be estimated using

preston ls\
 --algo md5\
 --anchor hash://md5/53e144641ffded6800dea502a8bb47ed\
 | preston cat\
 | pv\
 > /dev/null

to produce:

Also, the number of pdfs associated with content referenced in the corpus can be queried using

preston ls\
 --algo md5\
 --anchor hash://md5/53e144641ffded6800dea502a8bb47ed\
 | grep hasVersion\
 | grep partpdf\
 | grep -v well-known\
 | wc -l

to produce 32320 items, or over 30k tracked pdfs. Note also that out of a total of 32739 items, pdf content related to 419 items failed to be retrieved. This number can be estimated using:

preston ls\
 --algo md5\
 --anchor hash://md5/53e144641ffded6800dea502a8bb47ed\
 | grep hasVersion\
 | grep partpdf\
 | grep well-known\
 | wc -l