Signed Biodiversity Data Packages: A Method to Cite, Verify, Mobilize, and Future Proof, Large Image Corpora. hash://sha256/0154b9ddce4d2e280e627a08d1a2d42884201af6ac1ec19606e393deda57f4bb hash://md5/bae7f441cdd2648d2356b2330e4b71e8
Creators: name: Poelen, Jorrit H.
name: Best, Jason
Publisher: name: Zenodo
Year: 2023
Subjects: biodiversity informatics
herbarium
plants
image corpus

description: Access to Natural History Collections helps researchers to better understand the natural world.<br> Millions of digital images of herbarium specimens are openly available via the Internet.<br> However, using these images in a data-intensive research project raises basic questions like:<br> "How do I efficiently access, and verify, hundreds of thousands of images?", and, "How do I cite<br> a version of a large image corpus?" <br> Here, we present a method to cite, verify and mobilize such image corpora across different<br> locations and medium types. We demonstrate our method with &gt;100k images made available<br> through the Botanical Research Institute of Texas using available tools (e.g., rsync, Preston)<br> and technologies (e.g., internet, postal service). Our results show that our packaging method<br> allows the US Postal Service to transfer a packaged corpus at about 3 images/s, whereas<br> retrieving individual images via HTTP achieved a transfer rate of about 0.2 images/s. <br> Our results support that signed digital packaging of image corpora enables distributed storage<br> using readily available transfer and storage methods. In addition, our method is future proof<br> because they can be used with any digital media, including those that are not yet available. included files are: 00_Poelen_DD2023.mp4 - recorded presentation (see also https://vimeo.com/832006741) 00_Poelen_DD2023.pdf - presentation slides 00_Poelen_DD2023.pptx - presentation slides (powerpoint) 00_Poelen_DD2023_Abstract.pdf - presentation abstract. Part of: Digital Data in Biodiversity Data Conference 2023 <br> @ Arizona State University 5-7 June 2023.<br> Provenance: <pre><code class="language-bash">preston head \ --remote https://linker.bio\ --anchor hash://sha256/0154b9ddce4d2e280e627a08d1a2d42884201af6ac1ec19606e393deda57f4bb</code></pre> <pre><code>hash://sha256/0154b9ddce4d2e280e627a08d1a2d42884201af6ac1ec19606e393deda57f4bb</code></pre> <pre><code class="language-bash">preston head\ --remote https://linker.bio\ --anchor hash://sha256/0154b9ddce4d2e280e627a08d1a2d42884201af6ac1ec19606e393deda57f4bb\ | preston cat\ --remote https://linker.bio\ --anchor hash://sha256/0154b9ddce4d2e280e627a08d1a2d42884201af6ac1ec19606e393deda57f4bb\ | md5sum\ | sed 's+^+hash://md5/+g'\ | cut -d ' ' -f1</code></pre> <pre><code>hash://md5/bae7f441cdd2648d2356b2330e4b71e8</code></pre> <pre><code>preston alias\ --remote https://linker.bio\ --anchor hash://sha256/0154b9ddce4d2e280e627a08d1a2d42884201af6ac1ec19606e393deda57f4bb</code></pre> <pre><code>&lt;urn:preston:guoda:bio:Poelen_DD2023.pdf&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/56e997ea728d9276d750c837820796536e86915ca56168f035023e9e254a1f1d&gt; &lt;urn:uuid:03d88005-cb81-4c89-a5a3-6a1c0d2b2b15&gt; . &lt;urn:preston:guoda:bio:Poelen_DD2023.pptx&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/77a0a28a66dcfb335cb4a636f7b2ae0910e911e7e090a8d2b77c44647f916d2d&gt; &lt;urn:uuid:f84952cb-7a08-4acb-8066-fc94e103c073&gt; . &lt;urn:preston:guoda:bio:Poelen_DD2023.mp4&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/085ce0a06692610606f90a7f8a3be79fe2b3d8d670f7b7ad6109600e0e6af05a&gt; &lt;urn:uuid:aac8ae03-0f4c-4db3-89d6-bee1843f5124&gt; . &lt;urn:uuid:24509fda-cb15-4bf0-816a-52f8795ed9d0&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/085ce0a06692610606f90a7f8a3be79fe2b3d8d670f7b7ad6109600e0e6af05a&gt; &lt;urn:uuid:4c326c81-dfa2-460e-a544-63cc3c1dc900&gt; . &lt;https://docs.google.com/presentation/d/1EDp2PWdggttM0ZumuSED8MKEwQ_iKNgWZ4_wpFoqQaI/export/pptx&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/77a0a28a66dcfb335cb4a636f7b2ae0910e911e7e090a8d2b77c44647f916d2d&gt; &lt;urn:uuid:1869c40a-367e-46b4-b23a-079c5dfbe0fd&gt; . &lt;https://docs.google.com/presentation/d/1EDp2PWdggttM0ZumuSED8MKEwQ_iKNgWZ4_wpFoqQaI/export/pdf&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/56e997ea728d9276d750c837820796536e86915ca56168f035023e9e254a1f1d&gt; &lt;urn:uuid:fdf921ad-3dfa-4720-a49d-f5f9f7f99b0f&gt; . &lt;urn:preston:guoda:bio:Poelen_DD2023.mp4&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/2a5ae6e43b324f7faee95f5bcaa25fcf2fc19a42b60bdcf880333dcb2e4cc77e&gt; &lt;urn:uuid:c21ff7b2-1932-4cf9-afcc-1e82900f4295&gt; . &lt;urn:preston:guoda:bio:Poelen_DD2023.pdf&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/c4c1602421ec450a61417123b29d13998451ea1df885add2de807cceb3dd1278&gt; &lt;urn:uuid:e1dd4e5a-56fb-4a53-9c44-12898deb0fdb&gt; . &lt;urn:preston:guoda:bio:Poelen_DD2023_Abstract.pdf&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/ec9d5f60c62994a0c5f512c0ce54f3e0faba08b70cae454022f0be6c8455e9b0&gt; &lt;urn:uuid:fbf0c0e4-ca25-49f1-87cf-14c0bff11960&gt; . &lt;urn:preston:guoda:bio:Poelen_DD2023.pptx&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/3b581c7123f742b4d806f4c56df798dbb46f927d9f55a496b26918329a7ca627&gt; &lt;urn:uuid:2cb0e901-5019-4058-b0b7-a8b216d2e6ad&gt; . &lt;urn:uuid:a36b76d8-dc5c-490c-a4f0-4d71560922ab&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/2a5ae6e43b324f7faee95f5bcaa25fcf2fc19a42b60bdcf880333dcb2e4cc77e&gt; &lt;urn:uuid:238049a1-c722-4511-9dac-085ba3effd92&gt; . &lt;urn:uuid:0f12ad74-d270-43f2-824d-b8f445657346&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/ec9d5f60c62994a0c5f512c0ce54f3e0faba08b70cae454022f0be6c8455e9b0&gt; &lt;urn:uuid:57abcd50-04a1-4681-a109-d357b74940ad&gt; . &lt;https://docs.google.com/presentation/d/1EDp2PWdggttM0ZumuSED8MKEwQ_iKNgWZ4_wpFoqQaI/export/pptx&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/3b581c7123f742b4d806f4c56df798dbb46f927d9f55a496b26918329a7ca627&gt; &lt;urn:uuid:05b6a358-3037-4d25-9fe1-9d56cee84647&gt; . &lt;https://docs.google.com/presentation/d/1EDp2PWdggttM0ZumuSED8MKEwQ_iKNgWZ4_wpFoqQaI/export/pdf&gt; &lt;http://purl.org/pav/hasVersion&gt; &lt;hash://sha256/c4c1602421ec450a61417123b29d13998451ea1df885add2de807cceb3dd1278&gt; &lt;urn:uuid:e9b0717d-557a-404b-92af-eb3054969eeb&gt; . </code></pre>
description: In part funded by Nation Science Foundation OAC 1839201 .