cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.5281/zenodo.18335706
title: The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders - AUDIO AND EMBEDDING FILES

description: The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders - Audio and Embedding Files

This dataset contains the audio files and the embeddings for the paper "The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders" by Sauter el al. (2026). The corresponding code can be found here: https://github.com/adrian-sauter/visual_grounding_speech_analysis.

audio_files.zip contains the audio files from MALD [1] and LibriSpeech [2] that were used in our work.

fast_vgs_plus_librispeech_audioslicing.pkl.zip and w2v2_LibriSpeech_audioslicing.pkl.zip contain the embeddings for words from LibriSpeech (obtained via audio-slicing) for the FaST-VGS+ [3] and the wav2vec2 [4] model.

FULL_DF_MALD.pkl.zip contains the embeddings for words from MALD for FaST-VGS+ [3], wav2vec2 [4], GloVe [5], BERT [6], and VG-BERT [7].

 

References

[1] Tucker, B. V., Brenner, D., Danielson, D. K., Kelley, M. C., Nenadić, F., & Sims, M. (2019). The massive auditory lexical decision (MALD) database. Behavior research methods, 51, 1187-1204.

[2] Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015). Librispeech: an ASR corpus based on public domain audio books. 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 5206-5210.

[3] Peng, P. & Harwath, D. (2022). Self-supervised Representation Learning for Speech Using Visual Grounding and Masked Language Modeling. Proceedings of the AAAI Symposium on AI for Speech and Audio Processing.

[4] Baevski, A., Zhou, Y., Mohamed, A., & Auli, M. (2020). wav2vec 2.0: A framework for self-supervised learning of speech representations. Advances in neural information processing systems, 33, 12449-12460.

[5] Pennington, J., Socher, R., & Manning, C. D. (2014). Glove: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1532-1543.

[6] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019, June). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers) (pp. 4171-4186).

[7] Zhang, Y., Choi, M., Han, K., & Liu, Z. (2021). Explainable semantic space by grounding language to vision with cross-modal contrastive learning. Advances in Neural Information Processing Systems, 34, 18513-18526.
DOI: 10.5281/zenodo.18335705
title: The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders - AUDIO AND EMBEDDING FILES

description: The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders - Audio and Embedding Files

This dataset contains the audio files and the embeddings for the paper "The Curious Case of Visual Grounding: Different Effects for Speech- and Text-based Language Encoders" by Sauter el al. (2026). The corresponding code can be found here: https://github.com/adrian-sauter/visual_grounding_speech_analysis.

audio_files.zip contains the audio files from MALD [1] and LibriSpeech [2] that were used in our work.

fast_vgs_plus_librispeech_audioslicing.pkl.zip and w2v2_LibriSpeech_audioslicing.pkl.zip contain the embeddings for words from LibriSpeech (obtained via audio-slicing) for the FaST-VGS+ [3] and the wav2vec2 [4] model.

FULL_DF_MALD.pkl.zip contains the embeddings for words from MALD for FaST-VGS+ [3], wav2vec2 [4], GloVe [5], BERT [6], and VG-BERT [7].

 

References

[1] Tucker, B. V., Brenner, D., Danielson, D. K., Kelley, M. C., Nenadić, F., & Sims, M. (2019). The massive auditory lexical decision (MALD) database. Behavior research methods, 51, 1187-1204.

[2] Panayotov, V., Chen, G., Povey, D., & Khudanpur, S. (2015). Librispeech: an ASR corpus based on public domain audio books. 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 5206-5210.

[3] Peng, P. & Harwath, D. (2022). Self-supervised Representation Learning for Speech Using Visual Grounding and Masked Language Modeling. Proceedings of the AAAI Symposium on AI for Speech and Audio Processing.

[4] Baevski, A., Zhou, Y., Mohamed, A., & Auli, M. (2020). wav2vec 2.0: A framework for self-supervised learning of speech representations. Advances in neural information processing systems, 33, 12449-12460.

[5] Pennington, J., Socher, R., & Manning, C. D. (2014). Glove: Global vectors for word representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), 1532-1543.

[6] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2019, June). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technologies, volume 1 (long and short papers) (pp. 4171-4186).

[7] Zhang, Y., Choi, M., Han, K., & Liu, Z. (2021). Explainable semantic space by grounding language to vision with cross-modal contrastive learning. Advances in Neural Information Processing Systems, 34, 18513-18526.
DOI: 10.15468/dl.c549mu
title: Occurrence Download

description: A dataset containing 80 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Craugastor fecundus"
 ]
}

 The dataset includes 80 records from 6 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010014-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.apef89
title: Occurrence Download

description: A dataset containing 11135 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Hydnum rufescens"
 ]
}

 The dataset includes 11135 records from 235 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010017-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.yf6kpk
title: Occurrence Download

description: A dataset containing 106 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Lessingianthus sellowii",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 106 records from 35 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010018-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.yhew5p
title: Occurrence Download

description: A dataset containing 34 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Craugastor merendonensis"
 ]
}

 The dataset includes 34 records from 3 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010020-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.5b9tar
title: Occurrence Download

description: A dataset containing 997 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Leucanthemopsis alpina",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 997 records from 79 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010021-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.5281/zenodo.18362892
title: SuperDARN data in netCDF format (2004-Mar)

description: 2004-Mar SuperDARN radar data in netCDF format. These files were produced using version 3.0 of the public FitACF algorithm, using the AACGM v2 coordinate system. Cite this dataset if using our data in a publication.


The RST is available here: https://github.com/SuperDARN/rst



The research enabled by SuperDARN is due to the efforts of teams of scientists and engineers working in many countries to build and operate radars, process data and provide access, develop and improve data products, and assist users in interpretation.
Users of SuperDARN data and data products are asked to acknowledge this support in presentations and publications.
A brief statement on how to acknowledge use of SuperDARN data is provided below.




Users are also asked to consult with a SuperDARN PI prior to submission of work intended for publication.
A listing of radars and PIs with contact information can be found here:
(SuperDARN Radar Overview)



Recommended form of acknowledgement for the use of SuperDARN data:



'The authors acknowledge the use of SuperDARN data. SuperDARN is a collection of radars funded by national scientific funding agencies of Australia, Canada, China, France, Italy, Japan, Norway, South Africa, United Kingdom and the United States of America.'
DOI: 10.5281/zenodo.6727845
title: SuperDARN data in netCDF format (2004-Mar)

description: 2004-Mar SuperDARN radar data in netCDF format. These files were produced using version 3.0 of the public FitACF algorithm, using the AACGM v2 coordinate system. Cite this dataset if using our data in a publication.


The RST is available here: https://github.com/SuperDARN/rst



The research enabled by SuperDARN is due to the efforts of teams of scientists and engineers working in many countries to build and operate radars, process data and provide access, develop and improve data products, and assist users in interpretation.
Users of SuperDARN data and data products are asked to acknowledge this support in presentations and publications.
A brief statement on how to acknowledge use of SuperDARN data is provided below.




Users are also asked to consult with a SuperDARN PI prior to submission of work intended for publication.
A listing of radars and PIs with contact information can be found here:
(SuperDARN Radar Overview)



Recommended form of acknowledgement for the use of SuperDARN data:



'The authors acknowledge the use of SuperDARN data. SuperDARN is a collection of radars funded by national scientific funding agencies of Australia, Canada, China, France, Italy, Japan, Norway, South Africa, United Kingdom and the United States of America.'
DOI: 10.15468/dl.4gzbdj
title: Occurrence Download

description: A dataset containing 33 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Leucanthemum graminifolium",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 33 records from 19 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010022-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.zx57vn
title: Occurrence Download

description: A dataset containing 14 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Craugastor olanchano"
 ]
}

 The dataset includes 14 records from 2 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010023-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.48708/7172619
title: Sample Videos for Behavioral Observation Using Keypoint Detection Technology

description: This data consists of videos of people walking and performing desk work, taken for research on methods of observing human behavior using key point detection techniques. The contents of each video are as follows / desk_6min_a.mp4 / desk_6min_b.mp4 / desk_2min_a.mp4 / desk_2min_b.mp4: These videos show the task of choosing an object on the desk, placing it on the scale, and weighing it to exactly 100 grams, filmed from different positions. The scale's display was shown on a monitor in real time, and the subjects watched and adjusted the weights as they performed the task. The task was performed twice, once with 6 minutes to complete the task and once with 2 minutes to complete the task; in the 2-minute movie, the subject was instructed to perform the task as quickly as possible. / walk_sit_a.mp4 / walk_sit_b.mp4: These videos show the subject rising from a chair, walking, and then sitting in the chair again, filmed from different positions.walk_around_one.mp4 / walk_around_tow.mp4: These videos show the subject walking around the same location in a circle. “walk_around_one” shows five circles, and “walk_around_two” shows ten circles. In “walk_around_two”, there are passers-by in addition to the subjects. /
description: このデータはキーポイント検出技術を用いた人の行動観察手法の研究のために撮影された、歩行や机上作業を行う人の動画である。各動画の内容は以下のとおりである。 / desk_6min_a.mp4 / desk_6min_b.mp4 / desk_2min_a.mp4 / desk_2min_b.mp4： これらの動画は、机上に置かれた物を好きに選んで秤に置き、100グラムちょうどにする課題を異なる位置から撮影したものである。秤の表示はリアルタイムにモニターに表示されており、撮影対象者はそれを見ながら重さを調節して課題を遂行した。課題は2回実施され、ひとつは6分間でタスクを完了しており、もうひとつは2分間でタスクを完了している。2分間の動画においては、撮影対象者になるべく早く課題を遂行するよう教示を与えている。 / walk_sit_a.mp4 / walk_sit_b.mp4： これらの動画は、椅子から立ち上がり、歩き、再び椅子に座るまでの動作を異なる位置から撮影したものである。 / walk_around_one.mp4 / walk_around_tow.mp4: これらの動画は、同じ場所を円状に徒歩で回る動作を撮影したものである。walk_around_oneは5周、walk_around_twoでは10周回っている。またwalk_around_twoにおいては撮影対象者の他にも通行人が写り込んでいる。
DOI: 10.48708/7395434
title: I0483_あっヴぁんそぅ
DOI: 10.48708/7395435
title: I0483_うたき
DOI: 10.15468/dl.e8au9d
title: Occurrence Download

description: A dataset containing 980 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Leucochrysum albicans",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 980 records from 27 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010024-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.8z36qz
title: Occurrence Download

description: A dataset containing 1580 records in GBIF matching the query:
SELECT
 '357' AS fish_cell,
 GBIF_MGRSCode(1000, decimalLatitude, decimalLongitude, 0) AS cell, -- NO randomization
 COUNT(DISTINCT speciesKey) AS species_richness
 FROM occurrence
 WHERE hasCoordinate = TRUE
 AND speciesKey IS NOT NULL
 AND NOT ARRAY_CONTAINS(issue, 'ZERO_COORDINATE')
 AND NOT ARRAY_CONTAINS(issue, 'COORDINATE_OUT_OF_RANGE')
 AND NOT ARRAY_CONTAINS(issue, 'COORDINATE_INVALID')
 AND NOT ARRAY_CONTAINS(issue, 'COUNTRY_COORDINATE_MISMATCH')
 AND decimalLatitude &gt;= 28.773895969281842
 AND decimalLatitude &lt;= 33.06103686093294
 AND decimalLongitude &gt;= 92.0210150976321
 AND decimalLongitude &lt;= 100.19009778061415
 AND "year" &gt;= 2015
 AND "year" &lt;= 2026
 AND (coordinateUncertaintyInMeters &lt;= 100 OR coordinateUncertaintyInMeters IS NULL)
 GROUP BY fish_cell, cell

 The dataset's 1580 records were derived from 187 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010016-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.fjh73c
title: Occurrence Download

description: A dataset containing 461 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Leucogenes grandiceps",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 461 records from 17 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010025-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.34740/kaggle/ds/9330738
title: Sentiment & Mental Health Dataset (Reddit-Based)
DOI: 10.15468/dl.mcb34c
title: Occurrence Download

description: A dataset containing 49 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Leucomeris decora",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 49 records from 10 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010027-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.3ugsvs
title: Occurrence Download

description: A dataset containing 665 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Leucophyta brownii",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 665 records from 23 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010028-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.4xawsa
title: Occurrence Download

description: A dataset containing 3 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Leunisia laeta",
 "HasCoordinate is true",
 "BasisOfRecord is one of (Specimen)"
 ]
}

 The dataset includes 3 records from 3 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010029-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.ubfrbd
title: Occurrence Download

description: A dataset containing 4668 records in GBIF matching the query:
SELECT
 '358' AS fish_cell,
 GBIF_MGRSCode(1000, decimalLatitude, decimalLongitude, 0) AS cell, -- NO randomization
 COUNT(DISTINCT speciesKey) AS species_richness
 FROM occurrence
 WHERE hasCoordinate = TRUE
 AND speciesKey IS NOT NULL
 AND NOT ARRAY_CONTAINS(issue, 'ZERO_COORDINATE')
 AND NOT ARRAY_CONTAINS(issue, 'COORDINATE_OUT_OF_RANGE')
 AND NOT ARRAY_CONTAINS(issue, 'COORDINATE_INVALID')
 AND NOT ARRAY_CONTAINS(issue, 'COUNTRY_COORDINATE_MISMATCH')
 AND decimalLatitude &gt;= 28.773895969281842
 AND decimalLatitude &lt;= 33.06103686093294
 AND decimalLongitude &gt;= 97.43401598572812
 AND decimalLongitude &lt;= 105.7562143239816
 AND "year" &gt;= 2015
 AND "year" &lt;= 2026
 AND (coordinateUncertaintyInMeters &lt;= 100 OR coordinateUncertaintyInMeters IS NULL)
 GROUP BY fish_cell, cell

 The dataset's 4668 records were derived from 265 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0010026-260120142942310/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.bz9rvt
title: Occurrence Download

description: A dataset listing the 1 species recorded in GBIF matching the query:
{
 "and" : [
 "GadmGid is one of (CHN.6.4_1, CHN.6.15_1, CHN.6.21_1, CHN.6.3_1, CHN.6.6_1, CHN.6.2_1, CHN.6.20_1, CHN.6.7_1, CHN.6.19_1)",
 "HasCoordinate is true",
 "HasGeospatialIssue is false",
 "OccurrenceStatus is Present",
 "TaxonKey is Calidris acuminata",
 "Year 2020-2025"
 ]
}

 The dataset's 1 records were derived from 2 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0025407-250811113504898/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.5517/ccdc.csd.cc2mdzst
title: CCDC 2425557: Experimental Crystal Structure Determination

description: Related Article: Avinash Madhesiya, Saroj Maji, Gautam Panda, Tejender S. Thakur|2025|Cryst.Growth Des.|25|3394|doi:10.1021/acs.cgd.5c00219
description: An entry from the Cambridge Structural Database, the world’s repository for small molecule crystal structures. The entry contains experimental data from a crystal diffraction study. The deposited dataset for this entry is freely available from the CCDC and typically includes 3D coordinates, cell parameters, space group, experimental conditions and quality measures.
DOI: 10.5517/ccdc.csd.cc2mf0ps
title: CCDC 2425585: Experimental Crystal Structure Determination

description: Related Article: Avinash Madhesiya, Saroj Maji, Gautam Panda, Tejender S. Thakur|2025|Cryst.Growth Des.|25|3394|doi:10.1021/acs.cgd.5c00219
description: An entry from the Cambridge Structural Database, the world’s repository for small molecule crystal structures. The entry contains experimental data from a crystal diffraction study. The deposited dataset for this entry is freely available from the CCDC and typically includes 3D coordinates, cell parameters, space group, experimental conditions and quality measures.
DOI: 10.15468/dl.pbev9d
title: Occurrence Download

description: A dataset containing 119 species occurrences available in GBIF matching the query:
{
 "and" : [
 "Country is Mexico",
 "TaxonKey is Lepisosteus osseus (Linnaeus, 1758)"
 ]
}

 The dataset includes 119 records from 12 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0007415-250525065834625/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.tf8vsy
title: Occurrence Download

description: A dataset containing 36448 species occurrences available in GBIF matching the query:
{
 "and" : [
 "HasCoordinate is true",
 "TaxonKey is Streptomyces Waksman & Henrici, 1943"
 ]
}

 The dataset includes 36448 records from 425 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0016284-250525065834625/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.b3hqbp
title: Occurrence Download

description: A dataset containing 30414 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is one of (Cyclamen hederifolium Aiton)",
 "HasCoordinate is true",
 "HasGeospatialIssue is false",
 "Year is greater than or equal to 1950"
 ]
}

 The dataset includes 30414 records from 275 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0001710-250424135625364/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.