cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.5281/zenodo.13160660
title: Evaluation Results of English / Japanese LLMs Using Swallow-Evaluation ver.202407

description: Evaluation Results of English / Japanese LLMs Using Swallow-Evaluation ver.202407

This dataset is the source material of our observational analysis paper, "Significance and Effectiveness of Training LLM with Japanese Texts [Saito+, 2024]." It includes the evaluation results of 35 LLMs on 19 Japanese and English tasks, using Swallow-evaluation ver.202407.

As part of the Swallow project at Tokyo Institute of Technology, this dataset was developed to enable rigorous and comprehensive comparison of Japanese and English LLMs developed in Japan and worldwide.

Details

Tasks

Evaluation experiments are conducted on LLMs using 10 datasets for Japanese language understanding and generation tasks, and 9 datasets for English language understanding and generation tasks. All evaluation scores are normalized within a range from 0 (lowest) to 1 (highest). Refer to the reference [Saito+, 2024] for the complete list of evaluation tasks and datasets, evaluation metrics, and task configurations.

Environment

The evaluaitons were primarily conducted on A100 nodes (AIST), using Python as the programming language.

Limitation

While efforts were made to evaluate under fair conditions, considering the unique specifications of each LLM (such as tokenization and system prompts), minor differences in evaluation specifics (like prompt formatting and dependence on eval. environment) may cause task evaluation scores to change independently of the LLM’s performance.

Reference

```@techreport{    weko_238505_1,    author = "齋藤,幸史郎 and 水木,栄 and 大井,聖也 and 中村,泰士 and 塩谷,泰平 and 前田,航希 and Youmi,Ma and 服部,翔 and 藤井,一喜 and 岡本,拓己 and 石田,茂樹 and 高村,大也 and 横田,理央 and 岡崎,直観",    title = "LLMに日本語テキストを学習させる意義",    booktitle = "研究報告自然言語処理(NL)",    pages = "1--15",    year = "2024",    institution = "東京工業大学, 東京工業大学/産業技術総合研究所, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 産業技術総合研究所, 東京工業大学, 東京工業大学",    number = "12",    month = "aug" }```

License

This dataset is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Creators

Swallow LLM (GitHub, Official Web Page)
DOI: 10.5281/zenodo.13959137
title: Evaluation Results of English / Japanese LLMs Using Swallow-Evaluation ver.202407

description: Evaluation Results of English / Japanese LLMs Using Swallow-Evaluation ver.202407

This dataset is the source material of our observational analysis paper, "Significance and Effectiveness of Training LLM with Japanese Texts [Saito+, 2024]." It includes the evaluation results of 35 LLMs on 19 Japanese and English tasks, using Swallow-evaluation ver.202407.

As part of the Swallow project at Tokyo Institute of Technology, this dataset was developed to enable rigorous and comprehensive comparison of Japanese and English LLMs developed in Japan and worldwide.

Details

Tasks

Evaluation experiments are conducted on LLMs using 10 datasets for Japanese language understanding and generation tasks, and 9 datasets for English language understanding and generation tasks. All evaluation scores are normalized within a range from 0 (lowest) to 1 (highest). Refer to the reference [Saito+, 2024] for the complete list of evaluation tasks and datasets, evaluation metrics, and task configurations.

Environment

The evaluaitons were primarily conducted on A100 nodes (AIST), using Python as the programming language.

Limitation

While efforts were made to evaluate under fair conditions, considering the unique specifications of each LLM (such as tokenization and system prompts), minor differences in evaluation specifics (like prompt formatting and dependence on eval. environment) may cause task evaluation scores to change independently of the LLM’s performance.

Reference

```@techreport{    weko_238505_1,    author = "齋藤,幸史郎 and 水木,栄 and 大井,聖也 and 中村,泰士 and 塩谷,泰平 and 前田,航希 and Youmi,Ma and 服部,翔 and 藤井,一喜 and 岡本,拓己 and 石田,茂樹 and 高村,大也 and 横田,理央 and 岡崎,直観",    title = "LLMに日本語テキストを学習させる意義",    booktitle = "研究報告自然言語処理(NL)",    pages = "1--15",    year = "2024",    institution = "東京工業大学, 東京工業大学/産業技術総合研究所, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 東京工業大学, 産業技術総合研究所, 東京工業大学, 東京工業大学",    number = "12",    month = "aug" }```

License

This dataset is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Creators

Swallow LLM (GitHub, Official Web Page)
DOI: 10.15468/dl.bv9ezr
title: Occurrence Download

description: A dataset containing 4241 species occurrences available in GBIF matching the query:
{
 "and" : [
 "BasisOfRecord is Human Observation",
 "CoordinateUncertaintyInMeters 0.0-10000.0",
 "Geometry POLYGON((-125.32298 24.91301,-68.11648 24.91301,-68.11648 48.61634,-125.32298 48.61634,-125.32298 24.91301))",
 "TaxonKey is Bromus tectorum L."
 ]
}

 The dataset includes 4241 records from 5 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0026275-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.5281/zenodo.10794903
title: Characterization of the tumor-immune microenvironment in hepatocellular carcinoma patients undergoing immune checkpoint inhibitor therapy by highly multiplexed imaging mass cytometry

description: Imaging mass cytometry data of 42 HCC patients that received immune checkpoint inhibtor therapy after tumor biopsy or resection. 



ICI_img_normalized: Preprocessed and normalized multistack .tiff images. Each stack represents one channel. Channel annotations are stored in the ICICohort_panel.csv file.

ICI_cellmasks: Masks identifying individual cells on the images.

ICI_stromamasks: Masks identifying stromal and parenchymal regions on the image.

ICICohort_panel.csv: table containing channel information (metal tag and marker).


Patient etadata may be found in the supplementary table 3 of DOI 10.1136/gutjnl-2024-332837.
DOI: 10.5281/zenodo.10794904
title: Characterization of the tumor-immune microenvironment in hepatocellular carcinoma patients undergoing immune checkpoint inhibitor therapy by highly multiplexed imaging mass cytometry

description: Imaging mass cytometry data of 42 HCC patients that received immune checkpoint inhibtor therapy after tumor biopsy or resection. 



ICI_img_normalized: Preprocessed and normalized multistack .tiff images. Each stack represents one channel. Channel annotations are stored in the ICICohort_panel.csv file.

ICI_cellmasks: Masks identifying individual cells on the images.

ICI_stromamasks: Masks identifying stromal and parenchymal regions on the image.

ICICohort_panel.csv: table containing channel information (metal tag and marker).


Patient etadata may be found in the supplementary table 3 of DOI 10.1136/gutjnl-2024-332837.
DOI: 10.15468/dl.4hrdzf
title: Occurrence Download

description: A dataset containing 29 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Allium wallichii var. platyphyllum (Diels) J.M.Xu"
 ]
}

 The dataset includes 29 records from 8 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0026276-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.5281/zenodo.13744894
title: CF_D3 Interviews with with best practices of climate finance

description: The CLIMATEFIT dataset D1 contains data collected as part of WP1’s Task 1.1: Understand and capitalise on the good practices (M1-M10; Leader: UA). This dataset contains interviews that were conducted with stakeholders involved in international best practices of innovative climate finance, and innovative adaptation funding and financing solutions.

Data that is already published on the CLIMATEFIT website in WP1’s Deliverable 1.1: Adaptation Investment Landscape, is not included in this dataset.

More information can be found in the Readme file in this dataset.
DOI: 10.5281/zenodo.13744895
title: CF_D3 Interviews with with best practices of climate finance

description: The CLIMATEFIT dataset D1 contains data collected as part of WP1’s Task 1.1: Understand and capitalise on the good practices (M1-M10; Leader: UA). This dataset contains interviews that were conducted with stakeholders involved in international best practices of innovative climate finance, and innovative adaptation funding and financing solutions.

Data that is already published on the CLIMATEFIT website in WP1’s Deliverable 1.1: Adaptation Investment Landscape, is not included in this dataset.

More information can be found in the Readme file in this dataset.
DOI: 10.15468/dl.hfvckd
title: Occurrence Download

description: A dataset containing 293 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Allium fasciculatum Rendle"
 ]
}

 The dataset includes 293 records from 20 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0026277-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.5281/zenodo.13744815
title: CF_D2 financial and investment entities viewpoint and maturity about climate adaptation finance

description: The CLIMATEFIT dataset D2 contains data collected as part of WP1’s Task 1.2: Understand financial and investment entities point of view and maturity (M1-M8; Leader: WCF).

This data set contains no other data than what is available in Deliverable 1.1 Adaptation Investment Landscape. These interview transcripts and surveys are not included in this dataset due to sensitivity of information.
DOI: 10.5281/zenodo.13744816
title: CF_D2 financial and investment entities viewpoint and maturity about climate adaptation finance

description: The CLIMATEFIT dataset D2 contains data collected as part of WP1’s Task 1.2: Understand financial and investment entities point of view and maturity (M1-M8; Leader: WCF).

This data set contains no other data than what is available in Deliverable 1.1 Adaptation Investment Landscape. These interview transcripts and surveys are not included in this dataset due to sensitivity of information.
DOI: 10.5281/zenodo.13744718
title: CF_D1 Interviews with public authorities about climate adaptation finance

description: The CLIMATEFIT dataset D1 contains data collected as part of WP1’s Task 1.1: Assess financing barriers and drivers for territories (Leader: Actierra). This dataset contains interview transcripts and summaries of interviews conducted by the facilitators with the 20 territories. The interviews were about challenges and barriers regarding accessing climate adaptation funds and sources.

Data that is already published in WP1’s Deliverable 1.1: Adaptation Investment Landscape, is not included in this dataset. 

More information can be found in the Readme file in this dataset.
DOI: 10.5281/zenodo.13744719
title: CF_D1 Interviews with public authorities about climate adaptation finance

description: The CLIMATEFIT dataset D1 contains data collected as part of WP1’s Task 1.1: Assess financing barriers and drivers for territories (Leader: Actierra). This dataset contains interview transcripts and summaries of interviews conducted by the facilitators with the 20 territories. The interviews were about challenges and barriers regarding accessing climate adaptation funds and sources.

Data that is already published in WP1’s Deliverable 1.1: Adaptation Investment Landscape, is not included in this dataset. 

More information can be found in the Readme file in this dataset.
DOI: 10.15468/dl.zkrnbm
title: Occurrence Download

description: A dataset containing 107 species occurrences available in GBIF matching the query:
{
 "and" : [
 "DatasetKey is iNaturalist Research-grade Observations",
 "TaxonKey is Ortholomus punctipennis (Herrich-Schaeffer, 1850)"
 ]
}

 The dataset includes 107 records from 1 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0026278-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.upmwmt
title: Occurrence Download

description: A dataset containing 3 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Pavonia paneroi Fryxell"
 ]
}

 The dataset includes 3 records from 3 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0179341-240321170329656/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.m9yzrr
title: Occurrence Download

description: A dataset containing 1423193 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Alcidae",
 "Continent is one of (North America, South America)"
 ]
}

 The dataset includes 1423193 records from 211 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0061231-231002084531237/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.sgvum3
title: Occurrence Download

description: A dataset containing 2 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Bachia flavescens (Bonnaterre, 1789)",
 "DatasetKey is SysTax - Zoological Collections"
 ]
}

 The dataset includes 2 records from 1 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0000715-150512124619364/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.jzvm3e
title: Occurrence Download

description: A dataset containing 79 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Colaptes auratus tenebrosus"
 ]
}

 The dataset includes 79 records from 4 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0090294-200613084148143/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.sx8xe5
title: Occurrence Download

description: A dataset containing 463 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Acacia coolgardiensis Maiden"
 ]
}

 The dataset includes 463 records from 27 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0005141-240216155721649/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.zk2vfv
title: Occurrence Download

description: A dataset containing 9880 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Prosthechea Knowles & Westc."
 ]
}

 The dataset includes 9880 records from 170 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0000715-150811131857512/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.ex5bj1
title: Occurrence Download

description: A dataset containing 47 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Bauhinia pulla Craib"
 ]
}

 The dataset includes 47 records from 10 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0019155-190918142434337/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.wtj2tr
title: Occurrence Download

description: A dataset containing 134 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Octopus insularis Leite & Haimovici, 2008",
 "Year is greater than or equal to 1950",
 "Country is Colombia"
 ]
}

 The dataset includes 134 records from 3 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0005813-231002084531237/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.ayq8hh
title: Occurrence Download

description: A dataset containing 29 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Myrcia martiusiana (DC.) A.R.Lourenço & E.Lucas"
 ]
}

 The dataset includes 29 records from 12 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0179342-240321170329656/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.h7mj1i
title: Occurrence Download

description: A dataset containing 8446 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Apium graveolens L.",
 "HasCoordinate is true",
 "HasGeospatialIssue is false"
 ]
}

 The dataset includes 8446 records from 183 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0000715-150831095807960/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.vxphh5
title: Occurrence Download

description: A dataset containing 2 species occurrences available in GBIF matching the query:
{
 "and" : [
 "BasisOfRecord is Specimen",
 "HasCoordinate is true",
 "HasGeospatialIssue is false",
 "TaxonKey is Oedipina tomasi McCranie, 2006"
 ]
}

 The dataset includes 2 records from 1 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0090298-200613084148143/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.bgdq75
title: Occurrence Download

description: A dataset containing 1715 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Mammalia",
 "Year is greater than or equal to 2010",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 },
 "GadmGid is COL.20_2",
 {
 "or" : [
 {
 "not" : {
 "EstablishmentMeans" : [
 "is one of (MANAGED, INTRODUCED)"
 ]
 }
 },
 "EstablishmentMeans is null"
 ]
 }
 ]
}

 The dataset includes 1715 records from 22 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0005815-231002084531237/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.xoagis
title: Occurrence Download

description: A dataset containing 19 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Apion fuscirostre (Fabricius, 1775)"
 ]
}

 The dataset includes 19 records from 4 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0000715-150912100344238/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.efae9n
title: Occurrence Download

description: A dataset containing 16 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Copadichromis borleyi (Iles, 1960)",
 "HasGeospatialIssue is false",
 "HasCoordinate is true"
 ]
}

 The dataset includes 16 records from 2 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0090304-160910150852091/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.cgaa2y
title: Occurrence Download

description: A dataset containing 8 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Chrysaora lactea Eschscholtz, 1829",
 "Year is greater than or equal to 1950",
 "Country is Colombia"
 ]
}

 The dataset includes 8 records from 2 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0005812-231002084531237/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.y7aoa1
title: Occurrence Download

description: A dataset containing 4 species occurrences available in GBIF matching the query:
{
 "TaxonKey" : [
 "is Navia stenodonta L.B.Sm."
 ]
}

 The dataset includes 4 records from 3 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0000715-160526112335914/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.v63a6z
title: Occurrence Download

description: A dataset containing 1069 species occurrences available in GBIF matching the query:
{
 "and" : [
 "BasisOfRecord is Human Observation",
 "DatasetKey is EOD – eBird Observation Dataset",
 "Geometry POLYGON((66.6671 24.84833,66.97746 24.79065,67.09007 24.7467,67.45502 24.78172,67.55287 25.04745,67.351 25.69702,67.2686 25.57755,67.21642 25.44434,67.17247 25.33859,66.92528 25.112,66.6671 24.84833))",
 "HasCoordinate is true",
 "HasGeospatialIssue is false",
 "License is CC0 1.0",
 "OccurrenceStatus is Present",
 "Year 2015-2020"
 ]
}

 The dataset includes 1069 records from 1 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0090313-200613084148143/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.37pxkq
title: Occurrence Download

description: A dataset containing 16306 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Helianthus annuus L.",
 "Country is one of (United States of America, Canada)",
 "Year is greater than or equal to 1979"
 ]
}

 The dataset includes 16306 records from 175 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0061235-231002084531237/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.acgycb
title: Occurrence Download

description: A dataset containing 784 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Oryzomys couesi (Alston, 1877)",
 "Geometry POLYGON((-100.67 14.87,-100.67 19.07,-93.78 19.07,-93.78 14.87,-100.67 14.87))",
 "HasGeospatialIssue is false",
 "BasisOfRecord is Specimen"
 ]
}

 The dataset includes 784 records from 29 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0000715-170627171947987/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.aqc4jt
title: Occurrence Download

description: A dataset containing 144 species occurrences available in GBIF matching the query:
{
 "and" : [
 "ScientificName is Abies delavayi Franch.",
 "DecimalLatitude is greater than or equal to -90",
 "DecimalLongitude is greater than or equal to -180"
 ]
}

 The dataset includes 144 records from 25 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023550-191105090559680/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.f8xxeq
title: Occurrence Download

description: A dataset containing 2 species occurrences available in GBIF matching the query:
{
 "and" : [
 "Country is Panama",
 "Geometry POLYGON((-81.26004 7.63544,-81.26066 7.63333,-81.25904 7.62834,-81.25568 7.62635,-81.25206 7.62398,-81.24397 7.62784,-81.24297 7.63333,-81.24372 7.64167,-81.25368 7.64217,-81.26004 7.63544))",
 "TaxonKey is Amphibia"
 ]
}

 The dataset includes 2 records from 1 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0061216-231002084531237/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.