cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.15468/dl.nbw3x6
title: Occurrence Download

description: A dataset containing 1079 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.42316867955985",
 "DecimalLongitude is less than 6.42622823274425",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1079 records from 14 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023737-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.tmt3wh
title: Occurrence Download

description: A dataset containing 1351 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Stenodema holsata (Fabricius, 1787)",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 1351 records from 83 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023738-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.qeuvej
title: Occurrence Download

description: A dataset containing 2651 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.42622823274425",
 "DecimalLongitude is less than 6.42928778592864",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 2651 records from 16 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023739-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.2jvz9s
title: Occurrence Download

description: A dataset containing 1080 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.42928778592864",
 "DecimalLongitude is less than 6.43234733911304",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1080 records from 13 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023741-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.jy4d9y
title: Occurrence Download

description: A dataset containing 2671 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Stenodema laevigata (Linnaeus, 1758)",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 2671 records from 138 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023740-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.998msb
title: Occurrence Download

description: A dataset containing 1933 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.43234733911304",
 "DecimalLongitude is less than 6.43540689229743",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1933 records from 14 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023742-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.6a7ncm
title: Occurrence Download

description: A dataset containing 186 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Stygnocoris rusticus (Fallen, 1807)",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 186 records from 53 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023743-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.92maz7
title: Occurrence Download

description: A dataset containing 1198 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.43540689229743",
 "DecimalLongitude is less than 6.43846644548183",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1198 records from 10 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023744-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.fhgzsw
title: Occurrence Download

description: A dataset containing 598 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Stygnocoris sabulosus (Schilling, 1829)",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 598 records from 78 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023745-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.2ccx8a
title: Occurrence Download

description: A dataset containing 1436 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.43846644548183",
 "DecimalLongitude is less than 6.44152599866622",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1436 records from 12 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023746-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.8p6ra7
title: Occurrence Download

description: A dataset containing 609 species occurrences available in GBIF matching the query:
{
 "and" : [
 "Continent is one of (North America, South America)",
 "Country is one of (Jamaica, Costa Rica, Brazil, Venezuela (Bolivarian Republic of), Peru, Dominican Republic, Bolivia (Plurinational State of), Ecuador, Colombia)",
 "HasCoordinate is true",
 "HasGeospatialIssue is false",
 "TaxonKey is Leptodontium luteum (Taylor) Mitt."
 ]
}

 The dataset includes 609 records from 31 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023748-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.ff33ag
title: Occurrence Download

description: A dataset containing 81 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Taphropeltus contractus (Herrich-Schaeffer, 1835)",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 81 records from 32 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023747-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.7sv2b4
title: Occurrence Download

description: A dataset containing 1726 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.44152599866622",
 "DecimalLongitude is less than 6.44458555185062",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1726 records from 11 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023749-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.68fgm9
title: Occurrence Download

description: A dataset containing 1141 species occurrences available in GBIF matching the query:
{
 "DatasetKey" : [
 "is Mystic Aquarium's marine mammal and sea turtle stranding data 1976-2011"
 ]
}

 The dataset includes 1141 records from 1 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023750-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.vvn35e
title: Occurrence Download

description: A dataset containing 121 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Teratocoris saundersi Douglas & Scott, 1869",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 121 records from 23 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023751-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.3b53hg
title: Occurrence Download

description: A dataset containing 1354 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.44458555185062",
 "DecimalLongitude is less than 6.44764510503501",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1354 records from 11 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023752-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.h7qpzr
title: Occurrence Download

description: A dataset containing 2378 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.44764510503501",
 "DecimalLongitude is less than 6.45070465821941",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 2378 records from 14 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023754-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.me8znm
title: Occurrence Download

description: A dataset containing 81 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Tytthus pygmaeus (Zetterstedt, 1838)",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 81 records from 20 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023753-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.34740/kaggle/dsv/9670838
title: BBC News
DOI: 10.15468/dl.7hzcmm
title: Occurrence Download

description: A dataset containing 2143 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.45070465821941",
 "DecimalLongitude is less than 6.4537642114038",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 2143 records from 12 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023756-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.kag63w
title: Occurrence Download

description: A dataset containing 555 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Allygus mixtus (Fabricius, 1794)",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 555 records from 47 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023755-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.2xr8fh
title: Occurrence Download

description: A dataset containing 1593 species occurrences available in GBIF matching the query:
{
 "and" : [
 "TaxonKey is Plantae",
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 "Country is Germany",
 "DecimalLongitude is greater than or equal to 6.4537642114038",
 "DecimalLongitude is less than 6.4568237645882",
 "DecimalLatitude is greater than or equal to 47.27011",
 "DecimalLatitude is less than or equal to 55.05864"
 ]
}

 The dataset includes 1593 records from 9 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023757-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.15468/dl.avmxah
title: Occurrence Download

description: A dataset containing 206 species occurrences available in GBIF matching the query:
{
 "and" : [
 {
 "and" : [
 "HasGeospatialIssue is false",
 "HasCoordinate is true",
 "OccurrenceStatus is Present",
 {
 "not" : {
 "BasisOfRecord" : [
 "is one of (Fossil, Living Specimen)"
 ]
 }
 }
 ]
 },
 "TaxonKey is Allygus modestus Scott, 1876",
 "PhylumKey is Arthropoda",
 "Year is greater than or equal to 1992",
 "Year is less than or equal to 2012",
 "Geometry POLYGON((-26 34, 42 34, 42 70, -26 70, -26 34))"
 ]
}

 The dataset includes 206 records from 27 constituent datasets; see https://api.gbif.org/v1/occurrence/download/0023758-241007104925546/datasets/export for details.
 
Data from some individual datasets included in this download may be licensed under less restrictive terms.
DOI: 10.5281/zenodo.13956077
title: CRISP: Critical Path Analysis of Large-Scale Microservice Architectures (Artifact)

description: This zip includes the original artifact used in the CRISP paper.

The appendix in the original paper contains the details on the setup and execution of the artifact. There are three components in this artifact: top-down analysis, bottom-up analysis, and anomaly detection.

Note



Due to privacy and security concerns, most unrelated fields and tags are removed.

All trace is sanitized consistently. The same service or endpoint will have identical mapping across three directories. (i.e., service 1 represents the same service in all traces). However, the mapping is inconsistent with https://zenodo.org/records/13947828, so please do not mix the traces between the two artifacts. 

To preserve privacy, the start time of each trace has been randomly shifted. As a result, the start and end times in the traces do not reflect the actual collection times, and users should not attempt to infer when the traces were gathered.

Within each trace, the relative durations and timestamps of all spans remained consistent, as the shift was applied uniformly across the entire trace.


Top-down analysis

Simply run bash top-down.sh should be sufficient. Note the result looks slightly different since this artifact contains a subset of traces from the original paper.

bottom-up analysis

bash bottom-up.sh should generate the figure 13-20 from the original paper. Note instead of having 1m+ traces in the original paper, this artifact contains a subset of 100k traces. So generated figure may look slightly different.

Anomaly detection

This part contains the original repo of TraceAnomaly. The dataset contains the original trace of Service 3 in Table 2 from the original paper.

To run the experiment, first please refer to the appendix for the setup.

Then please run the following:



bash preprocess.sh to generate the matrices that are used in the training

within TraceAnomaly repo



run bash run-training-WG.sh to run the training using the whole graph. Correspond to Service 3 row, column TA in Table 2.

run bash run-training-CS.sh to run the training using the critical path only. Correspond to Service 3 row, column CRISP in Table 2.



run python3.6 parse-rnvp.py -i path_to_rnvp_file to check the result


Note



The traces among train, normal, and abnormal are split randomly from normal traces. The error generation part can be found in lines 137-144 in preprocess.py. It is also described in Section 7.3 Methodology in the original paper. For real error traces, please refer to https://zenodo.org/records/13947828.


If you use the traces in your research, please cite our paper



@inproceedings{zhang2022crisp,
  title={$\{$CRISP$\}$: Critical path analysis of $\{$Large-Scale$\}$ microservice architectures},
  author={Zhang, Zhizhou and Ramanathan, Murali Krishna and Raj, Prithvi and Parwal, Abhishek and Sherwood, Timothy and Chabbi, Milind},
  booktitle={2022 USENIX Annual Technical Conference (USENIX ATC 22)},
  pages={655--672},
  year={2022}
}


If you have more questions, you can reach out to Chris(Zhizhou) Zhang.
DOI: 10.5281/zenodo.13956078
title: CRISP: Critical Path Analysis of Large-Scale Microservice Architectures (Artifact)

description: This zip includes the original artifact used in the CRISP paper.

The appendix in the original paper contains the details on the setup and execution of the artifact. There are three components in this artifact: top-down analysis, bottom-up analysis, and anomaly detection.

Note



Due to privacy and security concerns, most unrelated fields and tags are removed.

All trace is sanitized consistently. The same service or endpoint will have identical mapping across three directories. (i.e., service 1 represents the same service in all traces). However, the mapping is inconsistent with https://zenodo.org/records/13947828, so please do not mix the traces between the two artifacts. 

To preserve privacy, the start time of each trace has been randomly shifted. As a result, the start and end times in the traces do not reflect the actual collection times, and users should not attempt to infer when the traces were gathered.

Within each trace, the relative durations and timestamps of all spans remained consistent, as the shift was applied uniformly across the entire trace.


Top-down analysis

Simply run bash top-down.sh should be sufficient. Note the result looks slightly different since this artifact contains a subset of traces from the original paper.

bottom-up analysis

bash bottom-up.sh should generate the figure 13-20 from the original paper. Note instead of having 1m+ traces in the original paper, this artifact contains a subset of 100k traces. So generated figure may look slightly different.

Anomaly detection

This part contains the original repo of TraceAnomaly. The dataset contains the original trace of Service 3 in Table 2 from the original paper.

To run the experiment, first please refer to the appendix for the setup.

Then please run the following:



bash preprocess.sh to generate the matrices that are used in the training

within TraceAnomaly repo



run bash run-training-WG.sh to run the training using the whole graph. Correspond to Service 3 row, column TA in Table 2.

run bash run-training-CS.sh to run the training using the critical path only. Correspond to Service 3 row, column CRISP in Table 2.



run python3.6 parse-rnvp.py -i path_to_rnvp_file to check the result


Note



The traces among train, normal, and abnormal are split randomly from normal traces. The error generation part can be found in lines 137-144 in preprocess.py. It is also described in Section 7.3 Methodology in the original paper. For real error traces, please refer to https://zenodo.org/records/13947828.


If you use the traces in your research, please cite our paper



@inproceedings{zhang2022crisp,
  title={$\{$CRISP$\}$: Critical path analysis of $\{$Large-Scale$\}$ microservice architectures},
  author={Zhang, Zhizhou and Ramanathan, Murali Krishna and Raj, Prithvi and Parwal, Abhishek and Sherwood, Timothy and Chabbi, Milind},
  booktitle={2022 USENIX Annual Technical Conference (USENIX ATC 22)},
  pages={655--672},
  year={2022}
}


If you have more questions, you can reach out to Chris(Zhizhou) Zhang.