|
--- |
|
datasets: |
|
- hellaswag |
|
- ag_news |
|
- pietrolesci/nli_fever |
|
- numer_sense |
|
- go_emotions |
|
- Ericwang/promptProficiency |
|
- poem_sentiment |
|
- pietrolesci/robust_nli_is_sd |
|
- sileod/probability_words_nli |
|
- social_i_qa |
|
- trec |
|
- pietrolesci/gen_debiased_nli |
|
- snips_built_in_intents |
|
- metaeval/imppres |
|
- metaeval/crowdflower |
|
- tals/vitaminc |
|
- dream |
|
- metaeval/babi_nli |
|
- Ericwang/promptSpoke |
|
- metaeval/ethics |
|
- art |
|
- ai2_arc |
|
- discovery |
|
- Ericwang/promptGrammar |
|
- code_x_glue_cc_clone_detection_big_clone_bench |
|
- prajjwal1/discosense |
|
- pietrolesci/joci |
|
- Anthropic/model-written-evals |
|
- utilitarianism |
|
- emo |
|
- tweets_hate_speech_detection |
|
- piqa |
|
- blog_authorship_corpus |
|
- SpeedOfMagic/ontonotes_english |
|
- circa |
|
- app_reviews |
|
- anli |
|
- Ericwang/promptSentiment |
|
- codah |
|
- definite_pronoun_resolution |
|
- health_fact |
|
- tweet_eval |
|
- hate_speech18 |
|
- glue |
|
- hendrycks_test |
|
- paws |
|
- bigbench |
|
- hate_speech_offensive |
|
- blimp |
|
- sick |
|
- turingbench/TuringBench |
|
- martn-nguyen/contrast_nli |
|
- Anthropic/hh-rlhf |
|
- openbookqa |
|
- species_800 |
|
- alisawuffles/WANLI |
|
- ethos |
|
- pietrolesci/mpe |
|
- wiki_hop |
|
- pietrolesci/glue_diagnostics |
|
- mc_taco |
|
- quarel |
|
- PiC/phrase_similarity |
|
- strombergnlp/rumoureval_2019 |
|
- quail |
|
- acronym_identification |
|
- pietrolesci/robust_nli |
|
- quora |
|
- wnut_17 |
|
- dynabench/dynasent |
|
- pietrolesci/gpt3_nli |
|
- truthful_qa |
|
- pietrolesci/add_one_rte |
|
- pietrolesci/breaking_nli |
|
- copenlu/scientific-exaggeration-detection |
|
- medical_questions_pairs |
|
- rotten_tomatoes |
|
- scicite |
|
- scitail |
|
- pietrolesci/dialogue_nli |
|
- code_x_glue_cc_defect_detection |
|
- nightingal3/fig-qa |
|
- pietrolesci/conj_nli |
|
- liar |
|
- sciq |
|
- head_qa |
|
- pietrolesci/dnc |
|
- quartz |
|
- wiqa |
|
- code_x_glue_cc_code_refinement |
|
- Ericwang/promptCoherence |
|
- joey234/nan-nli |
|
- hope_edi |
|
- jnlpba |
|
- yelp_review_full |
|
- pietrolesci/recast_white |
|
- swag |
|
- banking77 |
|
- cosmos_qa |
|
- financial_phrasebank |
|
- hans |
|
- pietrolesci/fracas |
|
- math_qa |
|
- conll2003 |
|
- qasc |
|
- ncbi_disease |
|
- mwong/fever-evidence-related |
|
- YaHi/EffectiveFeedbackStudentWriting |
|
- ade_corpus_v2 |
|
- amazon_polarity |
|
- pietrolesci/robust_nli_li_ts |
|
- super_glue |
|
- adv_glue |
|
- Ericwang/promptNLI |
|
- cos_e |
|
- launch/open_question_type |
|
- lex_glue |
|
- has_part |
|
- pragmeval |
|
- sem_eval_2010_task_8 |
|
- imdb |
|
- humicroedit |
|
- sms_spam |
|
- dbpedia_14 |
|
- commonsense_qa |
|
- hlgd |
|
- snli |
|
- hyperpartisan_news_detection |
|
- google_wellformed_query |
|
- raquiba/Sarcasm_News_Headline |
|
- metaeval/recast |
|
- winogrande |
|
- relbert/lexical_relation_classification |
|
- metaeval/linguisticprobing |
|
--- |
|
|
|
# Model Card for Model ID |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
# Table of Contents |
|
|
|
1. [Model Details](#model-details) |
|
2. [Uses](#uses) |
|
3. [Bias, Risks, and Limitations](#bias-risks-and-limitations) |
|
4. [Training Details](#training-details) |
|
5. [Evaluation](#evaluation) |
|
6. [Model Examination](#model-examination-optional) |
|
7. [Environmental Impact](#environmental-impact) |
|
8. [Technical Specifications](#technical-specifications-optional) |
|
9. [Citation](#citation-optional) |
|
10. [Glossary](#glossary-optional) |
|
11. [More Information](#more-information-optional) |
|
12. [Model Card Authors](#model-card-authors-optional) |
|
13. [Model Card Contact](#model-card-contact) |
|
14. [How To Get Started With the Model](#how-to-get-started-with-the-model) |
|
|
|
|
|
# Model Details |
|
|
|
## Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
|
|
|
|
- **Developed by:** [More Information Needed] |
|
- **Shared by [optional]:** [More Information Needed] |
|
- **Model type:** [More Information Needed] |
|
- **Language(s) (NLP):** [More Information Needed] |
|
- **License:** [More Information Needed] |
|
- **Related Models [optional]:** [More Information Needed] |
|
- **Parent Model [optional]:** [More Information Needed] |
|
- **Resources for more information:** [More Information Needed] |
|
|
|
# Uses |
|
|
|
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. --> |
|
|
|
## Direct Use |
|
|
|
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. --> |
|
|
|
[More Information Needed] |
|
|
|
## Downstream Use [optional] |
|
|
|
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app --> |
|
|
|
[More Information Needed] |
|
|
|
## Out-of-Scope Use |
|
|
|
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. --> |
|
|
|
[More Information Needed] |
|
|
|
# Bias, Risks, and Limitations |
|
|
|
<!-- This section is meant to convey both technical and sociotechnical limitations. --> |
|
|
|
[More Information Needed] |
|
|
|
## Recommendations |
|
|
|
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. --> |
|
|
|
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recomendations. |
|
|
|
# Training Details |
|
|
|
## Training Data |
|
|
|
<!-- This should link to a Data Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. --> |
|
|
|
[More Information Needed] |
|
|
|
## Training Procedure [optional] |
|
|
|
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. --> |
|
|
|
### Preprocessing |
|
|
|
[More Information Needed] |
|
|
|
### Speeds, Sizes, Times |
|
|
|
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. --> |
|
|
|
[More Information Needed] |
|
|
|
# Evaluation |
|
|
|
<!-- This section describes the evaluation protocols and provides the results. --> |
|
|
|
## Testing Data, Factors & Metrics |
|
|
|
### Testing Data |
|
|
|
<!-- This should link to a Data Card if possible. --> |
|
|
|
[More Information Needed] |
|
|
|
### Factors |
|
|
|
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. --> |
|
|
|
[More Information Needed] |
|
|
|
### Metrics |
|
|
|
<!-- These are the evaluation metrics being used, ideally with a description of why. --> |
|
|
|
[More Information Needed] |
|
|
|
## Results |
|
|
|
[More Information Needed] |
|
|
|
# Model Examination [optional] |
|
|
|
<!-- Relevant interpretability work for the model goes here --> |
|
|
|
[More Information Needed] |
|
|
|
# Environmental Impact |
|
|
|
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly --> |
|
|
|
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700). |
|
|
|
- **Hardware Type:** [More Information Needed] |
|
- **Hours used:** [More Information Needed] |
|
- **Cloud Provider:** [More Information Needed] |
|
- **Compute Region:** [More Information Needed] |
|
- **Carbon Emitted:** [More Information Needed] |
|
|
|
# Technical Specifications [optional] |
|
|
|
## Model Architecture and Objective |
|
|
|
[More Information Needed] |
|
|
|
## Compute Infrastructure |
|
|
|
[More Information Needed] |
|
|
|
### Hardware |
|
|
|
[More Information Needed] |
|
|
|
### Software |
|
|
|
[More Information Needed] |
|
|
|
# Citation [optional] |
|
|
|
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. --> |
|
|
|
**BibTeX:** |
|
|
|
[More Information Needed] |
|
|
|
**APA:** |
|
|
|
[More Information Needed] |
|
|
|
# Glossary [optional] |
|
|
|
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. --> |
|
|
|
[More Information Needed] |
|
|
|
# More Information [optional] |
|
|
|
[More Information Needed] |
|
|
|
# Model Card Authors [optional] |
|
|
|
[More Information Needed] |
|
|
|
# Model Card Contact |
|
|
|
[More Information Needed] |
|
|
|
# How to Get Started with the Model |
|
|
|
Use the code below to get started with the model. |
|
|
|
<details> |
|
<summary> Click to expand </summary> |
|
|
|
[More Information Needed] |
|
|
|
</details> |
