Aiden_t5 / README.md
satan4191's picture
Update README.md
75ae871
|
raw
history blame
No virus
5.94 kB
---
license: openrail
datasets:
- irds/codesearchnet
- giganticode/java-cmpx-v1
- nickrosh/Evol-Instruct-Code-80k-v1
- bigcode/starcoderdata
- bigcode/the-stack
- bigcode/the-stack-smol
- Cdaprod/AI-Developer-Prompts
- code_x_glue_ct_code_to_text
- codeparrot/github-code
- codeparrot/github-code-clean
- code_x_glue_cc_code_completion_line
- >-
autoevaluate/autoeval-eval-jeffdshen__inverse_superglue_mixedp1-jeffdshen__inverse-63643c-1665558893
- bentrevett/multi30k
- edbeeching/decision_transformer_gym_replay
- psyche/common_crawl
- Birchlabs/openai-prm800k-solutions-only
- openchat/openchat_sharegpt4_dataset
- Open-Orca/OpenOrca
- cjvt/slownet
- para_crawl
- zeroshot/twitter-financial-news-sentiment
- laugustyniak/political-advertising-pl
- code_search_net
- sukaka/novelai-webui
- P1ayer-1/chatgpt-conversations-chatlogs.net
- daniel2588/sarcasm
- psmathur/orca_minis_uncensored_dataset
- player1537/Bloom-560m-trained-on-Wizard-Vicuna-Uncensored-trained-on-Based
- shahules786/prosocial-nsfw-reddit
- Thewillonline/reddit-sarcasm
- datasciencemmw/current-data
- Oniichat/bluemoon_roleplay_chat_data_300k_messages
- dell-research-harvard/AmericanStories
- b-mc2/sql-create-context
- rahulmallah/autotrain-data-emotion-detection
- theblackcat102/multiround-programming-convo
- Lsavints/software_knowledgebase
- RazinAleks/SO-Python_QA-Web_Development_class
- codeparrot/apps
- branles14/ultrachat-uncensored_full
language:
- en
- it
- fr
- pt
- la
- ru
- ro
- el
metrics:
- accuracy
- bertscore
- bleu
- code_eval
- character
- brier_score
tags:
- code
- text-generation-inference
library_name: transformers
pipeline_tag: conversational
---
# Model Card for Aiden
<!-- Provide a quick summary of what the model is/does. -->
Aiden is a large language model (LLM) chatbot developed by or4cl3ai. It is trained on a massive dataset of text and code, and can generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way.
## Model Details
### Model Description
Aiden is a factual language model from Hugging Face, trained on a massive dataset of text and code. It is a powerful tool that can be used for a variety of tasks, including:
* Generating text, translating languages, writing different kinds of creative content, and answering your questions in an informative way.
* Identifying and correcting errors in text.
* Summarizing long pieces of text.
* Answering your questions in an informative way, even if they are open ended, challenging, or strange.
### Model Specifications
Aiden is a Transformer-based LLM with 137B parameters. It is trained on a massive dataset of text and code, including the following:
* Books
* Code
* Wikipedia articles
* News articles
* Social media posts
### Model Sources
* Repository: https://huggingface.co/or4cl3ai/Aiden
* Paper: https://arxiv.org/abs/2307.09700
* Demo: https://huggingface.co/or4cl3ai/Aiden
## Uses
Aiden can be used for a variety of tasks, including:
* Generating text
* Translating languages
* Writing different kinds of creative content
* Answering your questions in an informative way
* Identifying and correcting errors in text
* Summarizing long pieces of text
### Direct Use
Aiden can be used directly to generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way. For example, you could use Aiden to generate a poem, translate a document from one language to another, or write a blog post.
### Downstream Use
Aiden can also be used as a component in downstream applications. For example, you could use Aiden to power a chatbot, or to generate text for a synthetic data set.
### Out-of-Scope Use
Aiden is not intended to be used for any task that could be harmful or discriminatory. For example, you should not use Aiden to generate text that is hateful or offensive, or to translate languages in a way that could be used to spread misinformation.
## Bias, Risks, and Limitations
Aiden is a large language model, and as such, it is subject to a number of biases and limitations. These include:
* Biases in the training data: Aiden is trained on a massive dataset of text and code, which may contain biases. These biases can be reflected in the text that Aiden generates.
* Limitations in the model's capabilities: Aiden is a powerful tool, but it is not perfect. It can sometimes generate text that is inaccurate, biased, or offensive.
* Risks of misuse: Aiden can be misused for a variety of purposes, including generating harmful or offensive text, or spreading misinformation.
### Recommendations
Users of Aiden should be aware of the risks, biases, and limitations of the model. It is important to use Aiden responsibly and ethically.
## How to Get Started with the Model
To get started with Aiden, you can follow these steps:
1. Install the Hugging Face Transformers library.
2. Clone the Aiden repository.
3. Download the Aiden model weights.
4. Load the model in your code.
Once you have loaded the model, you can use it to generate text, translate languages, write different kinds of creative content, and answer your questions in an informative way.
## Training Details
Aiden is trained on a massive dataset of text and code. The training data is collected from a variety of sources, including books, code, Wikipedia articles, news articles, and social media posts.
The training process is divided into two phases:
1. Pre-training: The model is pre-trained on a massive dataset of text and code. This pre-training helps the model to learn the basic building blocks of language.
2. Fine-tuning: The model is fine-tuned on a smaller dataset of text and code that is relevant to the task at hand. This fine-tuning helps the model to improve its performance on the specific task.
## Evaluation
Aiden is evaluated on a variety of tasks, including:
* Text generation
* Translation
* Summarization