Aurora-M: The First Open Source Biden-Harris Executive Order Red teamed Multilingual Language Model
•
4
Mayank Mishra
mayank-mishra
AI & ML interests
Large Language Models, Distributed Training and Inference
Articles
Organizations
Posts
3
Post
1947
Thrilled to unveil DS-MoE: a dense training and sparse inference scheme for enhanced computational and memory efficiency in your MoE models! 🚀🚀🚀
Discover more in our blog: https://huggingface.co/blog/bpan/ds-moe and dive into the details with our paper: Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models (2404.05567)
Discover more in our blog: https://huggingface.co/blog/bpan/ds-moe and dive into the details with our paper: Dense Training, Sparse Inference: Rethinking Training of Mixture-of-Experts Language Models (2404.05567)
Post
1727
Current LLMs are very susceptible to generating toxic, harmful and even dangerous content. They can also generate outputs with gender or racial biases.
The Biden-Harris Executive Order (https://www.federalregister.gov/documents/2023/11/01/2023-24283/safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence) sets forth guidelines on what is considered a safe AI system.
Following up on these guidelines, we present the world's first open source Biden-Harris Executive Order Red teamed Multilingual Language Model: Aurora-M.
The model is trained on 5 languages: English, Hindi, Japanese, Vietnamese and Finnish.
Blog: https://huggingface.co/blog/mayank-mishra/aurora
Paper coming out soon.
Base model: aurora-m/aurora-m-base (not safety tuned)
Instruct model: aurora-m/aurora-m-instruct (not safety tuned)
Red teamed model: aurora-m/aurora-m-biden-harris-redteamed (safety tuned according to the order mentioned above)
The Biden-Harris Executive Order (https://www.federalregister.gov/documents/2023/11/01/2023-24283/safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence) sets forth guidelines on what is considered a safe AI system.
Following up on these guidelines, we present the world's first open source Biden-Harris Executive Order Red teamed Multilingual Language Model: Aurora-M.
The model is trained on 5 languages: English, Hindi, Japanese, Vietnamese and Finnish.
Blog: https://huggingface.co/blog/mayank-mishra/aurora
Paper coming out soon.
Base model: aurora-m/aurora-m-base (not safety tuned)
Instruct model: aurora-m/aurora-m-instruct (not safety tuned)
Red teamed model: aurora-m/aurora-m-biden-harris-redteamed (safety tuned according to the order mentioned above)
models
10
mayank-mishra/slim-pajama-1b-mha
Text Generation
•
Updated
•
9
mayank-mishra/slim-pajama-1b-mqa
Text Generation
•
Updated
•
15
mayank-mishra/slim-pajama-1b-gqa-swiglu
Text Generation
•
Updated
•
10
mayank-mishra/slim-pajama-1b-gqa
Text Generation
•
Updated
•
11
mayank-mishra/starcoder-GPTQ-8bit-128g
Updated
•
11
mayank-mishra/starcoder-GPTQ-4bit-128g
Updated
•
16
mayank-mishra/starcoderbase-GPTQ-4bit-128g
Updated
•
21
mayank-mishra/starcoderbase-GPTQ-8bit-128g
Updated
•
3
mayank-mishra/santacoder-GPTQ-4bit-128g
Updated
•
2
mayank-mishra/santacoder-GPTQ-8bit-128g
Updated
•
1
datasets
None public yet