heyFlorentin commited on
Commit
8affabb
•
1 Parent(s): 1c35320

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -53
README.md CHANGED
@@ -1,53 +1,55 @@
1
- ---
2
- license: llama3
3
- language: en
4
- datasets:
5
- - WEMAKE-CX/Intelligent-Content-Understanding
6
- ---
7
-
8
- # WeMake 💙 Llama-3 8B V41 Instruct 1048k
9
-
10
- Welcome to the official repository for **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k**, WeMake's pioneering 1 Million Token Large Language Model (LLM). This model represents a significant milestone in the evolution of natural language understanding and generation, combining the robust foundation of Meta's Llama-3 architecture with the nuanced alignment and emotional intelligence of WeMake's V41.
11
-
12
- ## Overview
13
-
14
- **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k** is a state-of-the-art language model designed to understand and generate human-like text with an unprecedented level of emotional intelligence and alignment. This model is a fork of both "gradientai/Llama-3-8B-Instruct-Gradient-1048k" and "meta-llama/Meta-Llama-3-8B", enhanced with the unique capabilities of WeMake's V41 and trained using the proprietary WeMake ICU method.
15
-
16
- Our model is engineered to serve a wide array of applications, from advanced conversational agents and content creation tools to sophisticated data analysis and insight generation platforms. It embodies WeMake's commitment to pushing the boundaries of AI to create more empathetic, understanding, and useful technologies.
17
-
18
- ## Key Features
19
-
20
- - **Emotional Intelligence:** Integrates WeMake's V41 emotional intelligence, enabling the model to understand and generate responses that consider emotional context and nuances.
21
- - **Alignment with Human Values:** Trained using the WeMake ICU method, ensuring the model's outputs are aligned with ethical standards and human values.
22
- - **Extensive Knowledge Base:** Leverages a vast dataset, encompassing a wide range of topics, to provide accurate and contextually relevant responses.
23
- - **Highly Configurable:** Offers extensive customization options to cater to specific application requirements, including adjustable generation settings and fine-tuning capabilities.
24
- - **Multilingual Support:** Capable of understanding and generating text in multiple languages, making it a versatile tool for global applications.
25
-
26
- ## Model Specifications
27
-
28
- - **Model Path:** WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k
29
- - **Architecture:** LlamaForCausalLM
30
- - **Hidden Size:** 4096
31
- - **Number of Attention Heads:** 32
32
- - **Number of Hidden Layers:** 32
33
- - **Max Position Embeddings:** 1048576
34
- - **Vocabulary Size:** 128256
35
- - **Torch Data Type:** bfloat16
36
-
37
- ## License
38
-
39
- **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k** is distributed under the "llama3" license. For more details, please refer to the LICENSE file in this repository.
40
-
41
- ## Contributing
42
-
43
- We welcome contributions from the community, including bug reports, feature requests, and code contributions. Please refer to the CONTRIBUTING.md file for more information on how to get involved.
44
-
45
- ## Acknowledgments
46
-
47
- This model is built upon the foundational work of Meta's Llama-3 and the enhancements made by Gradient's Llama-3-8B-Instruct-Gradient-1048k. We extend our gratitude to the researchers and developers behind these projects for their contributions to the field of AI.
48
-
49
- ## Contact
50
-
51
- For any inquiries, please contact us at [hey@wemake.cx](mailto:hey@wemake.cx).
52
-
53
- Join us in exploring the possibilities of emotionally intelligent and ethically aligned AI with **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k**. Together, let's shape the future of human-AI interaction.
 
 
 
1
+ ---
2
+ license: llama3
3
+ language: en
4
+ datasets:
5
+ - WEMAKE-CX/Intelligent-Content-Understanding
6
+ ---
7
+
8
+ ![V41](https://huggingface.co/spaces/WEMAKE-CX/home/resolve/main/v41.jpg)
9
+
10
+ # WeMake 💙 Llama-3 8B V41 Instruct 1048k
11
+
12
+ Welcome to the official repository for **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k**, WeMake's pioneering 1 Million Token Large Language Model (LLM). This model represents a significant milestone in the evolution of natural language understanding and generation, combining the robust foundation of Meta's Llama-3 architecture with the nuanced alignment and emotional intelligence of WeMake's V41.
13
+
14
+ ## Overview
15
+
16
+ **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k** is a state-of-the-art language model designed to understand and generate human-like text with an unprecedented level of emotional intelligence and alignment. This model is a fork of both "gradientai/Llama-3-8B-Instruct-Gradient-1048k" and "meta-llama/Meta-Llama-3-8B", enhanced with the unique capabilities of WeMake's V41 and trained using the proprietary WeMake ICU method.
17
+
18
+ Our model is engineered to serve a wide array of applications, from advanced conversational agents and content creation tools to sophisticated data analysis and insight generation platforms. It embodies WeMake's commitment to pushing the boundaries of AI to create more empathetic, understanding, and useful technologies.
19
+
20
+ ## Key Features
21
+
22
+ - **Emotional Intelligence:** Integrates WeMake's V41 emotional intelligence, enabling the model to understand and generate responses that consider emotional context and nuances.
23
+ - **Alignment with Human Values:** Trained using the WeMake ICU method, ensuring the model's outputs are aligned with ethical standards and human values.
24
+ - **Extensive Knowledge Base:** Leverages a vast dataset, encompassing a wide range of topics, to provide accurate and contextually relevant responses.
25
+ - **Highly Configurable:** Offers extensive customization options to cater to specific application requirements, including adjustable generation settings and fine-tuning capabilities.
26
+ - **Multilingual Support:** Capable of understanding and generating text in multiple languages, making it a versatile tool for global applications.
27
+
28
+ ## Model Specifications
29
+
30
+ - **Model Path:** WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k
31
+ - **Architecture:** LlamaForCausalLM
32
+ - **Hidden Size:** 4096
33
+ - **Number of Attention Heads:** 32
34
+ - **Number of Hidden Layers:** 32
35
+ - **Max Position Embeddings:** 1048576
36
+ - **Vocabulary Size:** 128256
37
+ - **Torch Data Type:** bfloat16
38
+
39
+ ## License
40
+
41
+ **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k** is distributed under the "llama3" license. For more details, please refer to the LICENSE file in this repository.
42
+
43
+ ## Contributing
44
+
45
+ We welcome contributions from the community, including bug reports, feature requests, and code contributions. Please refer to the CONTRIBUTING.md file for more information on how to get involved.
46
+
47
+ ## Acknowledgments
48
+
49
+ This model is built upon the foundational work of Meta's Llama-3 and the enhancements made by Gradient's Llama-3-8B-Instruct-Gradient-1048k. We extend our gratitude to the researchers and developers behind these projects for their contributions to the field of AI.
50
+
51
+ ## Contact
52
+
53
+ For any inquiries, please contact us at [hey@wemake.cx](mailto:hey@wemake.cx).
54
+
55
+ Join us in exploring the possibilities of emotionally intelligent and ethically aligned AI with **WEMAKE-CX/Llama-3-8B-Instruct-V41-1048k**. Together, let's shape the future of human-AI interaction.