Dampish commited on
Commit
60b2f0e
1 Parent(s): 769e1bf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,7 +7,7 @@ StellarX is a powerful autoregressive language model designed for various natura
7
 
8
  ## Model Details
9
 
10
- - **Training Data:** StellarX is trained on a large-scale dataset provided by "redpajama," maintained by the group "togethercomputer." This dataset has been instrumental in shaping StellarX's language capabilities and general-purpose understanding.
11
  - **Model Architecture:** StellarX is built upon the GPT-NeoX architecture, which is inspired by GPT-3 and shares similarities with GPT-J-6B. The architecture incorporates key advancements in transformer-based language models, ensuring high-quality predictions and contextual understanding.
12
  - **Model Size:** StellarX consists of approximately 4 billion parameters, making it a highly capable language model for a wide range of natural language processing tasks.
13
  - **Carbon-Friendly and Resource-Efficient:** StellarX has been optimized for carbon efficiency and can be comfortably run on local devices. When loaded in 8 bits, the model requires only about 5GB of storage, making it more accessible and convenient for various applications.
 
7
 
8
  ## Model Details
9
 
10
+ - **Training Data:** StellarX is trained on a large-scale dataset provided by "redpajama" maintained by the group "togethercumputer." This dataset has been instrumental in shaping StellarX's language capabilities and general-purpose understanding.
11
  - **Model Architecture:** StellarX is built upon the GPT-NeoX architecture, which is inspired by GPT-3 and shares similarities with GPT-J-6B. The architecture incorporates key advancements in transformer-based language models, ensuring high-quality predictions and contextual understanding.
12
  - **Model Size:** StellarX consists of approximately 4 billion parameters, making it a highly capable language model for a wide range of natural language processing tasks.
13
  - **Carbon-Friendly and Resource-Efficient:** StellarX has been optimized for carbon efficiency and can be comfortably run on local devices. When loaded in 8 bits, the model requires only about 5GB of storage, making it more accessible and convenient for various applications.