add astraios

README.md

@@ -17,7 +17,7 @@ pinned: false
 
 # BigCode
 
-BigCode is an open scientific collaboration working on responsible training of large language models for coding applications. You can find more information on the main [website](https://www.bigcode-project.org/) or follow Big Code on [Twitter](https://twitter.com/BigCodeProject). In this organization you can find the artefacts of this collaboration: **StarCoder**, a state-of-the-art language model for code, **OctoPack**, artifacts for instruction tuning large code models, **The Stack**, the largest available pretraining dataset with perimssive code, and **SantaCoder**, a 1.1B parameter model for code.
+BigCode is an open scientific collaboration working on responsible training of large language models for coding applications. You can find more information on the main [website](https://www.bigcode-project.org/) or follow Big Code on [Twitter](https://twitter.com/BigCodeProject). In this organization you can find the artefacts of this collaboration: **StarCoder 2**, a state-of-the-art language model for code, **StarCoder**, a previous state-of-the-art language model for code, **Astraios**, scaling instruction-tuned language models for code via diverse fine-tuning methods , **OctoPack**, artifacts for instruction tuning large code models, **The Stack**, the largest available pretraining dataset with perimssive code, and **SantaCoder**, a 1.1B parameter model for code.
 
 ---
 <details>
@@ -82,6 +82,7 @@ BigCode is an open scientific collaboration working on responsible training of l
   - [StarCoder Search](https://huggingface.co/spaces/bigcode/search): Full-text search code in the pretraining dataset.
   - [StarCoder Membership Test](https://stack.dataportraits.org/): Blazing fast test if code was present in pretraining dataset.
 </details>
+
 ---
 <details>
   <summary>
@@ -101,6 +102,21 @@ BigCode is an open scientific collaboration working on responsible training of l
   - [OctoGeeX](https://huggingface.co/bigcode/octogeex): Instruction tuned model of CodeGeeX2 by training on CommitPackFT.
 </details>
 ---
+<details>
+  <summary>
+    <b><font size="+1">✨Astraios</font></b>
+  </summary>
+  
+  Astraios is a model suite of scaling 28 instruction-tuned language models for code.
+  
+  - [Paper](https://arxiv.org/abs/2401.00788): Research paper with details about all components of Astraios.
+  - [GitHub](https://github.com/bigcode-project/astraios): All code used for the creation of Astraios.
+  - [Astraios-1B](https://huggingface.co/collections/bigcode/astraios-1b-6576ff1b8e449026ae327c1c): Collection of StarCoderBase-1B models instruction tuned on CommitPackFT + OASST with 7 method.
+  - [Astraios-3B](https://huggingface.co/collections/bigcode/astraios-3b-6577127317ee44ff547252d3): Collection of StarCoderBase-3B models instruction tuned on CommitPackFT + OASST with 7 method.
+  - [Astraios-7B](https://huggingface.co/collections/bigcode/astraios-7b-65788b509c5c26f96c08d576): Collection of StarCoderBase-7B models instruction tuned on CommitPackFT + OASST with 7 method.
+  - [Astraios-15B](https://huggingface.co/collections/bigcode/astraios-15b-65788b7476b6de79781054cc): Collection of StarCoderBase-15B models instruction tuned on CommitPackFT + OASST with 7 method.
+</details>
+---
 <details>
   <summary>
     <b><font size="+1">📑The Stack</font></b>