willyninja30 commited on
Commit
10064ab
1 Parent(s): 4e2075e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -2,8 +2,23 @@
2
  library_name: peft
3
  inference: true
4
  ---
5
- ## Training procedure
6
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
 
8
  The following `bitsandbytes` quantization config was used during training:
9
  - quant_method: bitsandbytes
 
2
  library_name: peft
3
  inference: true
4
  ---
 
5
 
6
+ ARIA 7B V2 is a model created by Faraday 🇫🇷 🇧🇪
7
+ The growing need of artificial intelligence tools around the world has created a run for GPU power. We decided to create an affordable model with better skills in French which can run on single GPU and reduce data bias observed in models trained mostly on english only datasets..
8
+
9
+ ARIA 7B has been trained on over 20.000 tokens of a high quality french dataset. ARIA 7B is one of the best open source models in the world avaible for this size of parameters.
10
+
11
+ ## Training procedure : NVIDIA A100. Thanks to NVIDIA GPU and Inception program,we have been able to train our model within less than 24 hours.
12
+
13
+ ## Base model : LLAMA_2-7B-CHAT-HF
14
+
15
+ We strongly believe that training models in more languages datasets can not only increase their knowledge base but also give more open analysis perspectives ,less focused visions and opinions from only one part of the world.
16
+ ## Contact
17
+ contact@faradaylab.fr
18
+
19
+ ## Number of Epoch : 2
20
+
21
+ ## Timing : Less than 24 hours
22
 
23
  The following `bitsandbytes` quantization config was used during training:
24
  - quant_method: bitsandbytes