yodiaditya commited on
Commit
5840119
1 Parent(s): c317db4

adding multi language

Browse files
Files changed (3) hide show
  1. .gitattributes +1 -0
  2. README.md +19 -1
  3. pytorch_model.bin +2 -2
.gitattributes CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ pytorch_model.bin filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -107,6 +107,24 @@ print(result)
107
  [{'generated_text': 'Given the question:\n{ siapa kamu? }\n---\nAnswer:\nSaya Karina, asisten virtual siap membantu seputar estimasi harga atau pertanyaan lain'}]
108
  ```
109
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
110
  <!-- Necessary for whitespace -->
111
  ###
112
 
@@ -118,4 +136,4 @@ print(result)
118
 
119
  ## Model
120
 
121
- - **Architecture:** Same as [bloom](https://huggingface.co/bigscience/bloom), also refer to the `config.json` file
 
107
  [{'generated_text': 'Given the question:\n{ siapa kamu? }\n---\nAnswer:\nSaya Karina, asisten virtual siap membantu seputar estimasi harga atau pertanyaan lain'}]
108
  ```
109
 
110
+ ## Training procedure
111
+
112
+
113
+ The following `bitsandbytes` quantization config was used during training:
114
+ - load_in_8bit: False
115
+ - load_in_4bit: True
116
+ - llm_int8_threshold: 6.0
117
+ - llm_int8_skip_modules: None
118
+ - llm_int8_enable_fp32_cpu_offload: False
119
+ - llm_int8_has_fp16_weight: False
120
+ - bnb_4bit_quant_type: nf4
121
+ - bnb_4bit_use_double_quant: True
122
+ - bnb_4bit_compute_dtype: float16
123
+
124
+ ### Framework versions
125
+
126
+ - PEFT 0.5.0.dev0
127
+
128
  <!-- Necessary for whitespace -->
129
  ###
130
 
 
136
 
137
  ## Model
138
 
139
+ - **Architecture:** Same as [bloom](https://huggingface.co/bigscience/bloom), also refer to the `config.json` file
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:37edbf4d366ec96811936d79a179d09ba230972e1f2c3f81c42716204de1f54b
3
- size 6005235037
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38e19d9b7b3b11cf5e3f2aaf7c136b5501e37d829930ef7394a7cab7957c718d
3
+ size 6005240157