Hzfinfdu commited on
Commit
d2783d8
1 Parent(s): 5fa5914

Rename folders

Browse files
Llama3_1-8B-Base-L13R-32x/lm_config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "device": "cuda",
3
+ "seed": 42,
4
+ "dtype": "torch.bfloat16",
5
+ "model_name": "meta-llama/Meta-Llama-3.1-8B",
6
+ "use_flash_attn": false,
7
+ "cache_dir": null,
8
+ "d_model": 4096,
9
+ "local_files_only": false
10
+ }