androlike
/

TerraMix_L2_13B_16K

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

androlike commited on Sep 6, 2023

Commit

d0c829d

•

1 Parent(s): 6a74cd3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ tags:
 Thanks to everyone, who finenuted base Llama2 model, made (Q)LoRas, created scripts for merge: [ties-merge](https://github.com/cg123/ties-merge), [BlockMerge_Gradient](https://github.com/Gryphe/BlockMerge_Gradient), [zaraki-tools](https://github.com/zarakiquemparte/zaraki-tools)
 #### Model details:
 Experiment about merging model with large context length.
-Here are settings for rope scaling, if you are using llama.cpp or koboldcpp:
 ```
 --rope-freq-base 10000 --rope-freq-scale 0.25 -c 16384 (llama.cpp)
 ```

 Thanks to everyone, who finenuted base Llama2 model, made (Q)LoRas, created scripts for merge: [ties-merge](https://github.com/cg123/ties-merge), [BlockMerge_Gradient](https://github.com/Gryphe/BlockMerge_Gradient), [zaraki-tools](https://github.com/zarakiquemparte/zaraki-tools)
 #### Model details:
 Experiment about merging model with large context length.
+Use these rope scaling settings:
 ```
 --rope-freq-base 10000 --rope-freq-scale 0.25 -c 16384 (llama.cpp)
 ```