Nexesenex commited on
Commit
6a2bafc
1 Parent(s): 7eed426

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ Requantization of a Q5_K_M quant of a trending 70b model without better quant/fp16 available, this through a Q8_0 intermediary step.
2
+
3
+ Model has a theta of 1,000,000, and not 10,000, like Llama 2 models usually have.
4
+
5
+ So, no Alpha or Rope Base Frequency up to its base 32k context, if it works as intended.