Hugging Face's logo

Jellon
/
gemma2-27b_GutenBerg_Nyxora-exl2-4bpw

Text Generation
Transformers
Safetensors
gemma2
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
4-bit precision
exl2
Model card Files Community
Jellon commited on
Commit
d0b6029
·
verified ·
1 Parent(s): 3847923

Upload 9 files

Browse files
Files changed (3) hide show
  1. README.md +0 -3
  2. config.json +1 -1
  3. output-00001-of-00002.safetensors +2 -2
README.md CHANGED
@@ -8,9 +8,6 @@ tags:
8
  - merge
9
 
10
  ---
11
-
12
- 4bpw exl2 quant of https://huggingface.co/DazzlingXeno/GutenBerg_Nyxora
13
-
14
  # merge
15
 
16
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
 
8
  - merge
9
 
10
  ---
 
 
 
11
  # merge
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
config.json CHANGED
@@ -35,7 +35,7 @@
35
  "quant_method": "exl2",
36
  "version": "0.2.3",
37
  "bits": 4.0,
38
- "head_bits": 8,
39
  "calibration": {
40
  "rows": 115,
41
  "length": 2048,
 
35
  "quant_method": "exl2",
36
  "version": "0.2.3",
37
  "bits": 4.0,
38
+ "head_bits": 6,
39
  "calibration": {
40
  "rows": 115,
41
  "length": 2048,
output-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:44bdf8bf7f0a133013549270621ec365064e59c2f4e4376986db014b260dc326
3
- size 8559888234
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c073433cc497d8aa9ee7bc0513436c68d9a39450d3a38de67212b17e944dcea4
3
+ size 8575402098