Hugging Face's logo

ThomasBaruzier
/
Llama-3.1-Minitron-4B-Width-Base-GGUF

GGUF
Inference Endpoints
imatrix
Model card Files Community
ThomasBaruzier commited on
Commit
ed03c0a
•
1 Parent(s): 34711d9

Delete ppl.sh

Browse files
Files changed (1) hide show
  1. ppl.sh +0 -22
ppl.sh DELETED
@@ -1,22 +0,0 @@
1
- . ~/.profile
2
-
3
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-IQ4_NL.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
4
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-IQ4_XS.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
5
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q2_K.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
6
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q2_K_S.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
7
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q3_K_L.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
8
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q3_K_M.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
9
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q3_K_S.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
10
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q4_0.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
11
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q4_0_4_4.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
12
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q4_0_4_8.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
13
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q4_0_8_8.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
14
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q4_1.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
15
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q4_K_M.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
16
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q4_K_S.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
17
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q5_0.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
18
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q5_1.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
19
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q5_K_M.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
20
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q5_K_S.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
21
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q6_K.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99
22
- gguf ppl -m Llama-3.1-Minitron-4B-Width-Base-Q8_0.gguf -f ../../misc/wiki.test.raw --no-mmap -ngl 99