Text Generation
Transformers
Safetensors
English
llama
sft
text-generation-inference
4-bit precision
gptq

Commit History

Upload README.md
6557836

TheBloke commited on

Upload README.md
fa4d578

TheBloke commited on

Update for Transformers GPTQ support
9323370

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
e3ce21d

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
040dc6e

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
75527d2

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
57b923d

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
60b8108

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
c7c658d

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
92fac14

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
33f2140

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
92098a4

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
1fef2fa

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
920b338

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
1867fec

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
c194824

TheBloke commited on

Re-done GPTQ, quantised with sequence length 8K
67dce60

TheBloke commited on

Initial GPTQ model commit
1fba035

TheBloke commited on

Initial GPTQ model commit
d232351

TheBloke commited on

Initial GPTQ model commit
8c8923d

TheBloke commited on

Initial GPTQ model commit
ba085e9

TheBloke commited on

Initial GPTQ model commit
3cb7bc4

TheBloke commited on

Initial GPTQ model commit
58fb024

TheBloke commited on

Initial GPTQ model commit
03bad6f

TheBloke commited on

Initial GPTQ model commit
47d1210

TheBloke commited on

Initial GPTQ model commit
146bd00

TheBloke commited on

Initial GPTQ model commit
7cded84

TheBloke commited on

Initial GPTQ model commit
211eeb7

TheBloke commited on

Initial GPTQ model commit
ca4106d

TheBloke commited on

Initial GPTQ model commit
2cf1cb5

TheBloke commited on

Initial GPTQ model commit
878cdfc

TheBloke commited on

initial commit
29cf2c7

TheBloke commited on