Hugging Face's logo

Spaces:
CoderCowMoo
/
Llama-3-70b-Instruct-Orthoganalized
Runtime error

App Files Community
Llama-3-70b-Instruct-Orthoganalized

Commit History

problem with marlin_kernel step
5be4bff
verified

CoderCowMoo commited on

disable exllamav2 and use marlin
d23fc4b
verified

CoderCowMoo commited on

use_exllama=false?
cdcdc4e
verified

CoderCowMoo commited on

Update requirements.txt
f084fbc
verified

CoderCowMoo commited on

exactly like the exampe
f37371f
verified

CoderCowMoo commited on

forgot comma dumbass
2ebd075
verified

CoderCowMoo commited on

Might've been adding device= in wrong spot.
84b43c9
verified

CoderCowMoo commited on

No device, and cuda in the spaces function?
125b498
verified

CoderCowMoo commited on

Maybe auto device map
5e96c36
verified

CoderCowMoo commited on

Maybe remove device?
332c1a1
verified

CoderCowMoo commited on

change device to cuda:0 same as mazaiyahr's repo
606fa0a
verified

CoderCowMoo commited on

Add auto-gptq dep
b17bd82
verified

CoderCowMoo commited on

Change to use GPTQ so i dont get limited
3974b7a
verified

CoderCowMoo commited on

llama 3 dumbass
267b4cd
verified

CoderCowMoo commited on

import from transformers dumbass
4f77518
verified

CoderCowMoo commited on

fix bitsandbytes no gpu support hopefully
d592427
verified

CoderCowMoo commited on

Remove pytorch version entirely
dd7da24
verified

CoderCowMoo commited on

2.2.1 to 2.2.0
65a95d9
verified

CoderCowMoo commited on

Change pytorch version and cuda version hopefully fix
c388e1e
verified

CoderCowMoo commited on

Update README.md
b992b5e
verified

CoderCowMoo commited on

Destroy default and add my own files
e9af225
verified

CoderCowMoo commited on

Duplicate from gradio-templates/chatbot
2f309cd
verified

CoderCowMoo pngwn HF staff commited on