Spaces:

CoderCowMoo
/

Llama-3-70b-Instruct-Orthoganalized

Runtime error

App Files Files Community

Llama-3-70b-Instruct-Orthoganalized / app.py

Commit History

problem with marlin_kernel step

5be4bff
verified

CoderCowMoo commited on May 5

disable exllamav2 and use marlin

d23fc4b
verified

CoderCowMoo commited on May 5

use_exllama=false?

cdcdc4e
verified

CoderCowMoo commited on May 5

exactly like the exampe

f37371f
verified

CoderCowMoo commited on May 5

forgot comma dumbass

2ebd075
verified

CoderCowMoo commited on May 5

Might've been adding device= in wrong spot.

84b43c9
verified

CoderCowMoo commited on May 5

No device, and cuda in the spaces function?

125b498
verified

CoderCowMoo commited on May 5

Maybe auto device map

5e96c36
verified

CoderCowMoo commited on May 5

Maybe remove device?

332c1a1
verified

CoderCowMoo commited on May 5

change device to cuda:0 same as mazaiyahr's repo

606fa0a
verified

CoderCowMoo commited on May 5

Change to use GPTQ so i dont get limited

3974b7a
verified

CoderCowMoo commited on May 5

llama 3 dumbass

267b4cd
verified

CoderCowMoo commited on May 5

import from transformers dumbass

4f77518
verified

CoderCowMoo commited on May 5

Destroy default and add my own files

e9af225
verified

CoderCowMoo commited on May 5

Duplicate from gradio-templates/chatbot

2f309cd
verified

pngwn HF staff commited on May 5