unsloth
/

Llama-3.1-Nemotron-70B-Instruct-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Problem loading with vllm

#8 opened 29 days ago by

vram+ram

#7 opened about 1 month ago by

Code

#6 opened about 2 months ago by

code

#5 opened about 2 months ago by

colab t4

#4 opened about 2 months ago by

convert

#3 opened about 2 months ago by

to gguf

#2 opened about 2 months ago by

how to run

#1 opened about 2 months ago by