HuggingChat hardware requirements

#23
by InferencetrainingAI - opened

What are the GPU and memory requirements for HuggingChat?

interresting

As this is 30b model i guess it is 60gb vram for half precision

Sign up or log in to comment