Spaces:

mlabonne
/

llm-auto-eval

Running

Multiple GPU's

by CultriX - opened Mar 15

Mar 15

Does adding more than one GPU actually do something? For me it just sits idle, or is it not supposed to speed up the evaluation but instead only serves for when the model is so large it does not fit on the VRAM of a single GPU?

Thanks for clarifying!

mlabonne

Owner Mar 15

Yeah, this is how it currently works but I'll fix it soon.

CultriX

Mar 16

•

edited Mar 16

Idk man still seeing some idle GPU's up in here.... (up in here! up in here!)

lol just kidding that explains it thanks mate! Awesome NoteBook!

EDIT: I just realised that there are few things in life as sad as a completely idle GPU... It's like expired condoms or something you know? So much potential that could have been but never was... lmao

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment