What does low_cpu_mem_usage do?
#8
by
omgwenxx
- opened
I was trying to figure out from the source code (https://huggingface.co/docs/transformers/model_doc/llava#transformers.LlavaForConditionalGeneration) what low_cpu_mem_usage is used for but I could not figure it out. Can someone explain to me what it does in the background? Does it make any difference if I run it on the GPU anyway?
Many thx!
There's an explaination of this param just below the https://huggingface.co/docs/transformers/main_classes/model#transformers.PreTrainedModel.from_pretrained.example section