Does it support --pre_layers?
#7
by
SaintHuggingface
- opened
I get out of memory as I only have 8gb vram. So I was trying to run it with --pre_layersm but I get this error. I was using text_generation_webui.AttributeError: 'Offload_LlamaModel' object has no attribute 'preload'
or Missing key(s) in state_dict: