LoftQ
/

Phi-3-mini-4k-instruct-4bit-64rank

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

LoftQ commited on May 3

Commit

2c16204

•

1 Parent(s): cba7046

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -19,9 +19,9 @@ The backbone is under `LoftQ/Phi-3-mini-4k-instruct-4bit-64rank` and LoRA adapte
 ## Model Info
 ### Backbone
 - Stored format: nf4
-- Size: ~ 5.5 GiB
 - Loaded format: bitsandbytes nf4
-- Size loaded on GPU: ~1.4 GiB
 ### LoRA adapters
 - rank: 64

 ## Model Info
 ### Backbone
 - Stored format: nf4
+- Size: ~ 2.5 GiB
 - Loaded format: bitsandbytes nf4
+- Size loaded on GPU: ~2.5 GiB
 ### LoRA adapters
 - rank: 64