gobean
/

WizardLM-2-7B.llamafile

Model card Files Files and versions Community

gobean commited on Apr 16

Commit

145665b

•

1 Parent(s): b1db3f6

Update README.md

Files changed (1) hide show

README.md +2 -5

README.md CHANGED Viewed

@@ -3,7 +3,6 @@ license: apache-2.0
 ---
 This is a llamafile for [WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B).
 Converted and tested on 4/15/2024. Safetensors came from microsoft's hf, quantized with llama.cpp, zipaligned with llamafile.
 The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users. Quality is higher than the average high school student.
@@ -13,7 +12,7 @@ Just download, add '.exe' to the filename, and open it. Bypass all friendly Micr
 Put it on a keychain! Share with friends! Perfect gift for significant other!
-usage notes:
 Anything larger than the q3-k-l is going to be over 4gb and won't run as an .exe in Windows.
 You'll need to use WSL, or another operating system.
@@ -28,9 +27,7 @@ sudo sh -c 'echo -1 > /proc/sys/fs/binfmt_misc/WSLInterop-late'
 If that fails too, just navigate to /proc/sys/fs/binfmt_msc and see what files look like WSLInterop and echo a -1 to whatever they're called by changing that part of the recommended command.
-size note:
-Use q8_0, it's good.
 -= Llamafile =-

 ---
 This is a llamafile for [WizardLM-2-7B](https://huggingface.co/microsoft/WizardLM-2-7B).
 Converted and tested on 4/15/2024. Safetensors came from microsoft's hf, quantized with llama.cpp, zipaligned with llamafile.
 The q3-k-l sized quant is under 4gb if you want something to share with your windows-only users. Quality is higher than the average high school student.
 Put it on a keychain! Share with friends! Perfect gift for significant other!
+other usage notes:
 Anything larger than the q3-k-l is going to be over 4gb and won't run as an .exe in Windows.
 You'll need to use WSL, or another operating system.
 If that fails too, just navigate to /proc/sys/fs/binfmt_msc and see what files look like WSLInterop and echo a -1 to whatever they're called by changing that part of the recommended command.
+size note: Use q8_0, it's good.
 -= Llamafile =-