llamafile: virus message.

#7
by vonjd - opened

The llamafile can not be downloaded because windows blocks it due to a virus message. Please advise, thank you.

Similar issue, Bitdefender just quarantined it.

if you don't trust it you can download the model and llamafile separately

mozilla org

Virus scanners sometimes get upset about our binaries that have weights inside them. We can't get them unflagged, because the online form with Microsoft Security Intelligence has an upload limit. What we can promise, is that the llamafile release binaries won't be flagged by Windows Defender. (We have zero support for any other AVs). So, could you try these commands:

curl -L -o llamafile.exe https://github.com/Mozilla-Ocho/llamafile/releases/download/0.7/llamafile-0.7
curl -L -o llava-v1.5-7b-Q4_K.gguf https://huggingface.co/jartine/llava-v1.5-7B-GGUF/resolve/main/llava-v1.5-7b-Q4_K.gguf
curl -L -o llava-v1.5-7b-mmproj-Q8_0.gguf https://huggingface.co/jartine/llava-v1.5-7B-GGUF/resolve/main/llava-v1.5-7b-mmproj-Q8_0.gguf
.\llamafile.exe -m llava-v1.5-7b-Q4_K.gguf --mmproj llava-v1.5-7b-mmproj-Q8_0.gguf --image SOMETHING.JPG -p "### User: What do you see?\n### Assistant:"

If that still gets flagged by Windows Defender, you should file an issue on https://github.com/mozilla-ocho/llamafile/

jartine changed discussion status to closed

Sign up or log in to comment