LLMCLI hitting incorrect format
Building for debugging...
[116/116] Applying LLMCLI
Build of product 'LLMCLI' complete! (9.32s)
Downloading from smpanaro/Llama-3.2-1B-Instruct-CoreML...
Done.
Downloaded to..../huggingface/models/smpanaro/Llama-3.2-1B-Instruct-CoreML
ModelPipeline Llama-3.2-1B-Instruct (6 chunks)
Error: The data couldnβt be read because it isnβt in the correct format.
directory structure and file sizes seem to match.
βββ Llama-3.2-1B-Instruct_chunk1.mlmodelc
β βββ analytics
β β βββ coremldata.bin
β βββ coremldata.bin
β βββ metadata.json
β βββ model.mil
β βββ weights
β βββ weight.bin
βββ Llama-3.2-1B-Instruct_chunk2.mlmodelc
β βββ analytics
β β βββ coremldata.bin
β βββ coremldata.bin
β βββ metadata.json
β βββ model.mil
β βββ weights
β βββ weight.bin
βββ Llama-3.2-1B-Instruct_chunk3.mlmodelc
β βββ analytics
β β βββ coremldata.bin
β βββ coremldata.bin
β βββ metadata.json
β βββ model.mil
β βββ weights
β βββ weight.bin
βββ Llama-3.2-1B-Instruct_chunk4.mlmodelc
β βββ analytics
β β βββ coremldata.bin
β βββ coremldata.bin
β βββ metadata.json
β βββ model.mil
β βββ weights
β βββ weight.bin
βββ Llama-3.2-1B-Instruct_chunk5.mlmodelc
β βββ analytics
β β βββ coremldata.bin
β βββ coremldata.bin
β βββ metadata.json
β βββ model.mil
β βββ weights
β βββ weight.bin
βββ Llama-3.2-1B-Instruct_chunk6.mlmodelc
β βββ analytics
β β βββ coremldata.bin
β βββ coremldata.bin
β βββ metadata.json
β βββ model.mil
β βββ weights
β βββ weight.bin
βββ cache-processor.mlmodelc
β βββ analytics
β β βββ coremldata.bin
β βββ coremldata.bin
β βββ metadata.json
β βββ model.mil
βββ logit-processor.mlmodelc
βββ analytics
β βββ coremldata.bin
βββ coremldata.bin
βββ metadata.json
βββ model.mil
I rm -rf and re-downloaded. worked
Someone on GitHub had the same error (https://github.com/smpanaro/coreml-llm-cli/issues/4). Iβm not sure if they ever fixed it though.
As mentioned there, it does work for some people, so maybe we can figure out what is wrong.
- What OS are you on?
- How much free disk space do you have?
- Can you try rebooting?
Oh, fantastic. (Funny timing too.)
FYI
OS: macOS 15.3.1
Disk free: 73GB