LLMCLI hitting incorrect format

#2
by paulyflynn - opened

Building for debugging...
[116/116] Applying LLMCLI
Build of product 'LLMCLI' complete! (9.32s)
Downloading from smpanaro/Llama-3.2-1B-Instruct-CoreML...
Done.
Downloaded to..../huggingface/models/smpanaro/Llama-3.2-1B-Instruct-CoreML
ModelPipeline Llama-3.2-1B-Instruct (6 chunks)
Error: The data couldn’t be read because it isn’t in the correct format.

directory structure and file sizes seem to match.

β”œβ”€β”€ Llama-3.2-1B-Instruct_chunk1.mlmodelc
β”‚   β”œβ”€β”€ analytics
β”‚   β”‚   └── coremldata.bin
β”‚   β”œβ”€β”€ coremldata.bin
β”‚   β”œβ”€β”€ metadata.json
β”‚   β”œβ”€β”€ model.mil
β”‚   └── weights
β”‚   └── weight.bin
β”œβ”€β”€ Llama-3.2-1B-Instruct_chunk2.mlmodelc
β”‚   β”œβ”€β”€ analytics
β”‚   β”‚   └── coremldata.bin
β”‚   β”œβ”€β”€ coremldata.bin
β”‚   β”œβ”€β”€ metadata.json
β”‚   β”œβ”€β”€ model.mil
β”‚   └── weights
β”‚   └── weight.bin
β”œβ”€β”€ Llama-3.2-1B-Instruct_chunk3.mlmodelc
β”‚   β”œβ”€β”€ analytics
β”‚   β”‚   └── coremldata.bin
β”‚   β”œβ”€β”€ coremldata.bin
β”‚   β”œβ”€β”€ metadata.json
β”‚   β”œβ”€β”€ model.mil
β”‚   └── weights
β”‚   └── weight.bin
β”œβ”€β”€ Llama-3.2-1B-Instruct_chunk4.mlmodelc
β”‚   β”œβ”€β”€ analytics
β”‚   β”‚   └── coremldata.bin
β”‚   β”œβ”€β”€ coremldata.bin
β”‚   β”œβ”€β”€ metadata.json
β”‚   β”œβ”€β”€ model.mil
β”‚   └── weights
β”‚   └── weight.bin
β”œβ”€β”€ Llama-3.2-1B-Instruct_chunk5.mlmodelc
β”‚   β”œβ”€β”€ analytics
β”‚   β”‚   └── coremldata.bin
β”‚   β”œβ”€β”€ coremldata.bin
β”‚   β”œβ”€β”€ metadata.json
β”‚   β”œβ”€β”€ model.mil
β”‚   └── weights
β”‚   └── weight.bin
β”œβ”€β”€ Llama-3.2-1B-Instruct_chunk6.mlmodelc
β”‚   β”œβ”€β”€ analytics
β”‚   β”‚   └── coremldata.bin
β”‚   β”œβ”€β”€ coremldata.bin
β”‚   β”œβ”€β”€ metadata.json
β”‚   β”œβ”€β”€ model.mil
β”‚   └── weights
β”‚   └── weight.bin
β”œβ”€β”€ cache-processor.mlmodelc
β”‚   β”œβ”€β”€ analytics
β”‚   β”‚   └── coremldata.bin
β”‚   β”œβ”€β”€ coremldata.bin
β”‚   β”œβ”€β”€ metadata.json
β”‚   └── model.mil
└── logit-processor.mlmodelc
β”œβ”€β”€ analytics
β”‚   └── coremldata.bin
β”œβ”€β”€ coremldata.bin
β”œβ”€β”€ metadata.json
└── model.mil

I rm -rf and re-downloaded. worked

paulyflynn changed discussion status to closed

Someone on GitHub had the same error (https://github.com/smpanaro/coreml-llm-cli/issues/4). I’m not sure if they ever fixed it though.

As mentioned there, it does work for some people, so maybe we can figure out what is wrong.

  • What OS are you on?
  • How much free disk space do you have?
  • Can you try rebooting?

Oh, fantastic. (Funny timing too.)

FYI
OS: macOS 15.3.1
Disk free: 73GB

Sign up or log in to comment