seba commited on
Commit
60cf301
1 Parent(s): a36f620

Create README.md

Browse files

Example command to run:
```
python -m src.coreml_example --model-path-mf ./Llama-3.2-1B-4bits-MF.mlmodelc --model-path-head ./Llama-3.2-1B-HEAD-6Bits.mlmodelc/ --model-path-emb ./Llama-3.2-1B-EMB-16Bits.mlmodelc --prompt "Write a poem joke about Harry Potter" --max-tokens 400 --temp 1.5
```
You need to have set or provided `HF_TOKEN` environment variable

Files changed (1) hide show
  1. README.md +4 -0
README.md ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - coreml
4
+ ---