QuietImpostor commited on
Commit
997186e
1 Parent(s): ded9715

Update README.md

Browse files

Added update about no more finetuning.

Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -16,7 +16,7 @@ language:
16
  This is a prune of [Llama 3 Refueled](https://www.huggingface.co/refuelai/llama-3-refueled) using [mergekit](https://github.com/cg123/mergekit) and [PruneMe](https://www.github.com/arcee-ai/PruneMe)
17
  The model is semi-tested, but still needs some debugging, namely with converting to GGUF, though I am working on that.
18
 
19
- Note: the [dataset](https://www.huggingface.co/yahma/alpaca-cleaned) was used for evaluating what layers should be pruned. This model was **NOT** (yet) finetuned.
20
 
21
  ### Performance
22
  After only 1 test because of lack of compute and for stupid long inference times on my 3060ti (8GB), it does show some interesting results.
@@ -30,6 +30,7 @@ Hi! I can help you find the best travel tips and recommendations for your next t
30
 
31
  Even without finetuning, the model still exhibits some extent of instruction following.
32
  And fine-tuning is a WIP and I will update this when it's ready.
 
33
 
34
  ### Configuration
35
 
 
16
  This is a prune of [Llama 3 Refueled](https://www.huggingface.co/refuelai/llama-3-refueled) using [mergekit](https://github.com/cg123/mergekit) and [PruneMe](https://www.github.com/arcee-ai/PruneMe)
17
  The model is semi-tested, but still needs some debugging, namely with converting to GGUF, though I am working on that.
18
 
19
+ Note: the [dataset](https://www.huggingface.co/yahma/alpaca-cleaned) was used for evaluating what layers should be pruned. This model was **NOT** finetuned.
20
 
21
  ### Performance
22
  After only 1 test because of lack of compute and for stupid long inference times on my 3060ti (8GB), it does show some interesting results.
 
30
 
31
  Even without finetuning, the model still exhibits some extent of instruction following.
32
  And fine-tuning is a WIP and I will update this when it's ready.
33
+ Finetuning is no longer in progress due to issues with unsloth. However, I am working on a project that will hopefully make pruning models easier.
34
 
35
  ### Configuration
36