Suparious commited on
Commit
0fb2abd
1 Parent(s): 7458ded

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -1,11 +1,14 @@
1
  ---
2
  library_name: transformers
 
3
  tags:
4
  - 4-bit
5
  - AWQ
6
  - text-generation
7
  - autotrain_compatible
8
  - endpoints_compatible
 
 
9
  pipeline_tag: text-generation
10
  inference: false
11
  quantized_by: Suparious
@@ -15,10 +18,14 @@ quantized_by: Suparious
15
  - Model creator: [mlabonne](https://huggingface.co/mlabonne)
16
  - Original model: [Hermes-3-Llama-3.1-8B-lorablated](https://huggingface.co/mlabonne/Hermes-3-Llama-3.1-8B-lorablated)
17
 
 
18
 
 
19
 
20
- ## How to use
 
21
 
 
22
  ### Install the necessary packages
23
 
24
  ```bash
 
1
  ---
2
  library_name: transformers
3
+ base_model: mlabonne/Hermes-3-Llama-3.1-8B-lorablated
4
  tags:
5
  - 4-bit
6
  - AWQ
7
  - text-generation
8
  - autotrain_compatible
9
  - endpoints_compatible
10
+ - mergekit
11
+ - merge
12
  pipeline_tag: text-generation
13
  inference: false
14
  quantized_by: Suparious
 
18
  - Model creator: [mlabonne](https://huggingface.co/mlabonne)
19
  - Original model: [Hermes-3-Llama-3.1-8B-lorablated](https://huggingface.co/mlabonne/Hermes-3-Llama-3.1-8B-lorablated)
20
 
21
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/4Hbw5n68jKUSBQeTqQIeT.png)
22
 
23
+ The recipe is based on @grimjim's [grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter](https://huggingface.co/grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter) (special thanks):
24
 
25
+ 1. **Extraction**: We extract a LoRA adapter by comparing two models: a censored Llama 3.1 ([meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct)) and an abliterated Llama 3.1 ([mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated](https://huggingface.co/mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated)).
26
+ 2. **Merge**: We merge this new LoRA adapter using [task arithmetic](https://arxiv.org/abs/2212.04089) to the censored [NousResearch/Hermes-3-Llama-3.1-8B](https://huggingface.co/NousResearch/Hermes-3-Llama-3.1-8B) to abliterate it.
27
 
28
+ ## How to use
29
  ### Install the necessary packages
30
 
31
  ```bash