secretmoon
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -68,15 +68,17 @@ input_text = "Tell me about the abandoned castle in the Everfree forest."
|
|
68 |
inputs = tokenizer(input_text, return_tensors="pt")
|
69 |
outputs = adapter_model.generate(**inputs, max_length=300)
|
70 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
71 |
-
|
72 |
|
73 |
|
74 |
## Merge:
|
75 |
|
76 |
1. **Using Axolotl** (https://github.com/OpenAccess-AI-Collective/axolotl)
|
77 |
```bash
|
78 |
-
python3 -m axolotl.cli.merge_lora lora.yml --lora_model_dir="./completed-model"
|
|
|
79 |
|
80 |
2. **Conversion to adapter for gguf in OLD llama.cpp**
|
81 |
```bash
|
82 |
-
python3 convert-lora-to-ggml.py /path/to/lora/adapter
|
|
|
|
68 |
inputs = tokenizer(input_text, return_tensors="pt")
|
69 |
outputs = adapter_model.generate(**inputs, max_length=300)
|
70 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
71 |
+
```
|
72 |
|
73 |
|
74 |
## Merge:
|
75 |
|
76 |
1. **Using Axolotl** (https://github.com/OpenAccess-AI-Collective/axolotl)
|
77 |
```bash
|
78 |
+
python3 -m axolotl.cli.merge_lora lora.yml --lora_model_dir="./completed-model"
|
79 |
+
```
|
80 |
|
81 |
2. **Conversion to adapter for gguf in OLD llama.cpp**
|
82 |
```bash
|
83 |
+
python3 convert-lora-to-ggml.py /path/to/lora/adapter
|
84 |
+
```
|