File size: 798 Bytes
8c05033
b40d265
 
 
8c05033
b40d265
 
8c05033
b40d265
 
 
 
 
8c05033
 
9ab178d
8c05033
b40d265
 
 
 
8c05033
b40d265
8c05033
b40d265
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
language:
- en
license: cc-by-nc-4.0
tags:
- text-generation-inference
- transformers
- unsloth
- mistral
- GEB
base_model: ammarali32/multi_verse_model
datasets:
- maldv/crabcanon
---

# SHRDFU-7b Γ

- **Developed by:** maldv
- **License:** cc-by-nc-4.0
- **Finetuned from model:** ammarali32/multi_verse_model
- **Methodology:** Targeting attention layers with peft to condition; then small full layer tuning; extending intelligence and problem solving w/ crabcanon

As I work on understanding how to layer information in to the model, this dataset has some good parts and bad.  I think one or two more experiments and I move on.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="50"/>](https://github.com/unslothai/unsloth)