---
language:
- en
license: cc-by-nc-4.0
tags:
- text-generation-inference
- transformers
- unsloth
- mistral
- GEB
base_model: ammarali32/multi_verse_model
datasets:
- maldv/crabcanon
---

# SHRDFU-7b LoRA

- **Developed by:** maldv
- **License:** cc-by-nc-4.0
- **Finetuned from model:** ammarali32/multi_verse_model
- **Methodology:** Targeting attention layers with peft to condition; then small full layer tuning; extending intelligence and problem solving w/ crabcanon

As I work on understanding how to layer information in to the model, this dataset has some good parts and bad.  I think one or two more experiments and I move on.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="50"/>](https://github.com/unslothai/unsloth)