SHRDFU-7b-gamma / README.md
maldv's picture
Update README.md
9ab178d verified
metadata
language:
  - en
license: cc-by-nc-4.0
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - mistral
  - GEB
base_model: ammarali32/multi_verse_model
datasets:
  - maldv/crabcanon

SHRDFU-7b Γ

  • Developed by: maldv
  • License: cc-by-nc-4.0
  • Finetuned from model: ammarali32/multi_verse_model
  • Methodology: Targeting attention layers with peft to condition; then small full layer tuning; extending intelligence and problem solving w/ crabcanon

As I work on understanding how to layer information in to the model, this dataset has some good parts and bad. I think one or two more experiments and I move on.