Model Card for molbal/novelstral-7b

Short response, text completion model trained on various novels.

Model Details

This is a text completion model, designed to advance a story a few lines at a time.

  • Developed by: https://huggingface.co/molbal
  • Model type: Mistral 7b fine-tune
  • Language(s) (NLP): English only
  • License: wtfpl
  • Finetuned from model: unsloth/mistral-7b-bnb-4bit
  • Notes: This model is in 4bit quants only, as its primary purpose is experimentation and that's what performs well locally on my laptop

Framework versions

  • PEFT 0.10.0
  • Unsloth for training
Downloads last month
9
GGUF
Model size
7.24B params
Architecture
llama

4-bit

Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for molbal/novelstral-7b

Adapter
(63)
this model