Instructions to use Vexxations/herta_lora_v0.1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Vexxations/herta_lora_v0.1 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Vexxations/herta_lora_v0.1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
Uploaded model
- Developed by: Vexxations
- License: apache-2.0
- Finetuned from model : unsloth/llama-3-8b-Instruct-bnb-4bit
LoRA adapters for Hertabot v0.1, a conversational chatbot finetuned from llama-3-8b-instruct for deploying on Discord. This is an incredibly early-stage model that will be replaced as soon as improvements are made - and there are PLENTY
Planned additions:
- Discord action integration: allow for usage of images, emojis, gifs and other features on discord
- Memory: remember users by name, traits inferred from messages
- User recognition: distinguish users in context and address them accordingly
- Enhanced persona believability: ensure Herta has no knowledge of "real life" subjects or distances herself from it (technically Earth is insignificant to her, and she's from the future)
- Improved system prompt: Prompt atm is using Deepseekslop and I'd rather look over it and finetune it myself
- Etc.
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Vexxations/herta_lora_v0.1
Base model
unsloth/llama-3-8b-Instruct-bnb-4bit