bartowski/sophosympatheia_Magistry-24B-v1.1-GGUF
Text Generation • 24B • Updated • 3.74k • 2
🏗️ Building on HF
Nasho
Nacholmo
AI & ML interests
Controlnet, Diffusers
Recent Activity
liked a model 4 months ago
bartowski/sophosympatheia_Magistry-24B-v1.1-GGUF updated a model 5 months ago
Nacholmo/ignore-RVC-models liked a model 5 months ago
circlestone-labs/AnimaOrganizations
liked a
model 4 months ago
updated a
model 5 months ago
liked a
model 5 months ago
updated a
model 6 months ago
published a
model 6 months ago
liked a
model 8 months ago
liked 2
models 11 months ago
liked a
model 12 months ago
reacted to sweatSmile's post with 🚀 12 months ago
Post
2809
Teaching a 7B Model to Be Just the Right Amount of Snark
Ever wondered if a language model could get sarcasm? I fine-tuned Mistral-7B using LoRA and 4-bit quantisation—on just ~720 hand-picked sarcastic prompt–response pairs from Reddit, Twitter, and real-life conversations.
The challenge? Keeping it sarcastic but still helpful.
LoRA rank 16 to avoid overfitting
4-bit NF4 quantization to fit on limited GPU memory
10 carefully monitored epochs so it didn’t turn into a full-time comedian
Result: a model that understands “Oh great, another meeting” exactly as you mean it.
Read the full journey, tech details, and lessons learned on my blog:
Fine-Tuning Mistral-7B for Sarcasm with LoRA and 4-Bit Quantisation
Try the model here on Hugging Face: sweatSmile/Mistral-7B-Instruct-v0.1-Sarcasm.
Ever wondered if a language model could get sarcasm? I fine-tuned Mistral-7B using LoRA and 4-bit quantisation—on just ~720 hand-picked sarcastic prompt–response pairs from Reddit, Twitter, and real-life conversations.
The challenge? Keeping it sarcastic but still helpful.
LoRA rank 16 to avoid overfitting
4-bit NF4 quantization to fit on limited GPU memory
10 carefully monitored epochs so it didn’t turn into a full-time comedian
Result: a model that understands “Oh great, another meeting” exactly as you mean it.
Read the full journey, tech details, and lessons learned on my blog:
Fine-Tuning Mistral-7B for Sarcasm with LoRA and 4-Bit Quantisation
Try the model here on Hugging Face: sweatSmile/Mistral-7B-Instruct-v0.1-Sarcasm.
liked a
model 12 months ago
liked a
Space 12 months ago
liked 2
models 12 months ago
liked a
Space 12 months ago
liked a
model about 1 year ago
liked a
Space about 1 year ago
liked 3
models about 1 year ago
