Model Card for Model ID

This model is a fine tuned Llama 3.2 to behave like Jack Sparrow.

Model Details

Model Description

This LLaMA model was fine-tuned on a custom dataset of Jack Sparrow's dialogue extracted from movie scripts, quotes, and paraphrased pirate-style interactions. It's designed to be used in conversational chat interfaces or roleplay environments.

  • Developed by: ebartha
  • Model type: Chat bot
  • Language(s) (NLP): English
  • Finetuned from model [optional]: Llama-3.2-3B-Instruct

Uses

Direct Use

This model can be used as:

  • A conversational AI chatbot for fans of Pirates of the Caribbean
  • A pirate-themed character in a storytelling game or NPC
  • A personality layer on top of LLM agents (e.g., LangChain, CrewAI)

Out-of-Scope Use

  • Not suitable for factual Q&A or critical decision-making
  • Should not be used to impersonate real people or used in harmful, deceptive, or offensive contexts

Bias, Risks, and Limitations

While the model is designed to be humorous and fictional, it is trained on stylized and potentially stereotypical data from movies. Users should not take responses literally or assume cultural accuracy.

Recommendations

Use in entertainment, educational, or fictional settings. Always clarify that the chatbot is a fictional character, not an actual pirate or historical figure.

How to Get Started with the Model

Use the code below to get started with the model.

[More Information Needed]

Training Details

Training Data

The model was fine-tuned on a custom dataset of Jack Sparrow dialogue: Devwa/jackSparrow. The dataset contains over 600 carefully curated and cleaned lines of dialogue from the Pirates of the Caribbean movies, formatted in a ShareGPT-like structure. Each line is embedded in conversational context with pirate-themed prompts, randomized to improve generalization and make the model more interactive.

The data was preprocessed to remove stage directions, formal/non-character lines, and noise (e.g. web references or citations), with additional injections of characteristic Jack Sparrow phrases.

Training Procedure

The model was fine-tuned using Unsloth's SFTTrainer, which wraps around Hugging Face's transformers and trl. The base model was meta-llama/Llama-3.2-3B-Instruct.

Training was conducted using full parameter fine-tuning with LoRA adapters. Each training sample consisted of a single formatted conversation with a user prompt and Jack Sparrow-style response.

Preprocessing [optional]

The dataset text field was text, with pre-formatted prompt/response structure.

Packed sequences were disabled (packing=False) to retain natural dialogue flow.

Each prompt was padded/truncated to a maximum sequence length of 2048 tokens.

Training Hyperparameters

  • Training regime: mixed precision (fp16 if bfloat16 unsupported, bf16 otherwise)

  • Epochs: 1

  • Batch size: 2 (per device)

  • Gradient accumulation: 4 steps (effective batch size: 8)

  • Learning rate: 2e-4

  • Optimizer: AdamW (8-bit)

  • Weight decay: 0.01

  • LR scheduler: Linear

  • Warmup steps: 5

  • Seed: 3407

  • Output dir: outputs/

Speeds, Sizes, Times [optional]

PU = Tesla T4. Max memory = 14.748 GB. 2.635 GB of memory reserved. 1:36:40

Downloads last month
16
GGUF
Model size
3B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Devwa/jackSparrow

Quantized
(547)
this model

Dataset used to train Devwa/jackSparrow