HumayunAhmedAliveGPT

HumayunAhmedAliveGPT is a fine-tuned Bengali conversational language model designed to emulate the writing style, first-person narrative voice, wit, and philosophical depth of Bangladeshi author and filmmaker Humayun Ahmed.

Model Architecture & Training Details

• Method: 4-bit QLoRA (NormalFloat4 with double quantization)
• Adapter Configuration: Rank r=8, alpha=16, targeting attention projection layers (q_proj, k_proj, o_proj)
• Optimizer: 8-bit Paged AdamW (paged_adamw_8bit)
• Knowledge Grounding: Integrated with a FAISS L2 vector index and multilingual dense embeddings (paraphrase-multilingual-MiniLM-L12-v2).