KielGen-Fast

KielGen-Fast is a fine-tuned multi-modal vision-language model based on the Janus architecture. It unifies three core capabilities within a single autoregressive framework:

  1. Text Generation: Standard conversational reasoning and open-ended text answers.
  2. Image Understanding (Image-to-Text): Visual question answering, scene description, and multimodal analysis.
  3. Text-to-Image Generation: Generating high-fidelity visual assets and creative artwork from descriptive text prompts.

Model Details

  • Model Type: Multi-Modal Causal Language Model (MultiModalityCausalLM)
  • Base Model: deepseek-ai/Janus-Pro-7B
  • Architecture Highlights: Decoupled visual encoder pathways for understanding combined with a vector-quantized token decoding head for native image synthesis.
  • Weights Format: Single unified .safetensors file (model.safetensors) designed for optimized cloud deployment and fast loading.

Quick Start: Loading the Model

Load your fine-tuned model and processor directly from Hugging Face using standard transformers:

import torch
from transformers import AutoProcessor, AutoModel

repo_id = "kiel2/KielGen-Fast"

processor = AutoProcessor.from_pretrained(repo_id, trust_remote_code=True)
model = AutoModel.from_pretrained(
    repo_id, 
    trust_remote_code=True, 
    torch_dtype=torch.bfloat16, 
    device_map="auto"
)
print("KielGen-Fast loaded successfully!")
Downloads last month
9
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for kiel2/KielGen-Fast

Finetuned
(38)
this model