gpt-4chan

This model is a fine-tuned version of .\checkpoints\gpt-4chan\ trained on 4chan board thread structures and greentext formatting.

Usage

You can load and run this model directly using Hugging Face transformers:

import torch
from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline

model_id = "wildarrows/gpt-4chan"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    torch_dtype=torch.float16 if torch.cuda.is_available() else torch.float32,
    device_map="auto"
)

prompt = "--- 10000001\nAnonymous\n>be me\n>experimenting with AI\n--- 10000002\n>>10000001\n"
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)

outputs = model.generate(
    **inputs,
    max_new_tokens=250,
    temperature=0.7,
    top_p=0.9,
    do_sample=True,
    repetition_penalty=1.2
)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

Prompt Format

The model responds to the serialized 4chan thread format:

--- <post_id>
<original post content>
--- <reply_id>
>>post_id
<model writes response here>