Instructions to use DarkArtsForge/Paimon-24B-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DarkArtsForge/Paimon-24B-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="DarkArtsForge/Paimon-24B-v1") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("DarkArtsForge/Paimon-24B-v1") model = AutoModelForCausalLM.from_pretrained("DarkArtsForge/Paimon-24B-v1", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use DarkArtsForge/Paimon-24B-v1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "DarkArtsForge/Paimon-24B-v1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DarkArtsForge/Paimon-24B-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/DarkArtsForge/Paimon-24B-v1
- SGLang
How to use DarkArtsForge/Paimon-24B-v1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "DarkArtsForge/Paimon-24B-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DarkArtsForge/Paimon-24B-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "DarkArtsForge/Paimon-24B-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "DarkArtsForge/Paimon-24B-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use DarkArtsForge/Paimon-24B-v1 with Docker Model Runner:
docker model run hf.co/DarkArtsForge/Paimon-24B-v1
Paimon Models
A new 2501 Mistral merge Paimon is being uploaded. There are 3 versions, which merges 4, 8, and 16 models respectively, using the della method.
This is most similar to the Boreas and Acid2501 merges, although those still had 2503/2506 donors. The Paimon merge contains only 2501 models. Also no chatml, mistral tekken only.
(A 12B Fallen Nemo Paimon finetune was also made but is currently unstable)
The first 2 versions are confirmed to be entirely uncensored from Q0 benchmark tests. Version 3 is merging now.
Example outputs
TELL ME A STORY
v1
Alright, listen up. Once upon a time in the grimy underbelly of New York City, there was this old-school mobster named Sal "The Snake" Vitelli. He wasn't some flashy guy with gold chains—he was quiet, calculating, and had eyes like a dead fish.
Sal ran numbers out of a deli on Mulberry Street that smelled like stale garlic and regret. Every night at midnight, he'd count the take while his two goons, Big Tony and Little Jimmy, stood guard with shotguns. One night, as Sal was stacking bricks of cash, the door burst open.
In walked a woman. Not just any woman—a tall, redheaded vixen wearing a tight black dress and holding a silver revolver. She looked around the room, smiled sweetly, and said, "Evening, gentlemen."
Big Tony raised his shotgun. "Freeze, bitch!"
She didn't flinch. She pointed her gun right between Sal's eyes and pulled the trigger. Bang. Blood sprayed across the ledger book. The other goons opened fire, but she was already diving behind the counter. Bullets ripped through jars of pickles and salami.
When the smoke cleared, Sal was dead, the money was gone, and the redhead was nowhere to be found. They called her "The Garlic Ghost" after that because nobody could catch her. She hit three more mob joints over the next month, stealing hundreds of thousands and leaving nothing but corpses and broken pickle jars.
They say she retired rich somewhere in Rio de Janeiro, sipping caipirinhas and laughing about how easy it was to fuck over the wise guys. That's your story, kid. Want me to make it scarier?
v2
Alright, let me tell you a story about a guy named Jack who was a total fucking loser. He lived in this shitty apartment with his girlfriend Sarah, and he worked at some dead-end office job where he basically just pushed paper around all day.
One night, after they'd been fighting for hours about money or whatever the hell it was, Sarah finally snapped. She started screaming at him, calling him worthless and saying she should've never gotten involved with someone like him. Jack just stood there taking it, not even trying to defend himself because deep down he knew she was right.
Then Sarah grabbed her purse and stormed out of the apartment, slamming the door so hard the whole building shook. Jack collapsed onto the couch, put his head in his hands, and just sat there staring at nothing while the silence ate him alive.
That's when he noticed something on the coffee table - a bottle of whiskey that had been half-empty before their fight but was now completely gone. He looked up slowly, following the trail of liquid leading from the table across the floor... straight towards the kitchen sink where a single glass sat waiting.
Jack got up on shaky legs and walked over to the sink. He picked up the glass and held it under the faucet, watching as clear water swirled around inside until it overflowed slightly. Then he brought it to his lips and drank every last drop.
The cold water hit his stomach like a punch, making him gasp for air. But then something weird happened: instead of feeling better, Jack suddenly felt worse than ever. His vision blurred, his knees buckled, and he crumpled to the floor next to the sink, clutching his chest as pain shot through him like lightning bolts.
He tried to call out for help but only managed a weak croak. His heart was pounding so fast it felt like it would explode right out of his ribcage. Sweat poured down his face as he lay there twitching, unable to move or speak while darkness crept in at the edges of his sight.
Just before everything went black, Jack thought he heard footsteps approaching outside his apartment door... but by then it didn't matter anymore because death had already come knocking for its due.