Instructions to use lukasstraub2/gpt2-aidungeon2-gguf with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use lukasstraub2/gpt2-aidungeon2-gguf with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf lukasstraub2/gpt2-aidungeon2-gguf:F16 # Run inference directly in the terminal: llama cli -hf lukasstraub2/gpt2-aidungeon2-gguf:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf lukasstraub2/gpt2-aidungeon2-gguf:F16 # Run inference directly in the terminal: llama cli -hf lukasstraub2/gpt2-aidungeon2-gguf:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf lukasstraub2/gpt2-aidungeon2-gguf:F16 # Run inference directly in the terminal: ./llama-cli -hf lukasstraub2/gpt2-aidungeon2-gguf:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf lukasstraub2/gpt2-aidungeon2-gguf:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf lukasstraub2/gpt2-aidungeon2-gguf:F16
Use Docker
docker model run hf.co/lukasstraub2/gpt2-aidungeon2-gguf:F16
- LM Studio
- Jan
- Ollama
How to use lukasstraub2/gpt2-aidungeon2-gguf with Ollama:
ollama run hf.co/lukasstraub2/gpt2-aidungeon2-gguf:F16
- Unsloth Studio
How to use lukasstraub2/gpt2-aidungeon2-gguf with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for lukasstraub2/gpt2-aidungeon2-gguf to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for lukasstraub2/gpt2-aidungeon2-gguf to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for lukasstraub2/gpt2-aidungeon2-gguf to start chatting
- Docker Model Runner
How to use lukasstraub2/gpt2-aidungeon2-gguf with Docker Model Runner:
docker model run hf.co/lukasstraub2/gpt2-aidungeon2-gguf:F16
- Lemonade
How to use lukasstraub2/gpt2-aidungeon2-gguf with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull lukasstraub2/gpt2-aidungeon2-gguf:F16
Run and chat with the model
lemonade run user.gpt2-aidungeon2-gguf-F16
List all available models
lemonade list
- Atomic Chat
AI Dungeon 2 GGUF
GGUF version of the 2019 AI Dungeon 2 model by latitude.
Usage
Recommended sampler settings are temperature = 0.4, top_p = 0.9 and top_k = 40.
This is not a chat model, you enter your action with > You go north., > You say "hello", etc. and the model continues the story.
<scenario>
> You <action>.
<model completion>
It's recommended to limit completion length to 100 tokens and use > as a stop token in your chat interface. Also your chat interface must be able to edit previous messages to remove incomplete sentences and steer the story.
This GGUF works in both text completion and chat completion mode, the included chat template simply concatenates all messages.
Example
You are Enoch, a mutant trying to survive after the North-Korean bombed your country to the ground. You have snake like tongue and scales on your arms.
In the colony you were born in, your strange condition was considered a curse, and you have been banished since you were sixteen. After a long journey, you find a old camper. Surprisingly, you feel more at home in it than in your old home.
You decide to make your way to the nearest town, which is a few days walk away. You have no idea what to expect, but you are glad to see a few people outside.
> You say "Hello there"
You walk up to the people and introduce yourself."Hello, I'm Enoch, I'm a mutant, and I'm here to find a new home."
You are met with a lot of curiosity, but not a lot of hostility.
"So, you're a mutant? What's a mutant?"
> You show you snake tongue and scales.
You quickly show off your tongue and scales. The people are fascinated."Oh my, you're a mutant, you are! That's amazing! I've never seen anything like it!"
> You say "Thank you for your kind words can you give me a job?"
"Thank you, I really appreciate it, I can teach you a lot if you want."You say and give them your contact information.
"I can't wait to see you, I'm going to be in town for a few days, if you can help me, I'd be happy to see you."
> You go to the local pub.
You go to the local pub and ask the bartender for a job. The bartender tells you he has never seen anyone like you before."I'm a mutant, a mutant that was born with a snake tongue, scales and a strange mutation that makes me invisible to normal eyes."
> You order a beer.
You order a beer and sit down. The bartender looks at you and says,"I'm sorry, but I don't serve mutants."
Example scenarios
Generated using aidungeon. Use the scenario as the fist message and let the model complete it.
You are Gimello, a rogue from the province of Harnid. You have a dagger and a sickle.
This afternoon you decided that basic pickpocketing is not sufficient anymore. You long for a more ambitious goal: taking for yourself mythic scepter of Areriw.
You see
You are Jupiter, a mutant trying to survive after the Hell came to the Earth. You have a third arm and snake like tongue.
In the village you were born in, your strange condition was considered a crime, and you have been enslaved since you were thirteen. You don't get any food for your misbehaving today from your supervisor. You sense
You are Rothien, a wizard from the land of Gassan. You have a pet snake and a tome of divination.
You face an endless expanse as images of fishermans flit through your memory. What was that? Though old and magical, your memory extends only a few months back. Now you roam about, trying to recall what happened.
You remember
You are Thoijan, a knight from the province of Broethien. You have a squire named Deborah and a steel lance.
You are setting out on a crusade to recover the blessed helmet of Alaodan, which is rumored to have belonged to the dead king. You set out towards a misty cave that should take you there.
As you approach, you imagine
You are Unerrarith, a wizard from the duchy of Hatami. You have a book and a quill.
You are apprentice to the Isgrigg the Black. Before leaving on an errand, they ordered you to never enter their confidential chamber... but your curiosity has gotten the best of you.
As you approach the door, you imagine
You are Frireven, a peasant from the country of Zurito. You have a dirty rag and a plough.
You wake up at daybreak and get about tilling the fields. For a while, you have wanted to run away. You wonder
You are Raiden, a headhunter trying to survive after the Hell came to the Earth. You have a grenade and a gas mask.
You are driving your truck. You go past many forsaken bunkers. You arrive at a village and stop the engine. You are on a mission to kill a captain named Arcadia. Your target lives in a currently unknown location.
You sense
You are Celadon, a knight from the province of Gassan. You have a dusty lance and a worn helmet.
You are beginning an adventure to free the lady of Galardo from the cruel orc's grasp. You set out towards a dark expanse that could take you there.
As you approach, you see
You are Teasagh, a lonely scavenger trying to survive after the gods punished the humanity for its sins. You have a lockpick and a dirty backpack.
You spend a routine evening trying to get out as much as you can from a abandoned bunker. At the end you find a couple of pieces of silicium. You head toward the nearby metropolis. You notice
You are Severiveth, a rogue from the country of Amato. You have a mace and a cloak.
This evening you decided that general stealing is not sufficient anymore. You long for a more ambitious goal: taking for yourself lost stone of Frykoth.
You remember
You are Isett, a noble from the kingdom of Renfro. You have a pouch of silver and a narrow rapier.
Throughout the land it is the festival of the wolf. To celebrate, you are feasting in a keep. Serfs bustle back and forth.
As a dwarf loudly argues, you sense
You are Laiken, a mutant trying to survive after the Prophecy of the Apocalypse turned out to be true. You have scales on your back and scales on your whole body.
In the city you were born in, your strange condition was considered a sign of supremacy, and you get the best education possible. You go to science class today. Finally, you hear
- Downloads last month
- 183
8-bit
16-bit