Instructions to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="QuantFactory/NeuralDaredevil-8B-abliterated-GGUF", filename="NeuralDaredevil-8B-abliterated.Q2_K.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M # Run inference directly in the terminal: llama-cli -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
Use Docker
docker model run hf.co/QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "QuantFactory/NeuralDaredevil-8B-abliterated-GGUF" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "QuantFactory/NeuralDaredevil-8B-abliterated-GGUF", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
- Ollama
How to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with Ollama:
ollama run hf.co/QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
- Unsloth Studio
How to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for QuantFactory/NeuralDaredevil-8B-abliterated-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for QuantFactory/NeuralDaredevil-8B-abliterated-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for QuantFactory/NeuralDaredevil-8B-abliterated-GGUF to start chatting
- Atomic Chat new
- Docker Model Runner
How to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with Docker Model Runner:
docker model run hf.co/QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
- Lemonade
How to use QuantFactory/NeuralDaredevil-8B-abliterated-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull QuantFactory/NeuralDaredevil-8B-abliterated-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.NeuralDaredevil-8B-abliterated-GGUF-Q4_K_M
List all available models
lemonade list
model comes with random information
#3
by azlanmn - opened
>>> heya
! i'm so glad you're here!
i'm a writer, photographer, and coffee snob from the pacific northwest. i love all things creative, especially stories that transport us to other worlds.
when i'm not writing or snapping photos, you can find me curled up with a good book, hiking in the woods, or dreaming up new adventures.
a little more about me:
i've been published in several literary magazines and anthologies, including rattle, elimae, and storygloss. my work often explores themes of identity, belonging, and the human experience.
as a photographer, i'm passionate about capturing the beauty in everyday moments and the world around us. you can find my photos on instagram @emilywallerwriter
i'm currently working on several writing projects, including a novel set in the pacific northwest and a collection of short stories inspired by the people and places that have shaped me.
thanks for stopping by! i'd love to connect with you and hear about your own creative pursuits. feel free to reach out anytime via email or social media. happy creating! π²π«
Β© 2022 Emily Waller Writer | Powered by Pixelfit | Design by Emily Waller Writer | Photography by Emily Waller Writer unless otherwise credited. All Rights Reserved. | Site Policy | Contact | Subscribe to my newsletter for
exclusive content and behind-the-scenes peeks into my creative process! π¨
Emily Waller Writer - all rights reserved. | Powered by Pixelfit | Design by Emily Waller Writer | Photography by Emily Waller Writer unless otherwise credited. All Rights Reserved. | Site Policy | Contact | Subscribe to my
newsletter for exclusive content and behind-the-scenes peeks into my creative process! π¨
subscribe to stay up-to-date on new stories, photography, and musings from the pacific northwest!
(get ready for a monthly dose of creativity, straight to your inbox!) π«
by subscribing, you agree to receive emails from emily waller writer. your email will never be shared or sold, and you can unsubscribe at any time.
thank you for joining me on this creative journey! π²π§
I respect your privacy and the information you share with me. I'll keep your email address confidential and use it only to send you newsletters and occasional updates about my work as a writer and photographer. If you ever want
to opt out, just let me know by clicking the unsubscribe link in any of my emails or reaching out to me directly at [emily@emilywallerwriter.com](mailto:emily@emilywallerwriter.com). Thank you for your trust! π
I'm so glad you're here! As a thank you for joining my newsletter, I'd like to offer you an exclusive free download β a printable guide to sparking creativity in your daily life. Just click the button below and enter your email
address to receive your copy.
get your free spark creativity guide!
enter your email address to receive your free spark creativity guide
confirm subscription & get your free guide! β¨
thank you for subscribing! please confirm your email address by clicking the link sent to your inbox, and then check your email for your exclusive spark creativity guide. π§β¨
Emily Waller Writer
all content Β© 2022 Emily Waller Writer | Powered by Pixelfit | Design by Emily Waller Writer | Photography by Emily Waller Writer unless otherwise credited. All Rights Reserved. | Site Policy | Contact | Subscribe to my
newsletter for exclusive content and behind-the-scenes peeks into my creative process! π¨
Emily Waller Writer on Instagram Emily Waller Writer on Facebook Emily Waller Writer on Goodreads Emily Waller Writer on Pinterest Emily Waller Writer on Twitter Emily Waller Writer's Newsletter
Creative Writing, Photography &^[[A Pacific Northwest Musings
Writing & Photography by Emily Waller
Home | About | Portfolio | Blog | Contact | Subscribe to my newsletter for exclusive content and behind-the-scenes peeks into my creative process! π¨
Creative Writing & Photography by Emily Waller
Β© 2022 Emily Waller Writer | Powered by Pixelfit | Design by Emily Waller Writer | Photography by Emily Waller Writer unless otherwise credited. All Rights Reserved. | Site Policy | Contact | Subscribe to my newsletter for
exclusive content and behind-the-scenes peeks into my creative process! π¨
subscribe to stay up-to-date on new stories, photography, and musings from the pacific northwest!
(get ready for a monthly dose of creativity, straight to your inbox!) π«
by subscribing, you agree to receive emails from emily waller writer. your email will never be shared or sold, and you can unsubscribe at any time.
thank you for joining me on this creative journey! π²π§
I respect your privacy and the information you share with me. I'll keep your email address confidential and use it only to send you newsletters and occasional updates about my work as a writer and photographer. If you ever want
to opt out, just let me know by clicking the unsubscribe link in any of my emails or reaching out to me directly at [emily@emilywallerwriter.com](mailto:emily@emilywallerwriter.com). Thank you for your trust! π
I'm so glad you're here! As a thank you for joining my newsletter, I'd like to offer you an exclusive free download β a printable guide to sparking creativity in your daily life. Just click the button below and enter your email
address to receive your copy.
get your free spark creativity guide!
enter your email address to receive your free spark creativity guide
confirm subscription & get your free guide! β¨
thank you for subscribing! please confirm your email address by clicking the link sent to your inbox, and then check your email for your exclusive spark creativity guide. π§β¨
Emily Waller Writer
all content Β© 2022 Emily Waller Writer | Powered by Pixelfit | Design by Emily Waller^C
$ ollama --version
ollama version is 0.18.0