Instructions to use SulphurAI/Sulphur-2-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SulphurAI/Sulphur-2-base with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SulphurAI/Sulphur-2-base", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - llama-cpp-python
How to use SulphurAI/Sulphur-2-base with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="SulphurAI/Sulphur-2-base", filename="prompt_enhancer/mmproj-BF16.gguf", )
llm.create_chat_completion( messages = "\"A young man walking on the street\"" )
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SulphurAI/Sulphur-2-base with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: ./llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Use Docker
docker model run hf.co/SulphurAI/Sulphur-2-base:BF16
- LM Studio
- Jan
- Ollama
How to use SulphurAI/Sulphur-2-base with Ollama:
ollama run hf.co/SulphurAI/Sulphur-2-base:BF16
- Unsloth Studio
How to use SulphurAI/Sulphur-2-base with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
- Pi
How to use SulphurAI/Sulphur-2-base with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf SulphurAI/Sulphur-2-base:BF16
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SulphurAI/Sulphur-2-base:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use SulphurAI/Sulphur-2-base with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf SulphurAI/Sulphur-2-base:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default SulphurAI/Sulphur-2-base:BF16
Run Hermes
hermes
- Atomic Chat new
- Docker Model Runner
How to use SulphurAI/Sulphur-2-base with Docker Model Runner:
docker model run hf.co/SulphurAI/Sulphur-2-base:BF16
- Lemonade
How to use SulphurAI/Sulphur-2-base with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SulphurAI/Sulphur-2-base:BF16
Run and chat with the model
lemonade run user.Sulphur-2-base-BF16
List all available models
lemonade list
short movie script
Short Movie Script: “Fragments of Her”
Characters
- Mrs. Salma Hassan (63 years old) – Patient
- Mona – Daughter
- Dr. Kareem – Neurologist
- Pharmacist – Community pharmacist
Scene 1: Opening (Home – Morning)
(Mrs. Salma is in the kitchen, confused, holding a kettle.)
Mona:
Mom… you already made tea.
Mrs. Salma (confused):
Did I? I don’t remember…
Narrator:
Alzheimer’s disease is the most common cause of dementia, affecting millions worldwide. Age above 65 is the strongest risk factor. Other risks include female gender, family history, hypertension, and diabetes.
Scene 2: Hospital Admission
(Mrs. Salma is brought to the clinic)
Mona:
Doctor, she’s been forgetting everything… even my name sometimes. She gets lost and repeats questions.
Dr.Kareem: Can you remember when her memory problems began
Mona: About 2 years ago
Dr. Kareem:
These symptoms suggest cognitive decline. Let’s assess her.
Scene 3: Clinical Manifestations
Dr. Kareem (examining):
- Memory loss (recent events)
- Disorientation to time and place
- Difficulty finding words
- Behavioral changes (irritability)
Mrs. Salma:
Where am I…?
Scene 4: Diagnosis & Examination
Dr. Kareem:
We’ll perform the Mini-Mental State Examination (MMSE).
(He asks questions)
Dr. Kareem (to Mona):
Her MMSE score is 18/30, indicating moderate Alzheimer’s disease.
Narrator:
Diagnosis is clinical, supported by cognitive scales like MMSE, and imaging to exclude other causes.
Lab tests:
Normal kidney and liver functions
Normal thyroid function and CBC
Neuropsychological testing: Normal MRI
Past medical history: DM and HTN
Scene 5: Treatment Plan
Dr. Kareem:
We’ll start treatment:
- Rivastigmine capsule 1.5 mg twice daily and it may increase to 3-6 mg twice daily after 2 weeks
Mona:
Are there any side effects?
Dr. Kareem:
Yes, she may suffer from some nausea and vomitting
Scene 6: Pharmacy Scene
(At pharmacy)
Pharmacist to Mona
Here is Rivastigmine. Let me explain:
Counseling Points:
- She should take the capsule twice daily
- she may suffer from some nausea and vomiting
It is better to be taken with food - Do not stop suddenly
Mona:
Okay, thank you.
Scene 7: Adverse Effect Appears
(At home – Mrs. Salma feels dizzy and nearly faints and she is suffering from severe N&V)
Mona:
Mom! You look pale!
Scene 8: Referral Back to Physician after 1 week
(Back to doctor)
Dr. Kareem:
Your mom can not tolerate the side effects of the medication
Solution:
- Switch to donepezil patch 4.6 mg every 24 hours
Apply the patch the day following the last oral dose
Scene 10: Monitoring Plan
Dr. Kareem:
We will monitor:
Efficacy:
- If no improvement , increase the dose of the patch to 9.5 mg every 24 hours
MMSE score for 3-6 months - Daily functioning
Safety:
Monitor cholinergic side effects
Final Scene: Emotional Close
(Mona helping her mother look at old photos)
Mrs. Salma (smiling faintly):
You look familiar…
Mona (holding tears):
I’m your daughter, mom.
Narrator:
Alzheimer’s disease slowly steals memories—but early diagnosis, proper treatment, and compassionate care can preserve dignity and quality of life.
Have you generated this if yes let me give some clips for same I would like to see the model at work