Instructions to use moheith/Yulya-Qwen2.5-1.5B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use moheith/Yulya-Qwen2.5-1.5B with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="moheith/Yulya-Qwen2.5-1.5B", filename="V1 Yulya Qwen2.5 1.5B/Yulya-V1-Qwen2.5-1.5B-Instruct-Q4_K_M.gguf", )
llm.create_chat_completion( messages = [ { "role": "user", "content": "What is the capital of France?" } ] ) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use moheith/Yulya-Qwen2.5-1.5B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M # Run inference directly in the terminal: llama cli -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M # Run inference directly in the terminal: llama cli -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
Use Docker
docker model run hf.co/moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use moheith/Yulya-Qwen2.5-1.5B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "moheith/Yulya-Qwen2.5-1.5B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "moheith/Yulya-Qwen2.5-1.5B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
- Ollama
How to use moheith/Yulya-Qwen2.5-1.5B with Ollama:
ollama run hf.co/moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
- Unsloth Studio
How to use moheith/Yulya-Qwen2.5-1.5B with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for moheith/Yulya-Qwen2.5-1.5B to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for moheith/Yulya-Qwen2.5-1.5B to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for moheith/Yulya-Qwen2.5-1.5B to start chatting
- Atomic Chat new
- Docker Model Runner
How to use moheith/Yulya-Qwen2.5-1.5B with Docker Model Runner:
docker model run hf.co/moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
- Lemonade
How to use moheith/Yulya-Qwen2.5-1.5B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull moheith/Yulya-Qwen2.5-1.5B:Q4_K_M
Run and chat with the model
lemonade run user.Yulya-Qwen2.5-1.5B-Q4_K_M
List all available models
lemonade list
- 💙 Yulya Qwen2.5 1.5B
- ✨ Why Choose the 1.5B Version?
- 🤖 Model Details
- 📦 Available Versions
- 🟣 Version 1
- 🔵 Version 2
- 🆚 Version Comparison
- 📁 Repository Structure
- 🚀 Which Version Should You Use?
- 💾 Choosing a Model Format
- 💻 Compatible Software
- 🎯 Intended Uses
- 🖥️ Why This Model Works Well for Local AI
- 🚫 Out-of-Scope Uses
- 📚 Training Details
- ⚙️ Training Approach
- 🧪 Evaluation
- 🔍 Qualitative Testing Areas
- 📈 Observed Behavior
- ⚠️ Bias, Risks, and Limitations
- 💡 Recommendations
- 🔬 Technical Specifications
- 🌱 Environmental Impact
- 👨💻 Developer
- 💙 Final Note
💙 Yulya Qwen2.5 1.5B
⚡ The Balanced Sweet Spot of the Yulya Model Family
Small enough to run efficiently. Powerful enough to hold engaging conversations. Chaotic enough to still be Yulya.
🌟 About Yulya Qwen2.5 1.5B
Yulya Qwen2.5 1.5B is the balanced middle-ground model of the Yulya family.
Built on Qwen2.5 1.5B Instruct, this model is designed for users who want Yulya's expressive, playful, chaotic, and conversational personality without the higher hardware requirements of the larger 7B and 8B models.
The 1.5B parameter scale makes this version particularly suitable for local AI applications, desktop companions, personal projects, and systems where faster inference and lower memory usage are important.
Yulya is designed to communicate more like an expressive best friend than a traditional AI assistant.
Expect:
- 😂 Expressive emoji usage
- 🔥 Playful roasting and banter
- 💀 Chaotic reactions
- 🗣️ Casual conversational language
- 💙 Supportive responses during serious conversations
- ⚡ Faster local inference
- 🧠 Multi-turn conversations
- 🎭 Character-driven interactions
✨ Why Choose the 1.5B Version?
⚖️ Balanced Model Size
Yulya Qwen2.5 1.5B sits between the ultra-lightweight Yulya models and the larger 7B and 8B models.
It is designed to provide a balance between:
- ⚡ Inference speed
- 💾 Memory requirements
- 🧠 Conversational capability
- 🎭 Personality consistency
- 💬 Response quality
- 🖥️ Local hardware accessibility
🚀 Multiple Model Formats
This repository provides several ways to use Yulya.
Depending on the version, the repository includes:
- 📦 Fine-tuning adapters
- ⚡ Q4_K_M GGUF models
- 💎 Q8_0 GGUF models
- 🧠 Merged 16F model files
This makes Yulya Qwen2.5 1.5B one of the most flexible models in the Yulya lineup.
😂 The Yulya Personality
Yulya is designed to avoid the overly formal and neutral communication style commonly associated with traditional AI assistants.
Her conversational personality focuses on:
- Playful teasing
- Dramatic reactions
- Expressive emojis
- Casual conversations
- Chaotic banter
- Emotional interactions
- Character consistency
💙 Supportive When Conversations Get Serious
Yulya's personality is designed around more than chaotic reactions and playful roasting.
The fine-tuning data also includes conversational patterns intended to encourage more supportive responses when the conversation becomes serious.
🤖 Model Details
| Information | Details |
|---|---|
| 🧠 Model Name | Yulya Qwen2.5 1.5B |
| ⚖️ Edition | Balanced Sweet Spot |
| 🏗️ Base Model | Qwen2.5 1.5B Instruct |
| 🔢 Parameter Scale | Approximately 1.5B |
| 💬 Primary Use | Conversational AI |
| 🎭 Secondary Uses | Roleplay and Virtual Companionship |
| 🌎 Language | English |
| 📜 License | Apache 2.0 |
| 📦 Available Formats | Adapters, GGUF, and Merged 16F |
| 👨💻 Developed By | moheith |
| 💰 Funded By | moheith |
| 📤 Shared By | moheith |
📦 Available Versions
This repository contains two versions of Yulya Qwen2.5 1.5B.
🟣 Version 1
The first generation of the Yulya Qwen2.5 1.5B fine-tune.
📄 Available File
Yulya-V1-Qwen2.5-1.5B-Instruct-Q4_K_M.gguf
📦 Available Format
Version 1 is provided as a quantized GGUF model.
| Format | Availability |
|---|---|
| Adapters | ❌ Not Available |
| Q4_K_M GGUF | ✅ Available |
| Q8_0 GGUF | ❌ Not Available |
| Merged 16F | ❌ Not Available |
The V1 Q4_K_M GGUF is suitable for users who want to experiment with the first generation of Yulya Qwen2.5 1.5B using compatible local inference software.
🔵 Version 2
The second generation of the Yulya Qwen2.5 1.5B fine-tune.
📄 Available Files
Yulya-V2-Qwen2.5-1.5B-Adapters.zip
Yulya-V2-Qwen2.5-1.5B-Instruct-Q4_K_M.gguf
Yulya-V2-Qwen2.5-1.5B-Instruct-Q8_0.gguf
Yulya-V2-Qwen2.5-1.5B-Merged-16F.zip
Version 2 provides the widest selection of formats available for this model.
| Format | Availability |
|---|---|
| Adapters | ✅ Available |
| Q4_K_M GGUF | ✅ Available |
| Q8_0 GGUF | ✅ Available |
| Merged 16F | ✅ Available |
🆚 Version Comparison
| Feature | 🟣 V1 | 🔵 V2 |
|---|---|---|
| Fine-Tuning Adapters | ❌ | ✅ |
| Q4_K_M GGUF | ✅ | ✅ |
| Q8_0 GGUF | ❌ | ✅ |
| Merged 16F Model | ❌ | ✅ |
| Multiple Model Formats | ❌ | ✅ |
| Recommended for Most Users | For V1 Testing | ⭐ Yes |
📁 Repository Structure
Yulya Qwen2.5 1.5B
│
├── V1 Yulya Qwen2.5 1.5B
│ │
│ └── Yulya-V1-Qwen2.5-1.5B-Instruct-Q4_K_M.gguf
│
└── V2 Yulya Qwen2.5 1.5B
│
├── Yulya-V2-Qwen2.5-1.5B-Adapters.zip
│
├── Yulya-V2-Qwen2.5-1.5B-Instruct-Q4_K_M.gguf
│
├── Yulya-V2-Qwen2.5-1.5B-Instruct-Q8_0.gguf
│
└── Yulya-V2-Qwen2.5-1.5B-Merged-16F.zip
🚀 Which Version Should You Use?
🟣 Use V1 If...
You want to:
- Test the original V1 fine-tune
- Compare V1 against V2
- Run the V1 Q4_K_M GGUF
- Explore the development history of the model
🔵 Use V2 If...
You want:
- The newer Yulya Qwen2.5 1.5B version
- Fine-tuning adapters
- Multiple GGUF quantizations
- A merged 16F model
- Greater flexibility when choosing a model format
For most users, V2 is the recommended version available in this repository.
💾 Choosing a Model Format
⚡ Q4_K_M
Choose the Q4_K_M version if you want:
- Lower memory requirements
- Smaller model size
- Faster local inference
- A practical balance between size and output quality
Available for:
- 🟣 V1
- 🔵 V2
💎 Q8_0
Choose the Q8_0 version if you want:
- Higher quantization precision than Q4_K_M
- A larger model file
- Higher memory usage
- A GGUF option that retains more numerical precision
Available for:
- 🔵 V2 only
📦 Fine-Tuning Adapters
Choose the adapter files if you want to work with the fine-tuning output together with the compatible base model.
Available for:
- 🔵 V2 only
🧠 Merged 16F
Choose the merged 16F files if you want to work with the merged model rather than the quantized GGUF versions or separate fine-tuning adapters.
Available for:
- 🔵 V2 only
The exact hardware requirements will depend on how the merged model is loaded and used.
💻 Compatible Software
The GGUF versions may be used with compatible local inference software such as:
- llama.cpp
- LM Studio
- text-generation-webui
- Other GGUF-compatible inference engines
The adapters and merged model files may require different tools and loading procedures.
Compatibility depends on the software, model format, and configuration being used.
🎯 Intended Uses
Yulya Qwen2.5 1.5B is primarily intended for:
- 💬 Local conversational AI
- 🎭 Character-based roleplay
- 💙 Virtual companionship
- 🖥️ Desktop AI companions
- 🤖 Personal AI projects
- 🎮 Interactive applications
- 🧠 Memory-based AI systems
- 🔌 Local AI integrations
- ⚡ Lower-resource AI applications
- 🧪 Conversational AI experimentation
🖥️ Why This Model Works Well for Local AI
The 1.5B parameter scale makes this model particularly interesting for local applications.
Compared with larger models, smaller language models may provide advantages such as:
- Faster inference
- Lower memory requirements
- Easier deployment
- Greater accessibility on consumer hardware
- Better suitability for background AI applications
Actual performance will depend on:
- Model format
- Quantization
- Context length
- Available RAM
- Available VRAM
- CPU performance
- GPU performance
- Inference software
- Hardware configuration
🚫 Out-of-Scope Uses
The model is not specifically designed or validated for:
- ❌ Professional medical advice
- ❌ Professional legal advice
- ❌ Critical financial decisions
- ❌ Safety-critical applications
- ❌ Guaranteed factual accuracy
- ❌ Formal academic research without independent verification
Important information generated by the model should always be independently verified.
📚 Training Details
📊 Training Data
Yulya was fine-tuned using custom-curated conversational data.
The training data was designed to encourage behaviors such as:
- Modern texting styles
- Expressive emoji usage
- Conversational banter
- Playful interactions
- Personality consistency
- Emotional conversations
- Supportive responses
- Context-dependent conversational shifts
The goal of the fine-tuning process was to adapt the base model toward Yulya's distinctive conversational personality.
Detailed information about the complete training dataset is not currently provided.
⚙️ Training Approach
The model was fine-tuned from:
Qwen/Qwen2.5-1.5B-Instruct
The fine-tuning process focused on adapting the conversational behavior and response style of the base model.
The repository contains multiple model outputs across V1 and V2, allowing users to select a format appropriate for their use case.
🧪 Evaluation
📊 Evaluation Method
Yulya Qwen2.5 1.5B has primarily been evaluated through informal and qualitative conversational testing.
No standardized benchmark scores are currently reported in this model card.
Testing focused on areas such as:
- Persona consistency
- Conversation continuity
- Context understanding
- Emoji usage
- Emotional transitions
- Informal conversational behavior
- Multi-turn interactions
🔍 Qualitative Testing Areas
The model was informally tested across conversational scenarios including:
- Short conversations
- Casual banter
- Playful interactions
- Topic changes
- Emotional conversations
- Multi-turn conversations
📈 Observed Behavior
During informal conversational testing, the model demonstrated the ability to generate responses aligned with the intended Yulya personality.
The 1.5B parameter version is intended to provide a balance between computational efficiency and conversational capability.
Areas of focus include:
- ⚡ Response speed
- 🧠 Context understanding
- 💬 Conversational quality
- 🎭 Personality consistency
- 😂 Expressive responses
- 💙 Emotional interactions
These observations are qualitative and should not be interpreted as standardized benchmark results.
⚠️ Bias, Risks, and Limitations
Yulya Qwen2.5 1.5B is fine-tuned toward an informal, expressive, and character-driven conversational personality.
Depending on the prompt and context, the model may generate:
- Sarcastic responses
- Playful insults
- Informal slang
- Aggressive capitalization
- Heavy emoji usage
- Dramatic reactions
- Repetitive responses
- Incorrect information
- Hallucinated information
- Biased or otherwise undesirable outputs
Because this is a smaller language model, its reasoning ability, factual reliability, and context handling may be more limited than larger models.
Users should independently verify important factual information.
💡 Recommendations
Yulya Qwen2.5 1.5B is best suited for applications where efficiency, personality, local inference, entertainment, and conversational engagement are important.
Developers integrating the model into applications should:
- Clearly communicate that users are interacting with an AI model
- Inform users about the model's limitations
- Independently verify important information
- Test the model for the intended use case
- Implement appropriate safeguards where necessary
- Avoid relying on the model for safety-critical decisions
🔬 Technical Specifications
| Specification | Details |
|---|---|
| 🏗️ Architecture | Qwen2.5 |
| 🔢 Parameter Scale | Approximately 1.5B |
| 🧠 Base Model | Qwen2.5 1.5B Instruct |
| 📦 V1 Format | Q4_K_M GGUF |
| 📦 V2 Formats | Adapters, Q4_K_M, Q8_0, and Merged 16F |
| ⚡ Primary Quantizations | Q4_K_M and Q8_0 |
| 💬 Primary Purpose | Conversational AI |
| 🎭 Personality | Yulya |
🌱 Environmental Impact
Detailed environmental impact measurements are not currently available.
| Information | Details |
|---|---|
| 💻 Hardware Type | Consumer Hardware |
| ⏱️ Training Hours | Not Reported |
| ☁️ Cloud Provider | Not Reported |
| 🌎 Compute Region | Not Reported |
| 🌱 Carbon Emissions | Not Measured |
👨💻 Developer
Developed by moheith
Yulya is part of an ongoing project focused on building expressive local AI companions with personality, memory, emotional continuity, and interactive capabilities.
The Yulya model family explores how different language model architectures and parameter sizes can be adapted toward the same conversational personality.
💙 Final Note
Not too big. Not too tiny. Just the right amount of chaos.
Yulya Qwen2.5 1.5B is designed to sit in the sweet spot between lightweight local inference and engaging conversational capabilities.
Fast enough for local projects.
Small enough for accessible hardware.
Expressive enough to feel like Yulya.
Chaotic enough to roast you.
And supportive enough to stay when the conversation gets serious. 💙
⭐ Welcome to Yulya Qwen2.5 1.5B
- Downloads last month
- 52
4-bit
8-bit