semvec/pypi-packages huggingface dataset:
chat-template-detector 0.1.0
Detect chat template mismatches in LLM fine-tuning
License: MIT
Requires Python: >=3.8

# Chat Template Detector

Detect chat template mismatches between training and inference in LLM fine-tuning.

## The Problem

You fine-tune an LLM with one chat template format. You run inference with a different format. The model outputs garbage. No error message. Hours wasted debugging.

This tool catches template mismatches before they waste your time and GPU credits.

## Installation

```bash
pip install chat-template-detector
```

## Usage

```bash
# Validate training data against inference config
chat-template-detector validate \
  --training-file train.jsonl \
  --inference-config config.yaml

# Validate against a specific model
chat-template-detector validate \
  --training-file train.jsonl \
  --model meta-llama/Llama-2-7b-chat-hf

# Check a single formatted text file
chat-template-detector check samples/sample_chatml.txt
```

## Common Issues Detected

- ChatML vs Llama format mismatch
- Missing special tokens
- Incorrect token ordering
- BOS/EOS token mismatches
- Role name inconsistencies

## Examples

Training file uses ChatML:
```json
{"messages": [{"role": "user", "content": "Hello"}, {"role": "assistant", "content": "Hi"}]}
```

Inference expects Llama format:
```


 Hello 
 Hi

```

Detector catches this mismatch and shows exactly what's wrong.

## Contributing

See [CONTRIBUTING.md](CONTRIBUTING.md)

## License

MIT License - see [LICENSE](LICENSE) for details

## Author

Built by [ClarifyIntel](https://clarifyintel.com) - We clarify complex tech. Kubernetes, AI/ML, DevOps, Security — we write, we teach, we solve.
sixfinger 2.1.0
Ultra-fast AI platform: Cloud API + On-device language models
License: MIT
Requires Python: >=3.7
Keywords: ai, chatbot, api, llm, sixfinger, artificial-intelligence, transformers, on-device, cpu-optimized, mobile-ml

# 🚀 Sixfinger - Ultra-Fast AI API

[![PyPI](https://img.shields.io/pypi/v/sixfinger.svg)](https://pypi.org/project/sixfinger/)
[![Python](https://img.shields.io/pypi/pyversions/sixfinger.svg)](https://pypi.org/project/sixfinger/)
[![License](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)

**~1,100 chars/sec** - 10-20x faster than OpenAI/Claude!

## ⚡ Features

- 🚀 **Ultra-fast**: ~1,100 characters/second
- 🤖 **9 AI Models**: Llama 3.1/3.3, Qwen3, GPT-OSS, etc.
- 🇹🇷 **Turkish optimized**: Qwen3-32B
- 💬 **Conversation context**
- 📡 **Streaming support**
- 💰 **Free tier**: 200 requests/month

## 📦 Installation

```bash
pip install sixfinger
For async support:

Bash

pip install sixfinger[async]
🔑 Get API Key
Sign up
Verify email
Get key from Dashboard
🚀 Quick Start
Python

from sixfinger import API

client = API(api_key="sixfinger_xxx")
response = client.chat("Merhaba!")
print(response.content)
Conversation
Python

from sixfinger import API

client = API(api_key="sixfinger_xxx")
conv = client.conversation()

conv.send("Merhaba!")
conv.send("Python nedir?")
conv.send("Neden popüler?")  # Remembers context!
Streaming
Python

from sixfinger import API

client = API(api_key="sixfinger_xxx")

for chunk in client.chat("Tell me a story", stream=True):
    print(chunk, end='', flush=True)
Async
Python

import asyncio
from sixfinger import AsyncAPI

async def main():
    async with AsyncAPI(api_key="sixfinger_xxx") as client:
        response = await client.chat("Merhaba!")
        print(response.content)

asyncio.run(main())
Model Selection
Python

# Auto model (recommended)
response = client.chat("Merhaba!")

# Turkish
response = client.chat("Osmanlı tarihi", model="qwen3-32b")

# Complex tasks
response = client.chat("Explain quantum physics", model="llama-70b")

# Fast
response = client.chat("Quick answer", model="llama-8b-instant")
🤖 Available Models
Model	Key	Size	Language	Plan
Llama 3.1 8B Instant	llama-8b-instant	8B	Multilingual	FREE+
Allam 2 7B	allam-2-7b	7B	Turkish/Arabic	FREE+
Qwen3 32B ⭐	qwen3-32b	32B	Turkish	STARTER+
Llama 3.3 70B	llama-70b	70B	Multilingual	STARTER+
GPT-OSS 120B	gpt-oss-120b	120B	Multilingual	PRO+
📊 Rate Limits
Plan	Price	Requests/Month	Tokens/Month
FREE	$0	200	20K
STARTER	$79	3K	300K
PRO	$199	75K	7.5M
PLUS	$499	500K	50M
📚 Documentation
Full docs: https://sfapi.pythonanywhere.com

🤝 Support
Email: sixfingerdev@gmail.com

📄 License
MIT License