|
--- |
|
license: llama3.1 |
|
datasets: |
|
- CalebE/new_mental_health_conversations_all1 |
|
- Amod/mental_health_counseling_conversations |
|
base_model: |
|
- unsloth/Meta-Llama-3.1-8B-Instruct |
|
--- |
|
# CounselorChat (C2) — A Mental Health Conversational Assistant |
|
|
|
## Overview |
|
|
|
**CounselorChat (C2)** is a fine-tuned version of the [Llama 3.1 8B](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct) model, designed as an experimental chatbot to offer quick mental health tips and support. This model is **not a substitute for professional mental health care** and should not replace consultation with a licensed specialist. |
|
|
|
The name *CounselorChat* is not the best but it was suggested by the model itself during testing so... you know... |
|
|
|
--- |
|
|
|
## Features |
|
|
|
- **Base Model**: [Llama 3.1 8B](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct). |
|
- **Training Process**: |
|
- **Datasets**: Fine-tuned on a combination of: |
|
- [CalebE/new_mental_health_conversations_all1](https://huggingface.co/datasets/CalebE/new_mental_health_conversations_all1) |
|
- [Amod/mental_health_counseling_conversations](https://huggingface.co/datasets/Amod/mental_health_counseling_conversations) |
|
- **Method**: One epoch of training using **Unsloth** at 16-bit precision. |
|
- **Data Cleanup**: Deduplication and cleaning were performed to enhance the quality of training data. |
|
|
|
--- |
|
|
|
## Deployment Options |
|
|
|
1. **GGUF Quantized Model**: Published as an **8-bit GGUF quantized model**. Other quantization levels are available upon request. |
|
2. **Modelfile for Ollama**: A **pre-configured Modelfile** for deployment on Ollama is also included, with a default context length of **8192 tokens**. |
|
- To deploy, update the **`PATH_TO_MODEL`** at the beginning of the Modelfile to point to the GGUF file location. |
|
- Then, run the following CLI command from the same directory as the Modelfile: |
|
```bash |
|
ollama create C2_llama3.1_8B_q8x8K --file OllamaModelfile_C2_llama31_8B_Q8x8K |
|
``` |
|
3. **Other Deployment Options**: For alternative deployment setups or platforms, it is recommended to set the **SYSTEM prompt** to: |
|
> *You are an AI counselor designed to provide compassionate, evidence-based mental health support. Offer helpful, non-judgmental guidance focusing on validated techniques. Avoid diagnosing conditions, or speculative or unsafe advice.* |
|
--- |
|
|
|
## Intended Use |
|
|
|
CounselorChat is designed to provide **quick, supportive mental health tips**. It can be used for: |
|
|
|
- Offering general advice for stress management, mindfulness, and coping strategies. |
|
- Engaging in non-clinical conversations. |
|
|
|
**Disclaimer**: This model is an **experimental tool**. It is not licensed or intended to provide clinical counseling or medical advice. For serious mental health concerns, please seek the assistance of a trained mental health professional. |
|
|
|
--- |
|
|
|
## Limitations |
|
|
|
- The model is not equipped to handle emergencies or complex mental health cases. |
|
- Responses are generated based on the training data and may lack the nuance of human judgment. |
|
- While efforts have been made to clean and deduplicate the datasets, unintended biases or inaccuracies may persist. |
|
|
|
--- |
|
|