README.md

---
library_name: transformers
tags:
- unsloth
- trl
- sft
---

\***NOTE**: I have discovered since releasing this model that the dataset was contaminated with some improperly escaped characters. It still performs rather well, but will have to get a new run here soon.

# Model Card for Hermes 2 Pro Mistral 7b Bulleted Notees

This is a fine-tune of [Hermes-2-Pro-Mistral-7B](https://huggingface.co/NousResearch/Hermes-2-Pro-Mistral-7B).

I created a dataset of "comprehensive bulleted notes with headings and terms in bold" from 25 psychology texts, using Mistral-7B-Instruct-v0.2, and one other. I cleaned up that set to be perfect, and trained with Hermes 2 Pro Mistral 7b.

## Model Details

```
```{document}```
Write comprehensive bulleted notes on the provided text.
```

## Uses

Ideally the output looks something like this:

```markdown
**Winnie's Grief Reaction**

**Therapist's Recommendations**:
- Advised grandmother and maid to:
  - **Hold Winnie** and talk to her as her mother had done
  - **Follow the mother's routines** as much as possible
  - Make **appropriate references to the mother**
- Suggested father talk to Winnie about:
  - Children thinking mothers get sick or die if they are naughty
  - This is not really the case

**Winnie's Behavior**:
- Became her usual self again, and symptoms disappeared
- **Sought out mother-substitutes**: grandmother, maid, father, sister Wendy
- **Happy and contented** as long as she was taken care of and loved

**Expressing Grief**:
- **Seven months after mother's death**, Winnie began talking about her absent mother
- Expressed **sadness, missing her mother**, asked questions about death
- **Explained by therapist**: Winnie could express grief after grandmother had expressed grief over losing her daughter

**Winnie's Remarks at Nursery School**:
- Emphasized that her **mother was dead**
- Expressed **yearning for her mother's return**
- **Sensitive to separations**, looked to sister Wendy for security
- **Apprehensive about losing other caregivers**
- **Resorted to somatic symptoms** when grandmother was away

**Therapist's Concern**:
- Winnie's **capacity to respond to stressful situations**, especially long separations
- Her **ready resort to somatic symptoms**
```


### Training Procedure

<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->

#### Preprocessing [optional]

[More Information Needed]


#### Training Hyperparameters

- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->

#### Speeds, Sizes, Times [optional]

<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->

[More Information Needed]

## Evaluation

<!-- This section describes the evaluation protocols and provides the results. -->

### Testing Data, Factors & Metrics

#### Testing Data

<!-- This should link to a Dataset Card if possible. -->

[More Information Needed]

#### Factors

<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->

[More Information Needed]

#### Metrics

<!-- These are the evaluation metrics being used, ideally with a description of why. -->

[More Information Needed]

### Results

[More Information Needed]

#### Summary