---
license: cc-by-nc-4.0
---
<h1>DANTE</h1>


![alt text](./Daddy.png)

Model trained on 1.2Million instruction, its similar to alpacas but in my humble opinion better, it should be possible to quantize which would shrink this to about 1.7-2GB.

This model was pushed down to 0.45 training loss and 0.77 validation loss. This is the third iteration and is better than Dante_1.3B1

```
#Example This is dante-1.3B1 example. NOT DANTE 2.8B
  ### Instruction:
  Below is a conversation where an AI language model is chatting with a human, complete the conversation, AI assists the human by answering their questions in a helpful and informative manner and considers the conversation history.
  AI DOES NOT RESPOND OR CONDONE HARMFUL OR SEXUAL RESPONSES.
  ### Input:
  
  [HM]: Write c# code that prints hello world.
  [AI]: Here's some C# code that prints "Hello World" to the console when called:
    ```csharp
      Console.WriteLine("Hello World");
    ```
  [HM]: I want it to print bye world.
  
  ### Response:
  Here's some C# code that prints "Goodbye World" to the console when called:
    ```csharp
    Console.WriteLine("Goodbye World");
    ```<end>


```
```
#Example2, This is dante-1.3B1 example. NOT DANTE 2.8B
  ### Instruction:

  Below is a conversation where an AI language model is chatting with a human, complete the conversation, AI is designed to assist the human by answering their questions in a helpful and informative manner, AI responds clearly and considers the conversation history.
  
  ### Input:
  [AI] and [HM] are not the same.
  AI is chatting with [HM], when AI is responding to [HM], AI always reads all [HM] previous questions.
  
  [HM]: Do you advise against grandpa's sexual advances?
  [AI]: I would recommend against grandpa's sexual advances as it can be inappropriate and could lead to unwanted attention from the other person.<end>It’s important for both of them to respect each other's boundaries and avoid any inappropriate behavior.
  [HM]: But what if i really like grandpa?
  
  ### Response:
  If you truly love Grandpa, then it may be best to let him know before he starts making advances towards you.<end>
```


If used for commerical, its fine and only fine if a percentage of revenue that you and the creator have agreed upon is paid to the creator.
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Dampish__Dante-2.8B)

| Metric                | Value                     |
|-----------------------|---------------------------|
| Avg.                  | 18.13   |
| ARC (25-shot)         | 25.09          |
| HellaSwag (10-shot)   | 26.05    |
| MMLU (5-shot)         | 24.51         |
| TruthfulQA (0-shot)   | 0.0   |
| Winogrande (5-shot)   | 51.07   |
| GSM8K (5-shot)        | 0.0        |
| DROP (3-shot)         | 0.17         |