Update README.md

README.md

@@ -21,7 +21,7 @@ Falcon-40B-Chat-v0.1 is a chatbot model for dialogue generation. It was built by
 
 ## Model Summary
 
-- **Model Type:** Decoder-only
+- **Model Type:** Causal language model (clm)
 - **Language(s):** English
 - **Base Model:** [Falcon-40B](https://huggingface.co/tiiuae/falcon-40b) (License: [Apache 2.0](https://huggingface.co/tiiuae/falcon-40b#license))
 - **Dataset:** [OpenAssistant/oasst1](https://huggingface.co/datasets/OpenAssistant/oasst1) (License: [Apache 2.0](https://huggingface.co/datasets/OpenAssistant/oasst1/blob/main/LICENSE))
@@ -29,10 +29,24 @@ Falcon-40B-Chat-v0.1 is a chatbot model for dialogue generation. It was built by
 
 The model was fine-tuned in 4-bit precision using `peft` adapters, `transformers`, and `bitsandbytes`. Training relied on a method called "Low Rank Adapters" ([LoRA](https://arxiv.org/pdf/2106.09685.pdf)), specifically the [QLoRA](https://arxiv.org/abs/2305.14314) variant. The run took approximately 10 hours and was executed on a workstation with a single A100-SXM NVIDIA GPU with 37 GB of available memory. See attached [Colab Notebook](https://huggingface.co/dfurman/Falcon-40B-Chat-v0.1/blob/main/finetune_falcon40b_oasst1_with_bnb_peft.ipynb) for the code and hyperparams used to train the model. 
 
-### Model Date
+## Model Date
 
 May 30, 2023
 
+## [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
+Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_dfurman__falcon-40b-openassistant-peft)
+
+| Metric                | Value                     |
+|-----------------------|---------------------------|
+| Avg.                  | 51.17   |
+| ARC (25-shot)         | 62.63          |
+| HellaSwag (10-shot)   | 85.59    |
+| MMLU (5-shot)         | 57.77         |
+| TruthfulQA (0-shot)   | 51.02   |
+| Winogrande (5-shot)   | 81.45   |
+| GSM8K (5-shot)        | 13.34        |
+| DROP (3-shot)         | 6.36         |
+
 ## Quick Start
 
 To prompt the chat model, use the following format:
@@ -210,16 +224,4 @@ See attached [Colab Notebook](https://huggingface.co/dfurman/Falcon-40B-Chat-v0.
 - `accelerate`: 0.19.0
 - `bitsandbytes`: 0.39.0
 - `einops`: 0.6.1
-# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
-Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_dfurman__falcon-40b-openassistant-peft)
 
-| Metric                | Value                     |
-|-----------------------|---------------------------|
-| Avg.                  | 51.17   |
-| ARC (25-shot)         | 62.63          |
-| HellaSwag (10-shot)   | 85.59    |
-| MMLU (5-shot)         | 57.77         |
-| TruthfulQA (0-shot)   | 51.02   |
-| Winogrande (5-shot)   | 81.45   |
-| GSM8K (5-shot)        | 13.34        |
-| DROP (3-shot)         | 6.36         |