tiiuae
/

falcon-11B

@@ -7,7 +7,7 @@
 🤗 To get started with Falcon (inference, finetuning, quantization, etc.), we recommend reading [this great blogpost fron HF](https://huggingface.co/blog/falcon)!
-⚠️ **This is a raw, pretrained model, which should be further finetuned for most usecases.** If you are looking for a version better suited to taking generic instructions in a chat format, we recommend taking a look at [Falcon2-11B-Chat](https://huggingface.co/tiiuae/Falcon2-11B-chat).
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
@@ -25,7 +25,7 @@ pipeline = transformers.pipeline(
     trust_remote_code=True,
 )
 sequences = pipeline(
-   "Girafatron is obsessed with giraffes, the most glorious animal on the face of this Earth. Giraftron believes all other animals are irrelevant when compared to the glorious majesty of the giraffe.\nDaniel: Hello, Girafatron!\nGirafatron:",
     max_length=200,
     do_sample=True,
     top_k=10,
@@ -93,7 +93,7 @@ pipeline = transformers.pipeline(
     device_map="auto",
 )
 sequences = pipeline(
-   "Girafatron is obsessed with giraffes, the most glorious animal on the face of this Earth. Giraftron believes all other animals are irrelevant when compared to the glorious majesty of the giraffe.\nDaniel: Hello, Girafatron!\nGirafatron:",
     max_length=200,
     do_sample=True,
     top_k=10,
@@ -149,16 +149,17 @@ The model training took roughly two months.
 ## Evaluation
-|English Benchmark | **Value**  | **Comment**                               |
-|--------------------|------------|-------------------------------------------|
-| HellaSwag-10shots          | 82.91     |                                           |
-| Winogrande-5shots | 78.30     |                                           |
-| ARC-Challenge-25shots         | 59.73    |                                           |
-| TruthfulQA-0shot      | 52.56     |                                           |
-| MMLU-5shots | 58.37     |                                           |
-| GSM8k-5shots | 53.83     |                                           |
-| ARC-Challenge-0shot | 50.17     |                                           |
-| ARC-Easy-0shot | 77.78     |                                           |
 We thank the leaderboard team from HuggingFace for providing an official evaluation of our model on the leaderboard tasks.

 🤗 To get started with Falcon (inference, finetuning, quantization, etc.), we recommend reading [this great blogpost fron HF](https://huggingface.co/blog/falcon)!
+⚠️ **This is a raw, pretrained model, which should be further finetuned for most usecases.**
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
     trust_remote_code=True,
 )
 sequences = pipeline(
+   "Can you explain the concepts of Quantum Computing?",
     max_length=200,
     do_sample=True,
     top_k=10,
     device_map="auto",
 )
 sequences = pipeline(
+   "Can you explain the concepts of Quantum Computing?",
     max_length=200,
     do_sample=True,
     top_k=10,
 ## Evaluation
+|English Benchmark | **Value**  |
+|--------------------|------------|
+| ARC-Challenge-25shots         | 59.73    |
+| HellaSwag-10shots  | 82.91     |
+| MMLU-5shots | 58.37     |
+| Winogrande-5shots | 78.30     |
+| TruthfulQA-0shot      | 52.56     |
+| GSM8k-5shots | 53.83     |
+| ARC-Challenge-0shot | 50.17     |
+| ARC-Easy-0shot | 77.78     |
+| Hellaswag-0shot    | 82.07     |
 We thank the leaderboard team from HuggingFace for providing an official evaluation of our model on the leaderboard tasks.