FalconLLM commited on
Commit
a0395a0
β€’
1 Parent(s): f6d4744

Update citation info

Browse files
Files changed (1) hide show
  1. README.md +23 -2
README.md CHANGED
@@ -161,7 +161,7 @@ Training happened in early March 2023 and took about two weeks.
161
 
162
  ## Evaluation
163
 
164
- *Paper coming soon.*
165
 
166
  See the [OpenLLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) for early results.
167
 
@@ -199,7 +199,28 @@ Falcon-7B was trained a custom distributed training codebase, Gigatron. It uses
199
 
200
  ## Citation
201
 
202
- *Paper coming soon* 😊.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
203
 
204
  ## License
205
 
 
161
 
162
  ## Evaluation
163
 
164
+ *Paper coming soon*.
165
 
166
  See the [OpenLLM Leaderboard](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) for early results.
167
 
 
199
 
200
  ## Citation
201
 
202
+ *Paper coming soon* 😊. In the meanwhile, you can use the following information to cite:
203
+ ```
204
+ @article{falcon40b,
205
+ title={{Falcon-40B}: an open large language model with state-of-the-art performance},
206
+ author={Almazrouei, Ebtesam and Alobeidli, Hamza and Alshamsi, Abdulaziz and Cappelli, Alessandro and Cojocaru, Ruxandra and Debbah, Merouane and Goffinet, Etienne and Heslow, Daniel and Launay, Julien and Malartic, Quentin and Noune, Badreddine and Pannier, Baptiste and Penedo, Guilherme},
207
+ year={2023}
208
+ }
209
+ ```
210
+
211
+ To learn more about the pretraining dataset, see the πŸ““ [RefinedWeb paper](https://arxiv.org/abs/2306.01116).
212
+
213
+ ```
214
+ @article{refinedweb,
215
+ title={The {R}efined{W}eb dataset for {F}alcon {LLM}: outperforming curated corpora with web data, and web data only},
216
+ author={Guilherme Penedo and Quentin Malartic and Daniel Hesslow and Ruxandra Cojocaru and Alessandro Cappelli and Hamza Alobeidli and Baptiste Pannier and Ebtesam Almazrouei and Julien Launay},
217
+ journal={arXiv preprint arXiv:2306.01116},
218
+ eprint={2306.01116},
219
+ eprinttype = {arXiv},
220
+ url={https://arxiv.org/abs/2306.01116},
221
+ year={2023}
222
+ }
223
+ ```
224
 
225
  ## License
226