amr-mohamed commited on
Commit
350132d
1 Parent(s): 74a2052

Updated README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -12
README.md CHANGED
@@ -338,14 +338,14 @@ The models were compared against a collection of existing open-source Arabic mod
338
  <tr>
339
  <td><a href="https://huggingface.co/inceptionai/jais-family-1p3b-chat" target="_blank">jais-family-1p3b-chat</a></td>
340
  <td>35.39</td>
341
- <td>32.51</td>
342
  <td>38.33</td>
343
  <td>35.56</td>
344
  </tr>
345
  <tr>
346
  <td><a href="https://huggingface.co/inceptionai/jais-family-2p7b-chat" target="_blank">jais-family-2p7b-chat</a></td>
347
  <td>37.44</td>
348
- <td>34.49</td>
349
  <td>44.11</td>
350
  <td>52.97</td>
351
  </tr>
@@ -373,7 +373,7 @@ The models were compared against a collection of existing open-source Arabic mod
373
  <tr>
374
  <td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-2B" target="_blank">Atlas-Chat-2B</a></strong></td>
375
  <td><b>44.97</b></td>
376
- <td><b>41.48</b></td>
377
  <td><b>53.89</b></td>
378
  <td><b>92.31</b></td>
379
  </tr>
@@ -381,35 +381,35 @@ The models were compared against a collection of existing open-source Arabic mod
381
  <tr>
382
  <td><a href="https://huggingface.co/inceptionai/jais-family-6p7b-chat" target="_blank">jais-family-6p7b-chat</a></td>
383
  <td>39.96</td>
384
- <td>41.57</td>
385
  <td>51.22</td>
386
  <td>65.18</td>
387
  </tr>
388
  <tr>
389
  <td><a href="https://huggingface.co/inceptionai/jais-adapted-7b-chat" target="_blank">jais-adapted-7b-chat</a></td>
390
  <td>39.30</td>
391
- <td>35.19</td>
392
  <td>43.67</td>
393
  <td>61.84</td>
394
  </tr>
395
  <tr>
396
  <td><a href="https://huggingface.co/inceptionai/jais-family-13b-chat" target="_blank">jais-family-13b-chat</a></td>
397
  <td>45.11</td>
398
- <td>43.90</td>
399
  <td>58.67</td>
400
  <td>69.93</td>
401
  </tr>
402
  <tr>
403
  <td><a href="https://huggingface.co/inceptionai/jais-adapted-13b-chat" target="_blank">jais-adapted-13b-chat</a></td>
404
  <td>45.20</td>
405
- <td>40.65</td>
406
  <td>49.67</td>
407
  <td>77.52</td>
408
  </tr>
409
  <tr>
410
  <td><a href="https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat" target="_blank">AceGPT-7b-chat</a></td>
411
  <td>35.98</td>
412
- <td>36.57</td>
413
  <td>30.11</td>
414
  <td>47.31</td>
415
  </tr>
@@ -423,21 +423,21 @@ The models were compared against a collection of existing open-source Arabic mod
423
  <tr>
424
  <td><a href="https://huggingface.co/google/gemma-2-9b-it" target="_blank">gemma-2-9b-it</a></td>
425
  <td>35.91</td>
426
- <td>42.43</td>
427
  <td>31.00</td>
428
  <td>90.86</td>
429
  </tr>
430
  <tr>
431
  <td><a href="meta-llama/Meta-Llama-3.1-8B-Instruct" target="_blank">Llama-3.1-8B-Instruct</a></td>
432
  <td>44.13</td>
433
- <td>38.24</td>
434
  <td>47.00</td>
435
  <td>78.08</td>
436
  </tr>
437
  <tr>
438
  <td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-9B" target="_blank">Atlas-Chat-9B</a></strong></td>
439
  <td><b>58.23</b></td>
440
- <td><b>57.75</b></td>
441
  <td><b>74.56</b></td>
442
  <td><b>95.62</b></td>
443
  </tr>
@@ -766,7 +766,6 @@ The models were compared against a collection of existing open-source Arabic mod
766
 
767
  </table>
768
 
769
-
770
  ## Usage and Limitations
771
 
772
  These models have certain limitations that users should be aware of.
 
338
  <tr>
339
  <td><a href="https://huggingface.co/inceptionai/jais-family-1p3b-chat" target="_blank">jais-family-1p3b-chat</a></td>
340
  <td>35.39</td>
341
+ <td>27.71</td>
342
  <td>38.33</td>
343
  <td>35.56</td>
344
  </tr>
345
  <tr>
346
  <td><a href="https://huggingface.co/inceptionai/jais-family-2p7b-chat" target="_blank">jais-family-2p7b-chat</a></td>
347
  <td>37.44</td>
348
+ <td>29.10</td>
349
  <td>44.11</td>
350
  <td>52.97</td>
351
  </tr>
 
373
  <tr>
374
  <td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-2B" target="_blank">Atlas-Chat-2B</a></strong></td>
375
  <td><b>44.97</b></td>
376
+ <td><b>35.08</b></td>
377
  <td><b>53.89</b></td>
378
  <td><b>92.31</b></td>
379
  </tr>
 
381
  <tr>
382
  <td><a href="https://huggingface.co/inceptionai/jais-family-6p7b-chat" target="_blank">jais-family-6p7b-chat</a></td>
383
  <td>39.96</td>
384
+ <td>32.64</td>
385
  <td>51.22</td>
386
  <td>65.18</td>
387
  </tr>
388
  <tr>
389
  <td><a href="https://huggingface.co/inceptionai/jais-adapted-7b-chat" target="_blank">jais-adapted-7b-chat</a></td>
390
  <td>39.30</td>
391
+ <td>29.55</td>
392
  <td>43.67</td>
393
  <td>61.84</td>
394
  </tr>
395
  <tr>
396
  <td><a href="https://huggingface.co/inceptionai/jais-family-13b-chat" target="_blank">jais-family-13b-chat</a></td>
397
  <td>45.11</td>
398
+ <td>33.98</td>
399
  <td>58.67</td>
400
  <td>69.93</td>
401
  </tr>
402
  <tr>
403
  <td><a href="https://huggingface.co/inceptionai/jais-adapted-13b-chat" target="_blank">jais-adapted-13b-chat</a></td>
404
  <td>45.20</td>
405
+ <td>32.84</td>
406
  <td>49.67</td>
407
  <td>77.52</td>
408
  </tr>
409
  <tr>
410
  <td><a href="https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat" target="_blank">AceGPT-7b-chat</a></td>
411
  <td>35.98</td>
412
+ <td>30.33</td>
413
  <td>30.11</td>
414
  <td>47.31</td>
415
  </tr>
 
423
  <tr>
424
  <td><a href="https://huggingface.co/google/gemma-2-9b-it" target="_blank">gemma-2-9b-it</a></td>
425
  <td>35.91</td>
426
+ <td>32.19</td>
427
  <td>31.00</td>
428
  <td>90.86</td>
429
  </tr>
430
  <tr>
431
  <td><a href="meta-llama/Meta-Llama-3.1-8B-Instruct" target="_blank">Llama-3.1-8B-Instruct</a></td>
432
  <td>44.13</td>
433
+ <td>31.40</td>
434
  <td>47.00</td>
435
  <td>78.08</td>
436
  </tr>
437
  <tr>
438
  <td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-9B" target="_blank">Atlas-Chat-9B</a></strong></td>
439
  <td><b>58.23</b></td>
440
+ <td><b>43.65</b></td>
441
  <td><b>74.56</b></td>
442
  <td><b>95.62</b></td>
443
  </tr>
 
766
 
767
  </table>
768
 
 
769
  ## Usage and Limitations
770
 
771
  These models have certain limitations that users should be aware of.