amr-mohamed
commited on
Commit
•
350132d
1
Parent(s):
74a2052
Updated README.md
Browse files
README.md
CHANGED
@@ -338,14 +338,14 @@ The models were compared against a collection of existing open-source Arabic mod
|
|
338 |
<tr>
|
339 |
<td><a href="https://huggingface.co/inceptionai/jais-family-1p3b-chat" target="_blank">jais-family-1p3b-chat</a></td>
|
340 |
<td>35.39</td>
|
341 |
-
<td>
|
342 |
<td>38.33</td>
|
343 |
<td>35.56</td>
|
344 |
</tr>
|
345 |
<tr>
|
346 |
<td><a href="https://huggingface.co/inceptionai/jais-family-2p7b-chat" target="_blank">jais-family-2p7b-chat</a></td>
|
347 |
<td>37.44</td>
|
348 |
-
<td>
|
349 |
<td>44.11</td>
|
350 |
<td>52.97</td>
|
351 |
</tr>
|
@@ -373,7 +373,7 @@ The models were compared against a collection of existing open-source Arabic mod
|
|
373 |
<tr>
|
374 |
<td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-2B" target="_blank">Atlas-Chat-2B</a></strong></td>
|
375 |
<td><b>44.97</b></td>
|
376 |
-
<td><b>
|
377 |
<td><b>53.89</b></td>
|
378 |
<td><b>92.31</b></td>
|
379 |
</tr>
|
@@ -381,35 +381,35 @@ The models were compared against a collection of existing open-source Arabic mod
|
|
381 |
<tr>
|
382 |
<td><a href="https://huggingface.co/inceptionai/jais-family-6p7b-chat" target="_blank">jais-family-6p7b-chat</a></td>
|
383 |
<td>39.96</td>
|
384 |
-
<td>
|
385 |
<td>51.22</td>
|
386 |
<td>65.18</td>
|
387 |
</tr>
|
388 |
<tr>
|
389 |
<td><a href="https://huggingface.co/inceptionai/jais-adapted-7b-chat" target="_blank">jais-adapted-7b-chat</a></td>
|
390 |
<td>39.30</td>
|
391 |
-
<td>
|
392 |
<td>43.67</td>
|
393 |
<td>61.84</td>
|
394 |
</tr>
|
395 |
<tr>
|
396 |
<td><a href="https://huggingface.co/inceptionai/jais-family-13b-chat" target="_blank">jais-family-13b-chat</a></td>
|
397 |
<td>45.11</td>
|
398 |
-
<td>
|
399 |
<td>58.67</td>
|
400 |
<td>69.93</td>
|
401 |
</tr>
|
402 |
<tr>
|
403 |
<td><a href="https://huggingface.co/inceptionai/jais-adapted-13b-chat" target="_blank">jais-adapted-13b-chat</a></td>
|
404 |
<td>45.20</td>
|
405 |
-
<td>
|
406 |
<td>49.67</td>
|
407 |
<td>77.52</td>
|
408 |
</tr>
|
409 |
<tr>
|
410 |
<td><a href="https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat" target="_blank">AceGPT-7b-chat</a></td>
|
411 |
<td>35.98</td>
|
412 |
-
<td>
|
413 |
<td>30.11</td>
|
414 |
<td>47.31</td>
|
415 |
</tr>
|
@@ -423,21 +423,21 @@ The models were compared against a collection of existing open-source Arabic mod
|
|
423 |
<tr>
|
424 |
<td><a href="https://huggingface.co/google/gemma-2-9b-it" target="_blank">gemma-2-9b-it</a></td>
|
425 |
<td>35.91</td>
|
426 |
-
<td>
|
427 |
<td>31.00</td>
|
428 |
<td>90.86</td>
|
429 |
</tr>
|
430 |
<tr>
|
431 |
<td><a href="meta-llama/Meta-Llama-3.1-8B-Instruct" target="_blank">Llama-3.1-8B-Instruct</a></td>
|
432 |
<td>44.13</td>
|
433 |
-
<td>
|
434 |
<td>47.00</td>
|
435 |
<td>78.08</td>
|
436 |
</tr>
|
437 |
<tr>
|
438 |
<td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-9B" target="_blank">Atlas-Chat-9B</a></strong></td>
|
439 |
<td><b>58.23</b></td>
|
440 |
-
<td><b>
|
441 |
<td><b>74.56</b></td>
|
442 |
<td><b>95.62</b></td>
|
443 |
</tr>
|
@@ -766,7 +766,6 @@ The models were compared against a collection of existing open-source Arabic mod
|
|
766 |
|
767 |
</table>
|
768 |
|
769 |
-
|
770 |
## Usage and Limitations
|
771 |
|
772 |
These models have certain limitations that users should be aware of.
|
|
|
338 |
<tr>
|
339 |
<td><a href="https://huggingface.co/inceptionai/jais-family-1p3b-chat" target="_blank">jais-family-1p3b-chat</a></td>
|
340 |
<td>35.39</td>
|
341 |
+
<td>27.71</td>
|
342 |
<td>38.33</td>
|
343 |
<td>35.56</td>
|
344 |
</tr>
|
345 |
<tr>
|
346 |
<td><a href="https://huggingface.co/inceptionai/jais-family-2p7b-chat" target="_blank">jais-family-2p7b-chat</a></td>
|
347 |
<td>37.44</td>
|
348 |
+
<td>29.10</td>
|
349 |
<td>44.11</td>
|
350 |
<td>52.97</td>
|
351 |
</tr>
|
|
|
373 |
<tr>
|
374 |
<td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-2B" target="_blank">Atlas-Chat-2B</a></strong></td>
|
375 |
<td><b>44.97</b></td>
|
376 |
+
<td><b>35.08</b></td>
|
377 |
<td><b>53.89</b></td>
|
378 |
<td><b>92.31</b></td>
|
379 |
</tr>
|
|
|
381 |
<tr>
|
382 |
<td><a href="https://huggingface.co/inceptionai/jais-family-6p7b-chat" target="_blank">jais-family-6p7b-chat</a></td>
|
383 |
<td>39.96</td>
|
384 |
+
<td>32.64</td>
|
385 |
<td>51.22</td>
|
386 |
<td>65.18</td>
|
387 |
</tr>
|
388 |
<tr>
|
389 |
<td><a href="https://huggingface.co/inceptionai/jais-adapted-7b-chat" target="_blank">jais-adapted-7b-chat</a></td>
|
390 |
<td>39.30</td>
|
391 |
+
<td>29.55</td>
|
392 |
<td>43.67</td>
|
393 |
<td>61.84</td>
|
394 |
</tr>
|
395 |
<tr>
|
396 |
<td><a href="https://huggingface.co/inceptionai/jais-family-13b-chat" target="_blank">jais-family-13b-chat</a></td>
|
397 |
<td>45.11</td>
|
398 |
+
<td>33.98</td>
|
399 |
<td>58.67</td>
|
400 |
<td>69.93</td>
|
401 |
</tr>
|
402 |
<tr>
|
403 |
<td><a href="https://huggingface.co/inceptionai/jais-adapted-13b-chat" target="_blank">jais-adapted-13b-chat</a></td>
|
404 |
<td>45.20</td>
|
405 |
+
<td>32.84</td>
|
406 |
<td>49.67</td>
|
407 |
<td>77.52</td>
|
408 |
</tr>
|
409 |
<tr>
|
410 |
<td><a href="https://huggingface.co/FreedomIntelligence/AceGPT-7B-chat" target="_blank">AceGPT-7b-chat</a></td>
|
411 |
<td>35.98</td>
|
412 |
+
<td>30.33</td>
|
413 |
<td>30.11</td>
|
414 |
<td>47.31</td>
|
415 |
</tr>
|
|
|
423 |
<tr>
|
424 |
<td><a href="https://huggingface.co/google/gemma-2-9b-it" target="_blank">gemma-2-9b-it</a></td>
|
425 |
<td>35.91</td>
|
426 |
+
<td>32.19</td>
|
427 |
<td>31.00</td>
|
428 |
<td>90.86</td>
|
429 |
</tr>
|
430 |
<tr>
|
431 |
<td><a href="meta-llama/Meta-Llama-3.1-8B-Instruct" target="_blank">Llama-3.1-8B-Instruct</a></td>
|
432 |
<td>44.13</td>
|
433 |
+
<td>31.40</td>
|
434 |
<td>47.00</td>
|
435 |
<td>78.08</td>
|
436 |
</tr>
|
437 |
<tr>
|
438 |
<td><strong><a href="https://huggingface.co/MBZUAI-Paris/Atlas-Chat-9B" target="_blank">Atlas-Chat-9B</a></strong></td>
|
439 |
<td><b>58.23</b></td>
|
440 |
+
<td><b>43.65</b></td>
|
441 |
<td><b>74.56</b></td>
|
442 |
<td><b>95.62</b></td>
|
443 |
</tr>
|
|
|
766 |
|
767 |
</table>
|
768 |
|
|
|
769 |
## Usage and Limitations
|
770 |
|
771 |
These models have certain limitations that users should be aware of.
|