Merge branch 'main' of https://huggingface.co/TMElyralab/lyraBaichuan into main
Browse files
README.md
CHANGED
@@ -33,14 +33,14 @@ We use the Baichuan2-7B-Base and Baichuan2-13B-Base model for measurement, but t
|
|
33 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
34 |
| --- | --- | --- | --- | --- | --- |
|
35 |
| Torch 2.0.1 | 41.2 | 323.2 | 640.0 | 1256.8 | 2231.0 |
|
36 |
-
|
|
37 |
|
38 |
### Baichuan2-13B-Base
|
39 |
|
40 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
41 |
| --- | --- | --- | --- | --- | --- |
|
42 |
| Torch 2.0.1 | 40.9 | 307.9 | 555.6 | 1010.4 | 1601.0 |
|
43 |
-
|
|
44 |
|
45 |
## Docker Environment Recommendation
|
46 |
|
|
|
33 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
34 |
| --- | --- | --- | --- | --- | --- |
|
35 |
| Torch 2.0.1 | 41.2 | 323.2 | 640.0 | 1256.8 | 2231.0 |
|
36 |
+
| lyraBaichuan | 125.9 | 948.1 | 1749.3 | 2974.0 | 4370.1 |
|
37 |
|
38 |
### Baichuan2-13B-Base
|
39 |
|
40 |
| Version | Batch Size 1 | Batch Size 8 | Batch Size 16 | Batch Size 32 | Batch Size 64 |
|
41 |
| --- | --- | --- | --- | --- | --- |
|
42 |
| Torch 2.0.1 | 40.9 | 307.9 | 555.6 | 1010.4 | 1601.0 |
|
43 |
+
| lyraBaichuan | 80.0 | 568.2 | 1124.4 | 1942.6 | 2828.0 |
|
44 |
|
45 |
## Docker Environment Recommendation
|
46 |
|