weiweiz1 commited on
Commit
b1b00fa
1 Parent(s): e289d3d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -41,7 +41,7 @@ GPT-2/GPT-3.
41
  Evaluating the accuracy of the sparse model of gpt-j-6b using the lambada_openai dataset in lm_eval, providing the accuracy fluctuation under two precisions: FP32 and BF16.
42
  <figure>
43
 
44
- | Model | Sparsity | Dataset | Precision | Dense Acc ↑ | Sparse Acc ↑ | Acc fluctuations |
45
- |--------------|--------|----------------|------- |------- |-------- |-------- |
46
- | gpt-j-6B | 40% |Lambada_openai  | FP32 | 0.6831 | 0.6922 | +1.33% |
47
- | gpt-j-6B | 40% |Lambada_openai  | BF16 | 0.6771 | 0.6874 | +0.63% |
 
41
  Evaluating the accuracy of the sparse model of gpt-j-6b using the lambada_openai dataset in lm_eval, providing the accuracy fluctuation under two precisions: FP32 and BF16.
42
  <figure>
43
 
44
+ | Sparsity | Dataset | Precision | Dense Acc ↑ | Sparse Acc ↑ | Acc fluctuations |
45
+ |------ |---------------- |------- |------- |-------- |------------------ |
46
+ | 40% |Lambada_openai  | FP32 | 0.6831 | 0.6922 | +1.33% |
47
+ | 40% |Lambada_openai  | BF16 | 0.6771 | 0.6874 | +0.63% |