CarperAI
/

FIM-NeoX-1.3B

Text Generation

code-generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

hails commited on Oct 7, 2022

Commit

c77b412

•

1 Parent(s): 2f06c6f

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -119,7 +119,11 @@ Report:
 LogiQA, PIQA, SciQ, WSC, Winogrande, ARC_challenge, ARC_easy, lambada
 On FIM-1.3B, the comparable autoregressive model,

 LogiQA, PIQA, SciQ, WSC, Winogrande, ARC_challenge, ARC_easy, lambada
 On FIM-1.3B, the comparable autoregressive model,
+| Model           | HumanEval-Infilling | arc_easy | arc_challenge | lambada | piqa   | sciq  | wsc    | winogrande |
+|-----------------|---------------------|----------|---------------|---------|--------|-------|--------|------------|
+| AR-1.3B         | 0.0029              | 0.5816   | 0.2465        | 7.03    | 0.7116 | 0.85  | 0.3654 | 0.5651     |
+| FIM-1.3B-rotary | 0.0155              | 0.5829   | 0.2457        | 7.08    | 0.7029 | 0.861 | 0.3654 | 0.5390     |
+| FIM-1.3B-alibi  | 0.0029              | 0.5589   | 0.25          | 7.49    | 0.6926 | 0.856 | 0.3654 | 0.5406     |