LLM4Binary commited on
Commit
08bfe99
1 Parent(s): a01086f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -8
README.md CHANGED
@@ -15,14 +15,22 @@ LLM4Decompile aims to decompile x86 assembly instructions into C. The newly rele
15
 
16
 
17
  ### 2. Evaluation Results
18
- | Model | HumanEval-Decompile | | | | | ExeBench | | | | |
19
- |:-----------------------:|:-------------------:|:------:|:------:|:------:|:------:|:--------:|:------:|:------:|:------:|:------:|
20
- | opt-level | O0 | O1 | O2 | O3 | Avg. | O0 | O1 | O2 | O3 | Avg. |
21
- | GPT4 | 0.1341 | 0.1890 | 0.1524 | 0.0854 | 0.1402 | TBD | TBD | TBD | TBD | TBD |
22
- | Deepseek-Coder-33B | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
23
- | LLM4Decompile-6.7B-UO | 0.3720 | 0.1585 | 0.2134 | 0.2134 | 0.2393 | 0.0904 | 0.0988 | 0.0988 | 0.0950 | 0.0957 |
24
- | LLM4Decompile-1.3B-V1.5 | 0.4817 | 0.2463 | 0.2329 | 0.2280 | 0.2972 | 0.2076 | 0.1774 | 0.1721 | 0.1728 | 0.1824 |
25
- | LLM4Decompile-6.7B-V1.5 | 0.6927 | 0.4280 | 0.4134 | 0.3732 | 0.4768 | 0.2453 | 0.1999 | 0.1927 | 0.1938 | 0.2079 |
 
 
 
 
 
 
 
 
26
 
27
 
28
  ### 3. How to Use
 
15
 
16
 
17
  ### 2. Evaluation Results
18
+
19
+ +------------------------+-------------------------------------------------+-------------------------------------------------+
20
+ | Model/Benchmark | HumanEval-Decompile | ExeBench |
21
+ +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
22
+ | Optimization Level | O0 | O1 | O2 | O3 | AVG | O0 | O1 | O2 | O3 | AVG |
23
+ +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
24
+ | DeepSeek-Coder-6.7B | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.0000 |
25
+ +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
26
+ | GPT-4o | 0.3049 | 0.1159 | 0.1037 | 0.1159 | 0.1601 | 0.0443 | 0.0328 | 0.0397 | 0.0343 | 0.0378 |
27
+ +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
28
+ | LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
29
+ +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
30
+ | LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
31
+ +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
32
+ | LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
33
+ +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
34
 
35
 
36
  ### 3. How to Use