ShawLiu commited on
Commit
466fd5b
1 Parent(s): 729b2ea

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +53 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ language:
4
+ - en
5
+ base_model:
6
+ - meta/Llama-3.1-70B
7
+ tags:
8
+ - webrl
9
+ - llama3.1
10
+ - webarena-lite
11
+ - llm
12
+ - agent
13
+ ---
14
+
15
+
16
+ # WebRL-Llama-3.1-70B
17
+
18
+
19
+ ## Model Introduction
20
+ WebRL-Llama-3.1-70B is the open-source version of WebRL in Llama-3.1-70B released by Zhipu AI.
21
+ It has the ability to complete web operations on five websites in WebArena: OpenStreetMap (Map), Reddit, GitLab, online store content management system (CMS) and OneStopShop (OSS).
22
+
23
+
24
+ ## Evaluation Results
25
+
26
+
27
+ We evaluated the WebRL-Llama-3.1-70B model on WebArena-Lite and obtained the following results:
28
+
29
+
30
+ | Model | Reddit | Gitlab | CMS | Map | OSS | Avg.SR |
31
+ |:--------------------|:------:|:------:|:------:|:------:|:------:|:--------:|
32
+ | Llama-3.1-8B-Instruct | 0.0 | 3.3 | 2.9 | 3.3 | 11.1 | 4.8 |
33
+ | Llama-3.1-70B-Instruct | 10.5 | 16.7 | 17.1 | 20.0 | 4.4 | 12.7 |
34
+ | WebRL-Llama-3.1-70B | 78.9 | 50.0 | 54.3 | 40.0 | 44.4 | 49.1 |
35
+
36
+
37
+ **For more inference code and requirements, please visit our [github page](GitHub - THUDM/WebRL).**
38
+
39
+
40
+ ## Citations
41
+
42
+
43
+ If you find our work useful, please consider citing the following paper.
44
+
45
+
46
+ ```
47
+ @artical{qi2024webrl,
48
+ title={WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning},
49
+ author={Zehan Qi and Xiao Liu and Iat Long Iong and Hanyu Lai and Xueqiao Sun and Xinyue Yang and Jiadai Sun and Yu Yang and Shuntian Yao and Tianjie Zhang and Wei Xu and Jie Tang and Yuxiao Dong},
50
+ journal={arXiv preprint arXiv:2411.02337},
51
+ year={2024},
52
+ }
53
+ ```