DiaVio commited on
Commit
f24717d
1 Parent(s): d71be65

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -2
README.md CHANGED
@@ -8,10 +8,37 @@ metrics:
8
  - bleurt
9
  pipeline_tag: text-generation
10
  ---
 
 
 
 
 
11
  Simulation testing has been widely adopted by leading companies to ensure the safety of autonomous driving systems (ADSs). A number of scenario-based testing approaches have been developed to generate diverse driving scenarios for simulation testing, and demonstrated to be capable of finding safety violations. However, there is no automated way to diagnose whether these violations are caused by the ADS under test and which category these violations belong to. As a result, great effort is required to manually diagnose violations.
12
 
13
  To bridge this gap, we propose DiaVio to automatically diagnose safety violations in simulation testing by leveraging large language models (LLMs). It is built on top of a new domain specific language (DSL) of crash to align real-world accident reports described in natural language and violation scenarios in simulation testing. DiaVio fine-tunes a base LLM with real-world accident reports to learn diagnosis capability, and uses the fine-tuned LLM to diagnose violation scenarios in simulation testing. Our evaluation has demonstrated the effectiveness and efficiency of DiaVio in violation diagnosis.
14
 
15
- We bridge DiaVio with two state-of-the-art open source scenario-based testing approaches, i.e., AV-Fuzzer and DriveFuzz. Specifically, we set up AV-Fuzzer with the Apollo 8.0 ADS and the SORA-SVL simulator, and set up DriveFuzz with the Behavior Agent ADS and the Carla simulator.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
17
- The "loras" folder is fine-tuned models according to the Llama2 series chat models based on the real traffic accident data set in the DiaVio method.
 
8
  - bleurt
9
  pipeline_tag: text-generation
10
  ---
11
+
12
+ # DiaVio: Safety Violation Diagnosis for Autonomous Driving Simulation Testing
13
+
14
+ ## Overview
15
+
16
  Simulation testing has been widely adopted by leading companies to ensure the safety of autonomous driving systems (ADSs). A number of scenario-based testing approaches have been developed to generate diverse driving scenarios for simulation testing, and demonstrated to be capable of finding safety violations. However, there is no automated way to diagnose whether these violations are caused by the ADS under test and which category these violations belong to. As a result, great effort is required to manually diagnose violations.
17
 
18
  To bridge this gap, we propose DiaVio to automatically diagnose safety violations in simulation testing by leveraging large language models (LLMs). It is built on top of a new domain specific language (DSL) of crash to align real-world accident reports described in natural language and violation scenarios in simulation testing. DiaVio fine-tunes a base LLM with real-world accident reports to learn diagnosis capability, and uses the fine-tuned LLM to diagnose violation scenarios in simulation testing. Our evaluation has demonstrated the effectiveness and efficiency of DiaVio in violation diagnosis.
19
 
20
+ ## Methodology
21
+
22
+ DiaVio fine-tunes a base LLM with real-world accident reports, enabling it to diagnose safety violations in simulation testing.
23
+
24
+ ## Integration with Testing Approaches
25
+
26
+ DiaVio is integrated with two state-of-the-art open-source scenario-based testing approaches:
27
+ - **AV-Fuzzer**: Setup with Apollo 8.0 ADS and the SORA-SVL simulator.
28
+ - **DriveFuzz**: Setup with Behavior Agent ADS and the Carla simulator.
29
+
30
+ ## "loras" Folder
31
+
32
+ The "loras" folder contains fine-tuned models based on the Llama2 series chat models. These models are trained using real traffic accident data from the DiaVio method.
33
+
34
+ ## How to Use
35
+
36
+ Researchers and practitioners in autonomous driving can leverage DiaVio for:
37
+ - Automated diagnosis of safety violations in simulation testing.
38
+ - Integration with scenario-based testing approaches.
39
+ - Fine-tuning language models for safety scenario analysis.
40
+
41
+ ## Citation
42
+
43
+ If you use DiaVio in your work, please cite our related publication.
44