Spaces:
Runtime error
Runtime error
File size: 552 Bytes
8655a4b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 |
## Chatbot Arena Conversations
1. Gather battles
```
python3 clean_battle_data.py --max-num 10 --mode conv_release
```
2. Tag OpenAI moderation
```
python3 tag_openai_moderation.py --in clean_battle_conv_20230814.json
```
3. Clean PII
4. Filter additional blocked words
```
python3 filter_bad_conv.py --in clean_battle_conv_20230630_tagged_v1_pii.json
```
5. Add additional toxicity tag
## All Conversations
1. Gather chats
```
python3 clean_chat_data.py
```
2. Sample
```
python3 conv_release_scripts/sample.py
```
## Prompt distribution
|