File size: 737 Bytes
406255b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 |
---
language:
- en
tags:
- transformers
license: apache-2.0
datasets:
- dvitel/hearthstone
metrics:
- exact_match
- bleu
- dvitel/codebleu
- chrf
---
Application of distilgpt2 to HearthStone card code synthesis. Dataset [dvitel/hearthstone](https://huggingface.co/datasets/dvitel/hearthstone) \
Article under consideration: [Abstract Syntax Networks for Code Generation and Semantic Parsing](https://aclanthology.org/P17-1105.pdf) \
We check if distilgpt2 could produce better results than ASNs from article. H0 model has minimal preprocessing of dataset where we normalize python code:
```python
def normalize(line:str):
return line.strip().replace("§", "\n").replace(" ", "\t").replace("\\ ", "").replace("\n\n", "\n")
``` |