Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,11 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
AR loss to consistency loss ratio: 10: 1
|
| 2 |
+
|
| 3 |
+
CodeSearchNet-Python dataset size: 50k (10%)
|
| 4 |
+
|
| 5 |
+
n-token sequence length: 32
|
| 6 |
+
|
| 7 |
+
Jacobi trajectory data cleaning: True
|
| 8 |
+
|
| 9 |
+
Target model: Deepseek-Coder-7B fine-tuned on CodeSearchNet-Python
|
| 10 |
+
|
| 11 |
+
release date: 02/26/2024
|