pvduy commited on
Commit
961aa3f
1 Parent(s): fd8e2d7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -160,6 +160,12 @@ output = tokenizer.batch_decode(tokens[:, inputs.input_ids.shape[-1]:], skip_spe
160
  | CodeLlama Instruct | 7B | 3.55 |
161
  | StarChat2 | 15B | 5.7 |
162
 
 
 
 
 
 
 
163
 
164
 
165
 
 
160
  | CodeLlama Instruct | 7B | 3.55 |
161
  | StarChat2 | 15B | 5.7 |
162
 
163
+ ### SQL Performance
164
+ | Model | Size | Date | Group By | Order By | Ratio | Join | Where |
165
+ |-----------------------------|------|-------|----------|----------|-------|-------|-------|
166
+ | Stable Code Instruct (DPO) | 3B | 24.0% | 54.2% | 68.5% | 40.0% | 54.2% | 42.8% |
167
+ | DeepSeek-Coder Instruct | 1.3B | 24.0% | 37.1% | 51.4% | 34.3% | 45.7% | 45.7% |
168
+ | SQLCoder | 7B | 64.0% | 82.9% | 74.3% | 54.3% | 74.3% | 74.3% |
169
 
170
 
171