rishdotblog commited on
Commit
7041123
1 Parent(s): fcf27f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -1
README.md CHANGED
@@ -8,6 +8,8 @@ pipeline_tag: text-generation
8
 
9
  A capable large language model for natural language to SQL generation. Outperforms all generalist models (including GPT-4) on text to SQL.
10
 
 
 
11
 
12
  ## Model Details
13
 
@@ -45,7 +47,18 @@ You can read more about the methodology behind SQLEval [here](https://defog.ai/b
45
 
46
  ### Results
47
 
48
- [More Information Needed]
 
 
 
 
 
 
 
 
 
 
 
49
 
50
  ## Model Card Authors
51
 
 
8
 
9
  A capable large language model for natural language to SQL generation. Outperforms all generalist models (including GPT-4) on text to SQL.
10
 
11
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/603bbad3fd770a9997b57cb6/3BVMV2z6FTEEPF1hJ2qu1.png)
12
+
13
 
14
  ## Model Details
15
 
 
47
 
48
  ### Results
49
 
50
+ We classified each generated question into one of 6 categories. The table displays the percentage of questions answered correctly by each model, broken down by category.
51
+ | | date | group_by | order_by | ratio | join | where |
52
+ | ------------- | ---- | -------- | -------- | ----- | ---- | ----- |
53
+ | sqlcoder-70b | 96 | 91.4 | 97.1 | 85.7 | 97.1 | 91.4 |
54
+ | sqlcoder-34b | 80 | 94.3 | 85.7 | 77.1 | 85.7 | 80 |
55
+ | gpt-4 | 64 | 94.3 | 88.6 | 74.2 | 85.7 | 80 |
56
+ | sqlcoder2-15b | 76 | 80 | 77.1 | 60 | 77.1 | 77.1 |
57
+ | sqlcoder-7b | 64 | 82.9 | 74.3 | 54.3 | 74.3 | 74.3 |
58
+ | gpt-3.5 | 68 | 77.1 | 74.2 | 34.3 | 65.7 | 71.4 |
59
+ | claude-2 | 52 | 71.4 | 74.3 | 57.1 | 65.7 | 62.9 |
60
+
61
+ ## Using SQLCoder
62
 
63
  ## Model Card Authors
64