rohitsroch commited on
Commit
78c1b08
1 Parent(s): 427f0c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -10
README.md CHANGED
@@ -4,6 +4,9 @@ language:
4
  license: apache-2.0
5
  tags:
6
  - NatSight-AdpSeq2Seq
 
 
 
7
  ---
8
 
9
  ## Paper
@@ -13,11 +16,13 @@ Aurthors: *Rohit Sroch*, *Dhiraj Patnaik*, *Jayachandran Ramachandran*
13
 
14
  ## Abstract
15
 
16
- In modern organizations, a large volume of customer, transactional and operational data is stored in relational database management systems (RDBMS). It provides scalability and agility for various business use cases. However, the interaction between these databases and business users is limited as users often lack the knowledge of query languages such as SQL and they need to rely on technical experts to interact with the database for curating insights & analytics. Recent advances in augmented analytics platforms have enabled business users to engage with data in natural language and consume insights in the form of data tables and charts. There are still limitations as the experience is still suboptimal.
 
17
  The development of natural language interfaces to databases has long been a challenge as previous approaches rely on a considerable amount of human-labeled data for domain adaptation. Moreover, most interfaces provide a constrained environment and do not allow the users to freely and naturally interact with data.
18
- In this work, we propose our framework for building domainagnostic natural language (NL) interfaces to relational databases (NLIDBs) in few-shot and zero-shot scenarios. Also, recent advancements in the area of Transfer learning allowed us to leverage Transformer-based pre-trained language models (PLMs), resulting in various real-world applications in functional areas like CRM, Supply Chain, Ecommerce, Health Care, etc. for getting real-time insights.
19
- More specifically, our framework works in the following ways: First, it provides graph focused auto-suggestions to complete the natural language queries based on the graph representation of database schema, and Second, it uses an adaptive sequenceto-sequence translator model that translates natural language queries to corresponding SQL queries. Furthermore, a feedback loop is used to improve the system based on active learning.
20
- Experiment results on benchmark datasets show that our approach achieves a state-of-the-art performance and can be effective in the few-shot and zero-shot scenarios for domainagnostic applications.
 
21
 
22
  *Sroch, R. & Patnaik, D. & Ramachandran, J. (2022). [NatSight: A framework for building domain agnostic Natural Language Interface to Databases for next-gen Augmented Analytics](https://dcal.iimb.ac.in/baiconf2022/full_papers/2346.pdf).
23
  9th International Conference on Business Analytics and Intelligence, IIM Banglore (BAI Conf’22).*
@@ -44,9 +49,9 @@ $ hyperparameters = torch.load(os.path.join('training_args.bin'))
44
 
45
  ### Evaluation results
46
 
47
- | ckpt_name | eval_bp | eval_em_accuracy | eval_ref_len | eval_runtime | eval_samples | eval_samples_per_second | eval_score | eval_steps_per_second | eval_sys_len |
48
- |:----------------:|:-------:|:----------------:|:------------:|:------------:|:------------:|:-----------------------:|:----------:|:---------------------:|:------------:|
49
- | checkpoint-42879 | 0.9907 | 83.3831 | 54260 | 421.0431 | 4821 | 11.45 | 95.2695 | 1.432 | 53756 |
50
 
51
 
52
  ### Framework versions
@@ -54,7 +59,6 @@ $ hyperparameters = torch.load(os.path.join('training_args.bin'))
54
  - Transformers >=4.8.0
55
  - Pytorch >=1.6.0
56
  - TensorFlow >=2.5.0
57
- - Flax >=0.3.5
58
  - Datasets >=1.10.2
59
  - Tokenizers >=0.11.6
60
 
@@ -71,5 +75,4 @@ If you use these models, please cite the following paper:
71
  month={Dec},
72
  url = {https://dcal.iimb.ac.in/baiconf2022/full_papers/2346.pdf}
73
  }
74
- ```
75
-
 
4
  license: apache-2.0
5
  tags:
6
  - NatSight-AdpSeq2Seq
7
+ - Text2SQL
8
+ datasets:
9
+ - wikisql
10
  ---
11
 
12
  ## Paper
 
16
 
17
  ## Abstract
18
 
19
+ In modern organizations, a large volume of customer, transactional, and operational data is stored in relational database management systems (RDBMS). It provides scalability and agility for various business use cases. However, the interaction between these databases and business users is limited as users often lack the knowledge of query languages such as SQL and they need to rely on technical experts to interact with the database for curating insights \& analytics. Recent advances in augmented analytics platforms have enabled business users to engage with data in natural language and consume insights in the form of data tables and charts. There are still limitations as the experience is still suboptimal.
20
+
21
  The development of natural language interfaces to databases has long been a challenge as previous approaches rely on a considerable amount of human-labeled data for domain adaptation. Moreover, most interfaces provide a constrained environment and do not allow the users to freely and naturally interact with data.
22
+
23
+ In this work, we propose our framework for building domain-agnostic natural language (NL) interfaces to relational databases (NLIDBs) in few-shot and zero-shot scenarios. Also, recent advancements in the area of Transfer learning allowed us to leverage Transformer-based pre-trained language models (PLMs), resulting in various real-world applications in functional areas like CRM, Supply Chain, Ecommerce, Health Care, etc. for getting real-time insights. More specifically, our framework works in the following ways: First, it provides graph focused auto-suggestions to complete the natural language queries based on the graph representation of database schema, and Second, it uses an adaptive sequence-to-sequence translator model that translates natural language queries to corresponding SQL queries. Furthermore, a feedback loop is used to improve the system based on active learning.
24
+
25
+ Experiment results on benchmark datasets show that our approach achieves a state-of-the-art performance and can be effective in the few-shot and zero-shot scenarios for domain-agnostic applications.
26
 
27
  *Sroch, R. & Patnaik, D. & Ramachandran, J. (2022). [NatSight: A framework for building domain agnostic Natural Language Interface to Databases for next-gen Augmented Analytics](https://dcal.iimb.ac.in/baiconf2022/full_papers/2346.pdf).
28
  9th International Conference on Business Analytics and Intelligence, IIM Banglore (BAI Conf’22).*
 
49
 
50
  ### Evaluation results
51
 
52
+ | eval_bp | eval_em_accuracy | eval_ref_len | eval_runtime | eval_samples | eval_samples_per_second | eval_score | eval_steps_per_second | eval_sys_len |
53
+ |:-------:|:----------------:|:------------:|:------------:|:------------:|:-----------------------:|:----------:|:---------------------:|:------------:|
54
+ | 0.9907 | 83.3831 | 54260 | 421.0431 | 4821 | 11.45 | 95.2695 | 1.432 | 53756 |
55
 
56
 
57
  ### Framework versions
 
59
  - Transformers >=4.8.0
60
  - Pytorch >=1.6.0
61
  - TensorFlow >=2.5.0
 
62
  - Datasets >=1.10.2
63
  - Tokenizers >=0.11.6
64
 
 
75
  month={Dec},
76
  url = {https://dcal.iimb.ac.in/baiconf2022/full_papers/2346.pdf}
77
  }
78
+ ```