aimlnerd commited on
Commit
842e4a2
1 Parent(s): cea5aca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md CHANGED
@@ -1,3 +1,38 @@
1
  ---
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+
5
+ # Extract Legal Entities from Insurance Documents using BERT transfomers
6
+
7
+ This model is a fine tuned BERT transfomers for NER of legal entities in Life Insurance demand letters.
8
+
9
+ Dataset is publicly available here
10
+ https://github.com/aws-samples/aws-legal-entity-extraction.git
11
+
12
+ The model extracts the following entities:
13
+
14
+ * Law Firm
15
+ * Law Office Address
16
+ * Insurance Company
17
+ * Insurance Company Address
18
+ * Policy Holder Name
19
+ * Beneficiary Name
20
+ * Policy Number
21
+ * Payout
22
+ * Required Action
23
+ * Sender
24
+
25
+ ## HF Space
26
+ https://huggingface.co/spaces/aimlnerd/legal-entity-ner-transformers
27
+ This space expose the model as gradio app and contains, training dataset and code for training.
28
+
29
+ Dataset consists of legal requisition/demand letters for Life Insurance, however this approach can be used across any industry & document which may benefit from spatial data in NER training.
30
+
31
+ ## Data preprocessing
32
+ The OCRed data is present as JSON here ```data/raw_data/annotations```.
33
+ I wrote this code to convert the JSON data in format suitable for HF TokenClassification
34
+ ```source/services/ner/awscomprehend_2_ner_format.py```
35
+
36
+ ## Finetuning BERT Transformers model
37
+ ```source/services/ner/train/train.py```
38
+ This code fine tune the BERT model and uploads to huggingface