Update README.md

README.md

@@ -9,17 +9,14 @@ metrics:
 - recall
 ---
 
-# Legal document section extraction: motivation
+# Legal document section extraction
 
-Legal documents are often dense and filled with information that is
+I'm interested in using encoder-based extraction of named legal document sections. The problem is challenging because often documents are published in different formats (PDF, HTML, etc.), and are not structured exactly the same across instances (same section, diff name, for example).
 
-## Thoughts around each approach, pros and cons
-
-I wanted to create a section classifier for legal documents. I found a pretty up-to-date paper called Structural Segmentation of Legal Documents (https://arxiv.org/pdf/2012.03619). This paper talks about segmentation of legal documents when specific sections _are not known_, and proposes a siamese architecture of ROBERTA for pairwise classification of either "same topic" or "not same topic". With this approach, I would still need to determine the classification of each section.
-
-In comparison, I was interested in the extraction of _known_ sections, therefore I may not need to perform any pairwise operations. I realized I could just use a plain old ROBERTA model with binary classifier after, but I think the downside here is that I'd have to come up with some heuristic to compensate for noise.
-
-A key hypothesis is: Since some sections may have "neutral" sentences, they won't be classified properly, but in the siamese architecture, they would not trigger a change of section classification. This would work in favor of the siamese architecture, except for when a neutral sentence falls at a section boundary.
+## Thoughts around two approachs, pros and cons
+- I wanted to create a section classifier for legal documents. I found a pretty up-to-date paper called Structural Segmentation of Legal Documents (https://arxiv.org/pdf/2012.03619). This paper talks about segmentation of legal documents when specific sections _are not known_, and proposes a siamese architecture of ROBERTA for pairwise classification of either "same topic" or "not same topic". With this approach, I would still need to determine the classification of each section.
+- In comparison, I was interested in the extraction of _known_ sections, therefore I may not need to perform any pairwise operations. I realized I could just use a plain old ROBERTA model with binary classifier after, but I think the downside here is that I'd have to come up with some heuristic to compensate for noise.
+- A key hypothesis is: Since some sections may have "neutral" sentences, they won't be classified properly, but in the siamese architecture, they would not trigger a change of section classification. This would work in favor of the siamese architecture, except for when a neutral sentence falls at a section boundary.
 
 ## About Siamese architecutre ROBERTa for clustering
 - The Siamese architecture uses two identical ROBERTA models, performs a pooling operation over corresponding indices for each output token embedding, cats the two outputs, then runs binary classification on this single vector.
@@ -30,8 +27,7 @@ A key hypothesis is: Since some sections may have "neutral" sentences, they won'
 - ROBERTa base output shape (batch size, seq length, hidden size)
 - ROBERTa base hidden size = 768
 - ROBERTa base max input seq length = 512
-
-- Using ROBERTA for segmentation involves combining sentences A and B into single input to ROBERTA:
+- ** Using ROBERTA for segmentation involves combining sentences A and B into single input to ROBERTA. See below:
 
 [cls] A [sep] B
 
@@ -50,3 +46,5 @@ x = torch.tanh(x)
 x = self.dropout(x)
 x = self.out_proj(x)
 ```
+
+## Results