Question Answering
Transformers
PyTorch
English
bert
How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("question-answering", model="nikotang/bert-large-cuad")
# Load model directly
from transformers import AutoTokenizer, AutoModelForQuestionAnswering

tokenizer = AutoTokenizer.from_pretrained("nikotang/bert-large-cuad")
model = AutoModelForQuestionAnswering.from_pretrained("nikotang/bert-large-cuad")
Quick Links

BERT-large fine-tuned on CUAD

This is a BERT-large model (bert-large-uncased-whole-word-masking) fine-tuned on the CUAD dataset from CUAD: An Expert-Annotated NLP Dataset for Legal Contract Review (Hendrycks et al., 2021), with the BertforQuestionAnswering model architecture.

The questions ask for information often found in contracts; the model would return the relevant text string and its starting index in the given document if the information exists. The CUAD dataset is in SQuAD 2.0 format.

For details of the dataset and usage of the relevant training/testing scripts, check out the paper and their Github repo.

Downloads last month
5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train nikotang/bert-large-cuad

Paper for nikotang/bert-large-cuad