Hugging Face's logo

AISystems
/
PAK-LEGAL-BERT-small-uncased

Fill-Mask
Transformers
PyTorch
English
bert
pretraining
legal
Inference Endpoints
Model card Files Community
1
PAK-LEGAL-BERT-small-uncased / README.md
AISystems's picture
AISystems
Update README.md
38ae7de
preview code
|
raw history blame
No virus
505 Bytes
metadata
license: openrail
language:
  - en
library_name: transformers
tags:
  - legal
pipeline_tag: fill-mask

Model

This is a bert model that is trained on 10GB of Pakistan-Legal-Corpus on NSP and MLM tasks by AI SYSTEMS.

Model Details

This model was orignally taken from "legal-bert-small-uncased" (https://huggingface.co/nlpaueb/legal-bert-small-uncased) and was further pretrained using the original Bert paper for NSP amd MLM task.