huawei-noah/pretrained-language-model: Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.
Category: nlp
Language: Python
Topics: knowledge-distillation, large-scale-distributed, model-compression, pretrained-models, quantization