GitHub repository: nooblyh/Distill-ALBERT
Primary language: Python
Description: Hidden-State-Aligned heterogeneous distillation of ALBERT using OpenWebText Corpus.