GitHub repository: nooblyh/Distilled-ALBERT
Primary language: Python
Description: Hidden-State-Aligned heterogeneous distillation of ALBERT using OpenWebText Corpus.