Before revision:  The kernel of fastHan is a joint many-task model based on a pruned BERT, which uses the first 8 layers in BERT.
After revision:  The backbone of fastHan is a joint many-task model based on a pruned BERT, which uses the first 8 layers in BERT.