Before revision:  Many works have studied model compression on large NLP models, but only focus on reducing inference cost/time , while still requiring  expensive training process.
After revision:  Many works have studied model compression on large NLP models, but only focus on reducing inference time while still requiring expensive training process.