Assertion: knowledge distillation | /r/CapableOf | allow to transfer the knowledge
Facets:
Source sentences:
text: Knowledge distillation allows to transfer the knowledge learnt by a large model to a smaller one, that would not be able to easily learn it directly from the data itself, producing a new model that is faster to evaluate, and therefore deployable on less powerful hardware (such as a mobile device), while at the same time experiencing only a small loss of classification performance compared to the original, large model.