Deep learning has achieved a great success in natural image classification. To overcome data-scarcity in computational pathology, recent studies exploit transfer learning to reuse knowledge gained from natural images in pathology image analysis, aiming to build effective pathology image diagnosis models. Since transferability of knowledge heavily depends on the similarity of the original and target tasks, significant differences in image content and statistics between pathology images and natural images raise the questions: how much knowledge is transferable? Is the transferred information equally contributed by pre-trained layers? To answer these questions, this paper proposes a method to quantify knowledge gain by a particular layer, conducts an empirical investigation into pathology image centered transfer learning, and reports some interesting observations. Different from prior arts in transfer learning, we show that transferability of off-the-shelf representation heavily depends on specific pathology image sets, and may obtain classification performance close to random guess . The observation in this study encourages further investigation of specific metric and tools to quantify the feasibility of transfer learning in future.
Deep learning has achieved a great success in natural image classification. To overcome data-scarcity in computational pathology, recent studies exploit transfer learning to reuse knowledge gained from natural images in pathology image analysis, aiming to build effective pathology image diagnosis models. Since transferability of knowledge heavily depends on the similarity of the original and target tasks, significant differences in image content and statistics between pathology images and natural images raise the questions: how much knowledge is transferable? Is the transferred information equally contributed by pre-trained layers? To answer these questions, this paper proposes a framework to quantify knowledge gain by a particular layer, conducts an empirical investigation in pathology image centered transfer learning, and reports some interesting observations. Particularly, compared to the performance baseline obtained by random-weight model, though transferability of off-the-shelf representations from deep layers heavily depend on specific pathology image sets, the general representation generated by early layers does convey transferred knowledge in various image classification applications . The observation in this study encourages further investigation of specific metric and tools to quantify effectiveness and feasibility of transfer learning in future.
R
method
framework
R
into
in
R
Different from prior arts in transfer learning, we show that
Particularly, compared to the performance baseline obtained by random-weight model, though
R
representation heavily depends
representations from deep layers heavily depend
R
and may obtain classification performance close to random guess
the general representation generated by early layers does convey transferred knowledge in various image classification applications
R
the
effectiveness and