Fixed a problem of implicit instantiation

keep an implicit instantiation into the specialization set
and remove it with its primary template