Before revision:  Additionally, with no overlapping between domain-specific subnetworks, PRUNE-TUNE is also capable of sequential multi-domain learning . Empirical experiment results show that PRUNE-TUNE outperforms several strong competitors in the target domain test set without  the quality degradation of the general domain in both single and multiple domain settings.
After revision:  Furthermore, Prune-Tune is able to sequentially learn a single network with multiple disjoint domain-specific subnetworks, PRUNE-TUNE is also capable of sequential multi-domain learning . Empirical experiment results show that PRUNE-TUNE outperforms several strong competitors in the target domain test set without the quality degradation of the general domain in both single and multiple domain settings.