Before revision:  Additionally, with no overlapping between domain-specific subnetworks, PRUNE-TUNE is also capable of sequential multi-domain learning . Empirical experiment results show that PRUNE-TUNE outperforms several strong competitors in the target domain test set without  the quality degradation of the general domain in both single and multiple domain settings.
After revision:  Additionally, with no overlapping between domain-specific subnetworks, PRUNE-TUNE is also capable of sequential multi-domain learning . Empirical experiment results show that PRUNE-TUNE outperforms several strong competitors in the target domain test set without the quality degradation of the general domain in both single and multi-domain settings. The source code and data are available at URL