Venue: ICLR 2020 Conference

Reviews:

final_score: rating: 6: Weak Accept
review_content: the paper studies transfer learning, which addresses the inconsistencies of the source and target domains in both input and output spaces. usually, we only worry about the inconsistencies in the input domain but here we worry about input and output. the paper proposes adversarial inductive transfer learning which uses adversarial domain adaptation for the input space and multi-task learning for the output space.

the main contribution of the paper is in identifying a new type of problem that may be worth studying. the proposal of the paper is sensible and its potential application to pharmacogenomics seems appealing. the paper shows promising performance of the proposal across datasets.
review_title: Official Blind Review #2

final_score: rating: 3: Weak Reject
review_content: The paper proposes an adversarial transfer learning network that can handle the adaptation of both the input space and the output space. The paper is motivated by the application of drug response prediction where the source domain is cell line data and the target domain is patient data. Patient data are usually scarce, hence motivating transferring the knowledge learned from the more widely available cell line data to improve the predictive performance based on the patient data.  The idea of making use of adversarial networks is to learn a representation of the data points that is invariant to whether the data points come from the source domain or the target domain. Experiments on real-world data over four drugs demonstrate the effectiveness of the proposed methods compared to other methods that are not specifically designed for this scenario.

The major utility of the proposed method demonstrated by the paper is its empirical effectiveness on real-world data with four drugs. The reviewer has the following concerns:

1. While the proposed method is capable of handling adaption of the output space between the source domain and the target domain, it makes use of a multi-task subnetwork component, which is a sensible modeling choice but it seems that the idea of leveraging a global discriminator and a class-wise discriminator has been exploited in previous works, as pointed out by the authors in Section 4.2. Therefore, the reviewer is concerned about the modeling contribution made in this paper is somewhat incremental given existing literature.

2. The multi-task subnetwork component itself also seems to be a straightforward and naive way to deal with the different tasks addressed in the source domain and the target domain. For one thing, only the data of the source domain are used to optimize the loss in the source domain and only the data of the target domain are used to optimize the loss in the target domain. While it is understandable that such a decision is due to the lack of ground truth of binary label in the source domain and numeric response in the target domain, ideally, the discriminative process might gain further benefits from borrowing information across the two domains.

3. It is also unclear from the paper how each component of the architecture contributes to the final performance. An ablation study that gets rid of the multi-task subnetwork, global discriminator, and class-wise discriminators (and potential combinations of these components) could help to provide better insights in the importance of each component and determine whether empirically these components do play a role coinciding with the description of the paper.

Other issues/questions:
1. Intuitively, what is the purpose of the shared layer g() in section 3.2.2?
2. In the spirit of the class-wise discriminators, will it be helpful to also add a discriminator based on the value of IC50?
3. Concepts and terminology are not well explained. e.g. what is a cell line? The authors should also provide further descriptions of what do the cell line and patient datasets look like early on in the paper. It was not until section 3 it is clear to the readers that in the dataseets consider in this paper, the source domain and the target domain have the same raw feature representation. Furthermore, in section 2, the authors could consider providing a taxonomy in table format to better explain different types of transfer learning and the three approaches to inductive transfer learning.  

review_title: Official Blind Review #1

final_score: rating: 3: Weak Reject
review_content: This paper proposes a novel Transfer Learning Method, namely Adversarial Inductive Transfer Learning (AITL), which adapts not only the input space but also the output space. The idea is interesting. 

However, the proposed method is not convincing from either theorical analysis or experimental results. No theorical analysis is given on the output space adaption, which is a nontrivial adaption between a discrete probability measure and a continuous probability measure. Furthermore, the method is verified on just one pharmacogenomics case. It is not convincing that the method can be used in another application.

review_title: Official Blind Review #3

Meta-review: The paper proposes an adversarial inductive transfer learning method that handles distribution changes in both input and output spaces.

While the studied problem is interesting, reviewers have major concerns about the incremental modeling contribution, the lack of comparative study to existing methods and ablation study to disentangling different modules. Overall, the current study is less convincing from either theoretical analysis or experimental results.

Hence I recommend rejection.
Decision: Reject