Title: PROBABILISTIC NEURAL-SYMBOLIC MODELS FOR INTERPRETABLE VISUAL QUESTION ANSWERING

Abstract: We propose a new class of probabilistic neural-symbolic models for visual question answering (VQA) that provide interpretable explanations of their decision making in the form of programs, given a small annotated set of human programs. The key idea of our approach is to learn a rich latent space which effectively propagates program annotations from known questions to novel questions. We do this by formalizing prior work on VQA, called module networks (Andreas, 2016) as discrete, structured, latent variable models on the joint distribution over questions and answers given images, and devise a procedure to train the model effectively. Our results on a dataset of compositional questions about SHAPES (Andreas, 2016) show that our model generates more interpretable programs and obtains better accuracy on VQA in the low-data regime than prior work.

1. INTRODUCTION:

Exciting progress has been made in recent years in deep representation learning (Hochreiter & Schmidhuber, 1997; LeCun et al., 1998) , which has led to advances in artificial intelligence tasks such as image recognition (Krizhevsky et al., 2012; He et al., 2015) , machine translation (Sutskever et al., 2014) , visual question answering (Agrawal et al., 2015) , visual dialog (Das et al., 2016) , and reinforcement learning (Mnih et al., 2015) , etc. While deep neural networks achieve such impressive performances, many aspects of human cognition such as compositional generalization and reasoning are harder to model with state-of-the art deep learning approaches (Battaglia et al., 2018; Barrett et al., 2018) .

Symbolic approaches (Newell & Simon, 1976) on the other hand provide strong compositional and reasoning capabilities which are challenging to model with neural networks (Lake et al., 2017) . Consequently, a rich line of work in neuro-symbolic processing sought to build AI systems with both strong learning and reasoning capabilities (Valiant, 2003; Evans et al., 2018b; Bader & Hitzler, 2005) .

As we tackle higher-level tasks which involve reasoning, such as visual question answering (Agrawal et al., 2015) , planning (Andreas et al., 2016b; Gregor et al., 2016) etc., it is natural to desire the ability to provide instructions to models to guide them. Symbolic instructions, by their very nature are easier to specify and more interpretable than specifying the parameters of a neural network. For such high-level tasks, a sensible approach is to specify "what" to do using symbols and learn how to do the task using modern representation learning techniques.

For the example shown in Figure 1 , given a question "Is a square to the left of a green shape?", one can ask the model to reason about the answer by first applying a find[green] operator, then find [left] , then And the result together with a find [square] operator in order to predict the answer, in other words specifying "what" are the computations we desire to be executed, in the form of a "program". (Johnson et al., 2017; Hu et al., 2017; Andreas et al., 2016a) . The network can then learn "how" to execute such a program from data using deep representation learning (Johnson et al., 2017; Hu et al., 2017; Andreas et al., 2016a) . This paper addresses a very natural desiderata for such neuro-symbolic models, in the context of visual question answering -can we retain the intepretability of "what the network did" expressed in terms of the syntax and lexicon that we are interested in, while specifying minimal teaching examples of "what to do" given an input question? We propose to approach this problem with a treatment of programs z as a latent variable, embedded into a generative model of questions x and answers a given images i as visualized in Figure 2 . This model class has certain desirable properties: first, a proper treatment of z as a stochastic latent variable is helpful especially in the presence of a limited number of expert human instructions, as we model the uncertainty associated with z explicitly, leading to more interepretable latent spaces (Section 5); second, the model makes intuitive independence assumptions with regards to the question answering task -conditioned on the program z, questions x are independent of the answers a for an image, meaning that the program must be a sufficient statistic for predicting the answer given a question1 . Third, we parameterize the p(a|i, z) term, which predicts an answer given an image and a program using a popular, related class of question answering models called neural module networks (NMNs) (Hu et al., 2017; Johnson et al., 2017; Andreas et al., 2016a) which previous work has shown leads to better fit between the program (or "what the model is doing") and the execution (or "how it is doing what it is doing"). Given the close ties of our model to NMNs, we will refer to our model as variational neural module networks (V-NMN) for the rest of the paper.

Apart from our modeling contribution of a probabilistic latent variable, neuro-symbolic model, our key technical contribution is to show how to train this model in the context of visual question answering.

Optimizing such generative models with structured discrete latent variables is an intractable problem to solve in genereal -for this particular case, we formulate training into stages of grounding questions into programs (question coding), learning how to execute them and then with those initializations train the full variational objective. We demonstrate that this stage-wise optimization allows us to successfully learn a probabilistic neural-symbolic model that can answer compositional questions about shapes in an image (Andreas et al., 2016a) .

While the V-NMN model is instantiated for the specific problem of visual question answering, we believe the tools and techniques we develop are more generally applicable to probabilistic, structured, discrete, interpretable latent spaces for interpretable neuro-symbolic models for planning, instruction following, grounding referring expressions etc.

We benchmark our model on the SHAPES (Andreas et al., 2016a) dataset with compositionally novel questions and show that our model is able to provide interpretable explanations of "what it is doing" (measured by program correctness) for unseen questions even in the setting where it is given as few as ≈ 20 paired examples of programs and corresponding questions from the dataset, while also getting to high question answering accuracy. We find that the proposed approach outperforms a state of the art neural-symbolic model designed for VQA from Johnson et al. (2017) , as well as deterministic ablations of our model.

2. A PROBABILISTIC NEURAL-SYMBOLIC MODEL FOR VQA:

For a standard neural-symbolic NMN approach to question answering (Johnson et al., 2017) , we are given an input image i and a question x = (x 1 , • • • , x N ) as a sequence of words x i each encoded using a vocabulary V x , and must produce answers a by planning and executing a series of modular computations

(z = (z 1 , • • • , z N )) -i.

e. a program of operations (z i ∈ V z ) to be executed in order to answer the question. Note that z here is the prefix serialization of the program and programs themselves often have tree-structured topologies. We denote the dataset of (i, x, a) triplets as D.

Additionally, we are provided programs z for some input questions (x ∈ S), which specify the notion of grounding desired by an end user. Our goal is to provide faithful explanations on unseen questions (along with correct answers) consistent with the specified grounding.

We accomplish this by modeling z as a latent variable that underlies both question and answer generation given an input image. Intuitively, we expect this will enable us to learn a more meaningful latent representation for questions, as modeling uncertainity should help better handle the potentially underspecified mapping between questions and programs provided by the user. As such, our model factorizes p(x, z, a|i) = p(x|z)p(a|i, z)p(z) as in the graphical model shown in Figure 2 , where the prior p(z) is learnt by training a neural sequence model on valid strings simulated from known syntax. Conceptually, this factorization captures the notion that many differently-worded questions are reducible to identical underlying semantics (captured by a program), making the program space, in a sense, a compression of the question space. As mentioned in Section 1 the model also captures the independence of questions from answers for an image given programs, which is also an intuitive desiderata for interpretable neural-symbolic models2 .

Given the proposed model shown in Figure 2 , we must address two tasks to put the model to use for VQA -learning model parameters, and performing inference for a specific query.

Learning. We will always condition on images i but may not observe underlying programs z, so our per-data point training objective is the log-marginal-conditional-likelihood: log p(x, a | i). Since computing this objective involves an intractable summation over latent programs (log z p(x j , z, a j | i j )), we use a variational approximation (Jordan et al., 1999) . Specifically, let q φ (z | x) denote an amortized inference neural network parameterized by φ,which instantiates a sequence to sequence LSTM (Hochreiter & Schmidhuber, 1997 ) model p θz (a | z, i) be a NMN parametrized by θ z run on image i with program z, -p θ (x | z) be a recurrent network (sequence to sequence model) parametrized by θ that maps programs to questions, and p(z) be a prior over programs learned from data or based on program syntax directly , parameterized as an LSTM (Hochreiter & Schmidhuber, 1997) sequence model Then, for datapoints without program supervision, the objective is:

elbo(a, x|i) = E z∼q φ (z|x) [log p θz (a|z, i) + log p θ (x|z)] -βKL(q φ (z|x), p(z))

It is easy to show that elbo(x, a|i) ≤ log p(x, a|i) for β ≥ 1; as such, maximizing this objective is a form of approximate maximum likelihood training for distribution parameters θ z , θ, and φ.

Additionally, for data points with annotations, we add the likelihood of the program given the question log r φ (z|x) to the objective. Note that r shares parameters φ with the inference network q. So our overall objective becomes:

EQUATION

where the indicator function [[x ∈ S]] is 1 if x is in the supervised set and 0 otherwise and α is a positive scaling factor. The goal is to learn the desired association of questions with programs from the second term, and to propagate them to other questions using the first term.

Inference. At test time, we can answer questions for images by computing p(a|i, x) = z p(a|i, z)p(z|x) using an approximation p q (a|i, x) ≈ E zi∼q(z|x) p(a|i, z i ). Challenges. While the elbo term in Equation ( 1) appears similar to a standard ELBO for joint latent variable models (Vedantam et al., 2018; Wang et al., 2016b; Suzuki et al., 2017) , there are a few important departures: -Firstly, the latent variable z is not a Gaussian or categorical random variable (which admit straightforward reparameterizations (Maddison et al., 2017; Jang et al., 2016) ) but rather a sequence of discrete tokens, which complicates the optimization problem in Equation ( 1). -Secondly, the conditional log-likelihood for a is parameterized by a NMN that is dynamically assembled based on sample programs drawn from q(z|x). Depending upon the uncertainty of the program posterior, program tokens may not be consistently grounded across examples, making learning the appropriate computation for the corresponding neural modules difficult. -Lastly, our observations x are explained by powerful "autoregressive" sequence models. Learning meaningful latent variable models that are informative of observations for such models is difficult (c.f. (Bowman et al., 2016; Chen et al., 2016; Alemi et al., 2018) ) as powerful decoder models can explain the data using stochasticity from sampling (referred to as autodecoding in Alemi et al. ( 2018)). Consequently, it also becomes hard to learn meaningful NMN parameters from the previous step.

In the following sections, we present a training regime and adjustments to the objective in Equation ( 1) that make optimization more tractable and enable training NMNs with significantly reduced questionaligned program supervision. While instantiated for question answering, it is not difficult to conceive versions of this regime for other problems relevant to probabilistic neural-symbolic models.

2.1. OPTIMIZING THE ELBO FOR V-NMN:

Rather than approaching the joint objective directly, we break ELBO training into three stages: 1. Question coding, where we learn a latent 'code' for questions in the latent space of programs, 2. Module training, where we learn the 'execution' of the programs from the first stage of training, grounding tokens in programs into the operations they perform on images; and 3. Joint training, where we train both stages jointly given the 'warm-starts' from the other phases. Question Coding. The goal of this stage is to learn a code for questions in the latent space of programs -i.e. an informative mapping from questions to programs. Given some set of question-aligned programs, we find this coding process effectively propagates these supervised groundings to unsupervised questions, which enable interpretable explanations / groundings of queries to explanations of "what" the model is doing, which is our primary goal.

During question coding, we drop the p θz (a|z, i) term from Eq. 1, yielding the objective

J(x; φ, θ) = E z∼q φ (z|x) [log p θ (x|z)] -βKL(q φ (z|x), p(z)) + α log r φ (z|x) • [[x ∈ S]]

(2) Recent theory from Alemi et al. ( 2018) prescribes changes to the ELBO, setting β < 1 as a recipe to learn representations which avoid learning degenerate latent representations in the presence of powerful decoders. Essentially, Alemi et al. ( 2018) identify that upto a constant factor, the negative log-marignal likelihood term D=-E z∼q φ (z|x) [log p θ (x|z)], and the kl diveregence term R = KL(q φ (z|x), p(z)) bound the mutual information between the data x and the latent variable z as follows:

H -D ≤ I(x, z) ≤ R (3)

where H is the entropy of the data, which is a constant. One can immediately notice that the standard elbo = -D -R. This means that for the same value of the elbo one can get different models which make drastically different usage of the latent variable (based on the achieved values of D and R). Thus, one way to achieve a desired behavior (of say high mutual information I(x, z)), is to set β to a lower value than the standard elbo (c.f. Eqn. 6 in Alemi et al. (2018) .) This aligns with our goal in question coding, and so we use β < 1. As this no longer a valid variational lower bound, denote our objective as J(x; φ, θ) from now on. We optimize the above objective using the score function estimator (Glynn, 1990) , also referred to as REINFORCE (Williams, 1992) applied to the first term, with a moving average baseline.Finally, while the KL term (in the reward) encourages the model to generate high-likelihood plausible sequences, we also penalize the model for producing syntactically invalid programs.

Although gradients for the KL term in Equation ( 2) can be computed by decomposing the KL for the sequence into per-timestep monte-carlo gradients, we found that having one term with per-timestep gradients and another that only receives sequence-level rewards (the likelihood term) skewed the model towards minimizing the KL, leading to auto-decoding solutions. Thus, we apply REINFORCE on the entire sequence and compute rewards using the full monte carlo gradient,i.e., we do not optimize the KL term separately, but instead maximize:

EQUATION

where x, ẑ are the questions and programs we observe in the dataset.

For comparison, the semi-supervised approach in Johnson et al. ( 2017) can be seen as optimizing the last term on supervised training data, while our question coding stage optimizes the elbo in addition to the last term. Our results in Section 5 show that the proposed question coding formulation significantly improves performance relative to Johnson et al. (2017) in terms of explaining "what" the model is doing on test programs.

Module Training. Having obtained a code for questions in the latent space, we train the parameters of the NMN for question answering. The network modules are trained to perform their corresponding tasks. For example, if the question coding learned to associate the program token v with the question phrase 'to the left', then the goal for this second stage is to train the module corresponding to v to actually perform this operation (e.g. transform[left]) when executed on images.

We do this by optimizing the joint elbo(x, a|i) in ( 1) with respect to the parameters θ z of the neural modules. We write this objective for each instance as

EQUATION

Notably, while we write this objective as a function of all neural modular network parameters θ z , for a given instance, only those modules present in the program z ∼ q(z|x) are updated. In practice, we take approx. argmax decoded programs from q φ (z|x) to simplify training, but perform sampling during joint training in the next stage. To be more specific, we run beam search (Vijayakumar et al., 2018) with a beam size of 1 to do this. Intuitively, we think of this as a bias vs. variance tradeoff, doing argmax enables us to trade off bias for high-variance from a posterior which (in the pathological case) could match the prior from the first stage of training. This is also consistent with standard practice for doing inference in sequence models, where beam search is the standard inference tool (and sampling often has issues due to teacher forcing based MLE training, which is how we do semi-supervised learning) (Bengio et al., 2015) .

Joint Training. Having trained the question code and the neural module network parameters, we tune all terms jointly, with the following objective, which adds scaling factors α, β and γ, and an extra semi-supervised learning term relative to Equation (1):

J(x, a|i) = E z∼q φ (z|x) [γ log p θz (a|z, i) + log p θ (x|z)] -βKL(q φ (z|x), p(z)) + α log r φ (z|x) (6)

The gamma factor γ controls the scaling of the likelihood term for the answers relative to the question (which has more bits of information), similar scaling factors have been for joint models in Vedantam et al. (2018) . Similar to Equation (4), we optimize the full monte carlo gradient for the above objective as well. The full training procedure is shown in Algorithm 1 below.

3. RELATED WORK:

We first explain other related work in neuro-symbolic models, the key differences between our formulation and closely related NMN work (Johnson et al., 2017; Hu et al., 2017; 2018) , and then connect our work to other themes and directions of research in literature.

Neural-symbolic models Valiant (2003) identifies neuro-symbolic models, which are able to reason as well as learn efficiently as one of the key problems in computer science. A rich literature of work exists in this area, around two major threads: firstly, there is a line of work in building hybrid models Algorithm 1 V-NMN Training 1: Given: p(z), Initialize q φ (z|x), p θz (a|z, i), p θ (x|z), moving average baseline B = 0, β = 0.1, α = 100.0, δ = 0.99. 2: Question Coding: Given x, ẑ ∼ p data (x, z), sample z i ∼ q φ (z|x) [Repeat until convergence]

3: ∇ φ ← (R -B) log q φ (zi|x) + α∇ φ log r φ (ẑ|x); where R = log p θ (x|z i )p(z i ) β q φ (z i |x) β 4: ∇ θ ← ∇ θ log p θ (x|zi) 5: B ← B + (1 -δ)(R -B); ∇ θ ← ∇ θ log p(x|zi) 6: Question Coding: Given x, ẑ ∼ p data (x, z), sample z i ∼ q φ (z|x) [Repeat until convergence] 7: Module Training: Given x, â, î ∼ p data (x, a, i), zi = argmax q(z|x) [Repeat until convergence] 8: ∇ θz ← ∇ θz log p(â|zi, î) 9: Joint Training: Given x, â, î, ẑ ∼ p data (x, a, i, z), zi ∼ q(z|x), γ; Initialize B = 0, [Repeat until convergence] 10: ∇ φ ← (R -B)∇ φ log q φ (zi|x) + α∇ φ log r φ (ẑ|x); where R = log p θ (x|z i )p(â|z i , î) γ p(z i ) β q φ (z i |x) β 11: B ← B + (1 -δ)(R -B); ∇ θ ← ∇ θ log p(x|zi); ∇ θz ← ∇ θz log p(â|zi, î)

which are hybrids of symbolic reasoning and neural networks (Bader & Hitzler, 2005 ; Hölldobler & Kalinke), the second thread looks at studying if neural networks can indeed do symbolic reasoning and building models and architectures to achieve this for specific cases (Evans et al., 2018a; Rocktäschel et al., 2015) . Our work is distinct in terms of being motivated by interpretability in the low-sample regime rather than getting connectionist/neural networks to explicitly do symbolic manipulations or building hybrid models that do logic. 2018) also shares the same goal of doing question answering with limited question program supervision while preserving the semantics of human programs. While they to approach this problem by simplifying the p(a|i, z) mapping (in context of our model) by first converting the image into a table, we approach this goal by modeling a stochastic latent space. Thus the two approaches are orthogonal, as one can use our probabilistic latent space in conjunction with their model as well to better share statistics between question-program pairs. Overall, compared to these works, our work addresses probabilistic neural-symbolic learning in a more general setting, by learning how to execute programs (on raw-pixels), as well as handling parsing of questions in an end to end manner.

Connection to prior work on NMNs. Our V-NMN model is inspired in its parameterization of program to answer mapping from prior work on visual question answering using neural module networks such as Johnson et al. (2017) ; Hu et al. (2017; 2018) . Distinct from these previous approaches, our explicit goal is to preserve the semantics of how a human specifies a task to be broken down in terms of instructions, while previous work was motivated by building inductive biases for reasoning (which turn out to be useful for our model as well). Given this goal, we construct a latent variable model that in some sense embeds previous work. The works from Hu et al. (2017; 2018) are more distant from our work, as they use continuous attention modules, which do not capture independence assumptions of the program being a sufficient statistic for answering the question (which makes them harder to specify completely for a human, as they would have to hallucinate attention parameters). However, apart from our focus on preserving the lexicon/specification given by a human, both approaches share the same high level goals of providing interpretable question answering with minimal supervision.

Beyond Gaussian Latents in Amortized Variational Inference. There has been exciting progress in developing lower-variance estimators for discrete generative models (Tucker et al., 2017; Mnih & Gregor, 2014; Titsias & Lázaro-Gredilla, 2015; Gu & Ling, 2015) . In particular, Maddison et al. ( 2017); Jang et al. (2017) propose the use of the concrete distribution on the probability simplex for providing biased but low variance estimators for discrete latent variable models by considering a reparametrization of samples (which asymptotically approach those from a categorical distribution). The contribution in our work is orthogonal to these approaches, how one can apply such parameterizations to neuro-symbolic models. More relevant to our work is Miao & Blunsom (2016) which proposes a discrete sequential latent variable model for sentence summarization, with summaries as the latent variable. In contrast to their model, ours is a joint model where the latent space consists of programs, not summaries, which have to explain questions and answers to images.

Joint Variational Autoencoder Models. Vedantam et al. (2018) propose a joint model for images and attributes for "visual imagination", Suzuki et al. (2017) propose a closely related model and show that one can use the model for conditional generation, while Wang et al. (2016a) propose a deep variational canonical correlation analysis model which learns a joint space between two modalities for denoising and representation learning. In contrast to these approaches, our joint model assumes a discrete structured latent variable (instead of a Gaussian), does semi-supervised training, which is possible for us, but not possible when there are no observations from the latent available for supervision, and is targeted towards neural module networks and question answering.

Program Induction and Neural Architecture Search. In program induction one is typically interested in learning to write programs given specifications of input-output pairs (Reed & de Freitas, 2015; Kalyan et al., 2018) , and optionally language (Neelakantan et al., 2015; Guu et al., 2017) or vision (Gaunt et al., 2017) . The key difference between program induction and our problem is that program induction assumes the tokens/instructions in the language are grounded to the executor, i.e., it is assumed that once a valid program is generated there is a black-box execution engine that can execute it, while we learn the execution engine from scratch, and learn the grounding from program symbols to parameters of a neural network for execution. Neural architecture search (Zoph & Le, 2016) is another closely related problem where one is given input output examples for a machine learning task, and the goal is to find a "neural program" that does well on the task. In contrast, ours can be seen as the problem of inducing programs conditioned on particular inputs (questions), where the number of samples seen per question is significantly lower than the number of samples one would observe for a machine learning task of interest.

4. EXPERIMENTS:

Dataset. We perform our experiments on the SHAPES dataset (Andreas et al., 2016a) . This dataset has been used in previous works (Andreas et al., 2016a; Hu et al., 2017) on visual question answering using neural module networks, and is intended to be a test for compositional generalization.

The dataset has 244 unique binary questions (i.e. having yes/no answers) and 15,616 images in total (Andreas et al., 2016a) . The dataset also has annotated programs for each of the questions. We use train, val, and test splits of 13,568, 1,024, and 1,024 (x, z, i, a) triplets respectively. No questions are repeated across these splits. Further, each question is asked for 64 different images, ensuring that a question can be answered correctly across all these instances only if it is processing the image in a reasonable way (as dictated by the underlying program), as opposed to leveraging any image-question correlations or biases that are unlikely to generalize across images.

Thus, the dataset explicitly tests for compositional generalization and "reasoning" in the task of visual question answering. The longest questions in the dataset are of length 11 and shortest are of length 4, while the longest programs are of length 6 and shortest programs are of length 4. The size of the question vocabulary V x is 14 and the program vocabulary V z is 12.

Training. To simulate a data-sparse regime, we restrict the set of question-aligned programs to 5, 10, 15, or 20% of unique questions -such that even at the highest level of supervision, programs for 80% of unique question have never been seen during training. Unless specified explicitly, we train our program prior using a set of 1848 unique programs simulated from the syntax (more details of this can be seen in the appendix). In general, it might not be possible to exhaustively enumerate the space of all valid strings to learn the prior. Thus, we also evaluate the effect of training the prior with varying-sized subsets of the 212 programs present in the training set (without using any corresponding questions or answers) to check how robust overall performance is to the choice of the prior (in the appendix).

We find sequence-level policy-gradient based training in this setting can be highly variable -with some runs failing spectacularly while others succeed -for both our method and to some extent NMN (Johnson et al., 2017) . For fairness and to reduce the impact of stochasticity, we perform the following stage-wise training regime for all models. First, the question-coding stage is run for 5 different random seeds, producing multiple program predictors. Programs taken from the model that performs the best on the validation set are used to train 10 runs of the module training stage. Finally, the best of these module networks (based on val) is trained jointly with the program predictor under settings of γ ∈ {1, 10, 100} and the max (on val) is chosen. We report mean and variance accuracies on test from this training regime over four random sets of supervisory programs. Implementation Details: Following Johnson et al. (2017) and Hu et al. (2017) , we treat the program z = {z 1 , • • • , z K } as a variable length sequence of tokens with an end of sequence token, which corresponds to the prefix traversal of an execution tree. Given this representational choice, we learn the prior p(z) using maximum likelihood training on simulated samples from known syntax of programs. An alternative, interesting approach to try would be to use something like Janz et al. (2017) , who acquire a generative model more directly from validity annotations. The log p(a|z, i) term in Equation ( 1) is parameterized by an NMN that is dynamically assembled given the program string, while the generative model p(x|z), and inference (q(z|x)) terms are both sequence to sequence models. Our sequence to sequence models are based on LSTM (Hochreiter & Schmidhuber, 1997) cells. For the NMN programs, we use syntax similar to that used by Hu et al. (2017) , but we replace their question-attention neural modules with "regular" modules. For clear comparison we adapt the objectives from the baseline approach, Johnson et al. (2017) , to our representational choices. More details can be found in appendix.

5. RESULTS:

We focus on evaluating approaches by varying the fraction of question-aligned programs (which we denote %x ↔ z) in Table 1 . To put the numbers in context, a baseline LSTM + image model, which does not use module networks, gets an accuracy of 63.0% on Test (see Andreas et al. (2016a) ; Table . 2). This indicates that SHAPES has highly compositional questions which is challenging to model via conventional methods for Visual Question Answering (Agrawal et al., 2015) . Overall, we make the following observations:

-Our V-NMN approach consistently improves performance in data-sparse regimes. While both methods tend to improve with greater program supervision, V-NMN quickly outpaces NMN (Johnson et al., 2017) , achieving test accuracies over 20-35% points higher for >5% program supervision. Notably, both methods perform similarly poorly on the test set given only 5% program supervision, suggesting this may be too few examples to learn compositional reasoning. -Our question coding stage greatly improves initial program prediction. Our V-NMN approach to question coding gets to approximately double the question coding (reconstruction) accuracy as the NMN approach (col 1, question coding). This means that it effectively propagates groundings from question-aligned programs during the coding phase. Consequently, we also see improved VQA performance after the module and joint training stages which are based on predicted programs. -Question reconstruction is well-correlated with overall accuracy. Despite the program space being trained directly as a latent code for questions, we find question reconstruction accuracy rises with the amount of supervision -confirming that inference in a space of discrete structured latent variables is difficult to do without some supervision to guide the mapping. Figure 3 shows sample programs for each model. We see the limited supervision negatively affects NMN program prediction, with the 5% model resorting to simple Find[X]→Answer structures. Interestingly, we find that the mistakes made by the V-NMN model, e.g., green in 5% supervision (top-right) are also made when reconstructing the question (also substituting green for blue). Further, when the token does get corrected to blue, the question also eventually gets reconstructed (partially correctly (10%) and then fully (15%)), and the program produces the correct answer. This indicates that there is high fidelity between the learnt question space, the answer space and the latent space.

Effect of the Program Prior p(z). Next, we explore the impact of regularizing the program posterior to be close to the prior p(z), for different choices of the prior. Firstly, we disable the KL-divergence term by setting β = 0 in Equation ( 2 5). In this section we empirically study this design choice.

We generally find that in low-supervision settings, where the question coding stage might not produce correct programs (for questions) as frequently, using sampling form the sequence model q(z|x) instead of beam search leads to a drop in module training performance. For example, with 10% supervision, the module training accuracy drops from 81.34 ± 8.61 (with beam search) to 76.31 ± 8.41 (with sampling). With more supervision the choice of beam search or sampling does not matter, which makes intuitive sense, as the this means that the programs that get sampled tend to be the correct ones more often (that is, the confidence of the model increases with the improvement in correctness).

Effect of optimizing the true ELBO, β = 1. Next, we empirically validate the claim that approximate inference learned using the ELBO leads to autodecoding behavior as predicted by Alemi et al. (2018) , and that better program representations for our problem can be found for β < 1 (as shown above). At 15% program supervision, VQA accuracy drops from 96.90% (±0.96) at β = 0.1 to 78.49% (± 1.37) at β = 1 (for the empirical prior). Question reconstruction drops from 97.43 % (±3.42) at β = 0.1, to 43.40 % (±5.34) at β = 1, showing auto-decoding behavior (as predicted by theory).

Finally, the N2NMN approach (Hu et al., 2017) evaluates their question-attention based module networks in the fully unsupervised setting, getting to 96.19% on TEST. However, the programs in this case become non-compositional (see Section 3), as the model leaks information from questions to answers via attention, meaning that programs no longer carry the burden of explaining the observed answers. This makes the modules less interpretable; which is one of the core motivations of this neural-symbolic class of module networks in the first place.

6. DISCUSSION AND CONCLUSION:

In this paper we presented a novel, probabilistic neural symbolic model for interpretable visual question answering, that provides explanations of "what" the model is doing on unseen questions given a minimal number of annotated symbolic traces or programs of "what it should do". We demonstrate that our formulation provides more interpretable explanations than previous work on visual question answering called neural module networks, on dataset of compositional questions about shapes (Andreas et al., 2016a) .

The key to our approach is a model with programs as a stochastic latent variable, which leads to better sharing of statistics across questions, yielding a latent space where program annotations for known questions propagate effectively to unknown / novel questions without annotations.

In general, the model family we study is quite rich, and also supports other inference queries such as counter factual explanations of what programs could have led to particular answers for a given image. Predicted programs and answers of different models (NMN in white, V-NMN in gray) and resconstructed question (V-NMN) for variable amount of supervision. We find that V-NMN finds the right answer as well as the program more often than NMN (Johnson et al., 2017) .

We hope our work inspires more work on applying such ideas to other tasks requiring compositional reasoning such as planning, navigation etc.

:

Note that this model assumes independence of programs from images, which corresponds to the weak sampling assumptions in concept learning(Tenenbaum, 1999), one can handle question premise, ie. that people might ask a specific set of questions for an image in such a model by reparameterizing the answer variable to include a relevance label.

This view also matches finding fromHu et al. (2017) who find models linking questions to answer (via attention) operating in low-program supervision regimes often have syntactically poor programs despite leading to correct answers -i.e. the program need not be a sufficient statistic anymore to answer the question.

Figures and Tables:

Figure 1: An illustration of neural module networks for visual question answering. Given a question, the program generator produces a program in prefix notation which is used to construct a neural network from the specified module networks. This network operates on the image and intermediate attention maps to answer the question.

Figure 2: An illustration of the graphical model used for neural module networks (NMNs).

Our evaluation metrics are as follows: a) question-coding uses reconstruction accuracy (of getting the entire question right) and program prediction accuracy (of matching the ground truth programs) on the training set, since the second stage, module training will use inferences from the first stage (on the training set to train modules), b) module training and joint training: visual question answering accuracy, by counting matches to ground truth answers.

Figure 3: Qualitative results: Image with the corresponding question, ground truth program, and ground truth answer (top left).Predicted programs and answers of different models (NMN in white, V-NMN in gray) and resconstructed question (V-NMN) for variable amount of supervision. We find that V-NMN finds the right answer as well as the program more often than NMN(Johnson et al., 2017).

) recovering a deterministic version of our model. Compared to our full model at 10% supervision, the performance on question coding drops to 12.7% program Results in %, on the SHAPES dataset with varying amounts of question-program supervision (%x ↔ z), β = 0.1. prediction accuracy (from 65.45%), while the performance on question reconstruction improves from 87.52% to 93.8%. Without the KL term, the model focuses solely on reconstruction and fails to learn compositionality in the latent z space, such that supervised grounding are poorly propagated to unsupervised questions as evidenced by the drop in program prediction accuracy. that this ties well to our high-level goal to better leverage the semantics of the lexicon provided by the user for interpretable question answering.Beam search vs. sampling for module training. As explained in Section 2, we use beam search instead of sampling to optimize Equation (

Table content: <table><tr><td/><td>%x ↔ z</td><td colspan="4">Validation During Training Stages [I] Question Coding [II] Module Training [III] Joint Training</td><td>Test Accuracy</td></tr><tr><td/><td/><td colspan="2">(Reconstruction) (Program Prediction)</td><td>(VQA Accuracy)</td><td>(VQA Accuracy)</td><td>(VQA Accuracy)</td></tr><tr><td>NMN (Johnson et al., 2017) V-NMN(Ours)</td><td>5</td><td>-54.86±6.75</td><td>9.28±1.91 17.90±3.48</td><td>61.56±3.59 63.21±3.12</td><td>63.08±0.78 66.61±1.58</td><td>60.06±3.88 61.40±4.41</td></tr><tr><td>NMN (Johnson et al., 2017) V-NMN(Ours)</td><td>10</td><td>-87.52±6.45</td><td>24.30±2.39 65.45±11.88</td><td>60.31±3.37 81.34±8.61</td><td>66.51±4.10 92.85±4.89</td><td>61.99±0.96 88.01±6.45</td></tr><tr><td>NMN (Johnson et al., 2017) V-NMN(Ours)</td><td>15</td><td>-99.66±0.19</td><td>47.67±5.02 86.23±3.29</td><td>69.47±9.87 93.24±3.17</td><td>62.43±0.49 97.97±1.20</td><td>61.32±2.36 94.63±2.65</td></tr><tr><td>NMN (Johnson et al., 2017) V-NMN(Ours)</td><td>20</td><td>-99.88±0.20</td><td>58.37±3.30 90.95±0.90</td><td>66.17±7.02 91.12±2.67</td><td>80.68±18.00 99.13±0.72</td><td>78.59±19.27 95.63±1.31</td></tr></table>

Peer review (iclr2019):
 The paper presents a new approach for performing visual query answering. System responses are programs that can explain the truth value of the answer. In the paper, both the problems of learning and inference are taken into account. To answer queries, this system takes as input an image and a question, which is a set of word from a given vocabulary. Then the question is modeled by a plan (a series of operation that must be performed to answer the query). Finally, the found answer with the plan are returned. To learn the parameters of the model, the examples are tuples composed by an image, a question, the answer, and the program. Experiments performed on the SHAPES dataset show good performance compared to neural model networks by Johnson et al. The paper is well written and clear. I have not found any specific problems in the paper, the quality is high and the approach seems to me to be new and worth studying. The discussion on related work seems to be good, as well as the discussion on the results of the tests conducted. On page 5, in equation (3) it seems to me that something is missing in J. Moreover, In Algorithm 1, in lines 4 and 9, the B after the arrow should be written in italic. Overall, there are several typos that must be corrected. I suggest a double check of the English. For example: - page 3, "as modeling *uncertaintly* should..." - page 6, "Given this goal, we *consrtuct* a latent *varible* ..." - page 8, in paragraph "Effect of optimizing the true ELBO", the word "that" is repeated twice in the 3rd row - page 13, "for the" repeated twice in "Moving average baseline" paragraph. Also, in the last line of this paragraph, the sentence seems incomplete. Pros - The results are convincing - The approach is clearly explained Cons - English must be checked