Before revision:  We investigate the capacity of this architecture relative to sparse bag-of-words retrieval models and attentional neural networks.
After revision:  We investigate the capacity of this architecture relative to sparse bag-of-words models and attentional neural networks.