Knowing When to Look: Adaptive Attention via a Visual Sentinel for Image Captioning
Multimodal Neural Language Models