Before revision:  Experiments on ImageNet benchmark and downstream tasks demonstrate the superiority and efficiency\times16\times4 of the proposed TNT architecture .
After revision:  Experiments on ImageNet benchmark and downstream tasks demonstrate the superiority and efficiency\times16\times4) as "visual words". The attention of each word will be calculated with other words in the given visual sentence with negligible computational costs. Features of both words and sentences will be aggregated to enhance the representation ability. Experiments on several benchmarks demonstrate the effectiveness of the proposed TNT architecture .