We develop a Deep-Text Recurrent Network (DTRN) that regards scene text reading as a sequence labelling problem. We leverage recent advances of deep convolutional neural networks to generate an ordered high-level sequence from a whole word image, avoiding the difficult character segmentation problem. Then a deep recurrent model, building on long short-term memory (LSTM), is developed to robustly recognize the generated CNN sequences, departing from most existing approaches recognising each character independently. Our model has a number of appealing properties in comparison to existing scene text recognition methods: (i) It can recognise highly ambiguous words by leveraging meaningful context information, allowing it to work reliably without either pre-or post-processing; (ii) the deep CNN feature is robust to various image distortions; (iii) it retains the explicit order information in word image, which is essential to discriminate word strings; and (iv) the model does not depend on pre-defined dictionary, and it can process unknown words and arbitrary strings. The proposed model achieves impressive performance on a number of benchmarks, advancing the-state-of-the-arts [18, 1] substantially. Codes for the DTRN will be available.
The researchers in REF used a Deep-Text recurrent network that considers text reading as a sequence labeling problem.
Reading Scene Text in Deep Convolutional Sequences
ArXiv
ArXiv
Computer Science