Optimizing Detection Techniques for High-Precision Icon Recognition in Sparse Feature Spaces

Authors: Monali Barbate, Sudeep Choudhary
Primary area: applications to computer vision, audio, language, and other modalities
Keywords: cnn, feature sparse images, contrastive learning, adversarial training, dynamic margins, attention mechanisms

Abstract:
CNNs usually work well when they can extract progressively higher-level features through the layers. In small, low-resolution images, the depth of feature extraction is limited, leading to a sparsity in the feature space. Icon detection presents a unique challenge due to the small, feature-sparse nature of the target images, which often results in limited discriminative features. To address this, we propose an icon detection model based on a Siamese network architecture. This approach draws inspiration from face recognition frameworks. The modified architectures are aimed at being well-suited for distinguishing subtle differences between icon pairs. Given the relatively sparse feature space of these icons compared to larger images, we explore several enhancements to improve performance. Key innovations include the integration of attention mechanisms to focus on informative features, multi-scale feature extraction for better detail capture and contrastive learning. We additionally employ adversarial training to enhance performance. Additionally, we investigate dynamic margins in metric learning to model icon similarities. Self-supervised pretraining and Neural Architecture Search are employed to further refine and optimize the network. Our comprehensive evaluation demonstrates significant improvements in icon detection, highlighting the effectiveness of these advanced techniques in handling small, feature-sparse image data. This solution
offers a valuable advancement in high-precision icon recognition, with potential applications in user interface design, software development, and digital asset management.

Decision: withdrawn
Reviewer scores: 3, 1, 1, 3

Reviews and discussion:
<thread>
creation date:
1729671920694

thread_type:
official_review

<thread_object>
creator: reviewer_5f7c

<content>
summary:
In this paper, the authors proposed to explore the effectiveness of siamese networks, self-supervised pertaining, attention modules, multi-scale feature extraction, and adaptive margins in contrastive loss. The experiments have demonstrated the improvement of the proposed pertaining and attention module.

strengths:
1. The task of icon recognition is pretty interesting. This type of spatial discrimination learning is worth studying.
2. This paper discusses useful technologies, like siamese network architecture, constractive pertaining, attention mechanisms, etc. 
3. Experiments show the effectiveness of pertaining and attention mechanisms.

weaknesses:
The completeness of the paper is poor. It lacks details on the architecture of the network and training implementation. In addition, experiments are limited. There is neither a comparison with existing methods nor an ablation comparison of designs that include multi-scale feature extraction and loss functions.

The core contribution of the paper is unclear. The authors only use the existing technologies and do not provide valuable new insights for the readers.

questions:
My main concerns are listed in the weaknesses.
</content>
</thread_object>

</thread>
<thread>
creation date:
1730119669756

thread_type:
official_review

<thread_object>
creator: reviewer_qvau

<content>
summary:
In my opinion, this paper is not ready for ICLR. 

The theoretical part of the paper lacks innovation, with simple formulas such as cross-entropy loss and cosine distance. The model structure is not innovative, the page count is less than 8 pages, there are only 8 references, and the image quality is insufficient. The experiments are not comprehensive, with only one table in the entire paper, and it only presents a very simple ablation study without comparing it to existing methods.

strengths:
I found no strength

weaknesses:
see summary

questions:
The paper is far from ICLR paper quality.
</content>
</thread_object>

</thread>
<thread>
creation date:
1730610899911

thread_type:
official_review

<thread_object>
creator: reviewer_mahq

<content>
summary:
They propose an icon detection model, which is a Siamese network architecture with self-supervised pertaining, multi-scale feature extraction, and attention mechanisms. In addition, they introduce dynamic margins and various loss functions to improve performance.

strengths:
1. They proposed an attention based Siamese network for icon recognition.

2. They introduced a learnable margin in the contrastive loss.

weaknesses:
1. The paper is not well prepared. Some punctuation is missing, such as a period on line 161, an incorrect use of “model s” on line 252, and a missing period on line 364. Figure 1 has a resolution problem, making it blurry. In the abstract, they mention adaptations for few-shot learning and the use of GNN to model icon relationships, but I did not see either of them in the paper. There are some references in the Reference section not cited in the paper.

2. They missed a detailed introduction to the dataset. They did not try on public icon datasets, like the Icons-50 Dataset. They did not compare with other related work, like [1] and [2].

3. They lack novel contributions, all methods have been proposed by others, like SimCLR, attention-based Siamese network[3]. 

[1] Camilo Vargas, Qianni Zhang, and Ebroul Izquierdo. 2020. One Shot Logo Recognition Based on Siamese Neural Networks. In Proceedings of the 2020 International Conference on Multimedia Retrieval (ICMR '20). Association for Computing Machinery, New York, NY, USA, 321–325. 
[2] Nakul Sharma, Abhirama Subramanyam V B Penamakuri, and Anand Mishra. 2023. Contrastive Multi-View Textual-Visual Encoding: Towards One Hundred Thousand-Scale One-Shot Logo Identification. In Proceedings of the Thirteenth Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP '22). Association for Computing Machinery, New York, NY, USA, Article 24, 1–9.
[3] Y. Liu, G. Chang, G. Fu, Y. Wei, J. Lan and J. Liu, "Self-Attention based Siamese Neural Network recognition Model," 2022 34th Chinese Control and Decision Conference (CCDC), Hefei, China, 2022, pp. 721-724

questions:
1. In the dataset, you only have training and validation datasets. Where is the testing dataset?

2. I did not see the details of how you designed and implemented the attention mechanism in your model. Can you explain the details?

3. Where are the ablation study results regarding the learnable margin?
</content>
</thread_object>

</thread>
<thread>
creation date:
1730639301533

thread_type:
official_review

<thread_object>
creator: reviewer_dv9r

<content>
summary:
This paper proposes to explore the effectiveness of multiple techniques including attention, SimCLR pretraining and learnable loss margin in the context of small and feature-sparse icon recognition. The paper finds that the following techniques are useful:
1. Using SimCLR pretraining.
2. Using attention mechanism before embedding generation.
3. Using adaptive margin loss.

strengths:
1. The experimental results show an improvement compared to the baseline.
2. Icon recognition can be useful in practical settings.

weaknesses:
1. Lack of novelty: This paper seems to be a combination of previously proposed method in a new dataset.
2. Inconsistency between claim and experiments: The abstract mentions that the techniques of adversarial training is included but it is not reflected in the experiments.
3. Formatting problem: Page 5 contains lots of empty lines.

questions:
1. Please provide more details and experiments about the learning of margin.
2. Please provide more details about the difference between SimCLR pretraining and the Siamese network learning.
3. Please prove more details about the results of related works and dataset.
</content>
</thread_object>

</thread>


Metareview: