DOI: 10.5281/zenodo.5482334
title: Chinese Chemical Safety Signs (CCSS)

description: <strong>Notice:</strong> We have currently a paper under double-blind review that introduces this dataset. Therefore, we have anonymized the dataset authorship. Once the review process has concluded, we will update the authorship information of this dataset. <strong>Chinese Chemical Safety Signs (CCSS)</strong> This dataset is compiled as a benchmark for recognizing chemical safety signs from images. We provide both the dataset and the experimental results at doi:10.5281/zenodo.5482334. <strong>1. The Dataset</strong> The complete dataset is contained in the folder <code>ccss/data</code> in archive <code>css_data.zip</code>. The images include signs based on the Chinese standard "Safety Signs and their Application Guidelines" (GB 2894-2008) for safety signs in chemical environments. This standard, in turn, refers to the standards ISO 7010 (Graphical symbols – Safety Colours and Safety Signs – Safety signs used in workplaces and public areas), GB/T 10001 (Public Information Graphic Symbols for Signs), and GB 13495 (Fire Safety Signs) <strong>1.1. Image Collection</strong> We collect photos commonly used chemical safety signs in chemical laboratories and chemical teaching buildings. For a discussion of the standards we base our collections, refer to the book "Talking about Hazardous Chemicals and Safety Signs" for common signs, and refer to the safety signs guidelines (GB 2894-2008). The shooting was mainly carried out in 6 locations, namely on the road, in a parking lot, construction walls, in a chemical laboratory, outside near big machines, and inside the factory and corridor. Shooting scale: Images in which the signs appear in small, medium and large scales were taken for each location by shooting photos from different distances. Shooting light: good lighting conditions and poor lighting conditions were investigated. Part of the images contain multiple targets and the other part contains only single signs. Under all conditions, a total of 4650 photos were taken in the original data. These were expanded to 27'900 photos were via data enhancement. All images are located in folder <code>ccss/data/JPEGImages</code>. The file <code>ccss/data/features/enhanced_data_to_original_data.csv</code> provides a mapping between the enhanced image name and the corresponding original image. <strong>1.2. Annotation and Labelling</strong> The labelling tool is Labelimg, which uses the PASCAL-VOC labelling format. The annotation is stored in the folder <code>ccss/data/Annotations</code>. Faster R-CNN and SSD are two algorithms that use this format. When training YOLOv5, you can run <code>trans_voc2yolo.py</code> to convert the XML file in PASCAL-VOC format to a txt file. We provide further meta-information about the dataset in form of a CSV file <code>features.csv</code> which notes, for each image, which other features it has (lighting conditions, scale, multiplicity, etc.). <strong>1.3. Dataset Features</strong> As stated above, the images have been shot under different conditions. We provide all the feature information in folder <code>ccss/data/features</code>. For each feature, there is a separate list of file names in that folder. The file <code>ccss/data/features/features_on_original_data.csv</code> is a CSV file which notes all the features of each original image. <strong>1.4. Dataset Division</strong> The data set is fixedly divided into 7:3 training set and test set. You can find the corresponding image names in the files <code>ccss/data/training_data_file_names.txt</code> and <code>ccss/data/test_data_file_names.txt</code>. <strong>2. Baseline Experiments</strong> We provide baseline results with the three models of Faster R-CNN, SSD, and YOLOv5. All code and results is given in folder <code>ccss/experiment</code> in archive <code>ccss_experiment</code>. <strong>2.2. Environment and Configuration</strong> Single Intel Core i7-8700 CPU NVIDIA GTX1060 GPU 16 GB of RAM Python: 3.8.10 pytorch: 1.9.0 pycocotools: pycocotools-win Visual Studio 2017 Windows 10 <strong>2.3. Applied Models</strong> The source codes and results of the applied models is given in folder <code>ccss/experiment</code> with sub-folders corresponding to the model names. <strong>2.3.1. Faster R-CNN</strong> backbone: resnet50+fpn. we downloaded the pre-training weights from &lt;https://download.pytorch.org/models/fasterrcnn_resnet50_fpn_coco-258fb6c6.pth&gt; we modify the type information of the JSON file to match our application. run <code>train_res50_fpn.py</code> finally, the weights trained by the training set. backbone: mobilenetv2 the same training method as resnet50+fpn, but the effect is not as good as resnet50+fpn, so it is directly discarded. The Faster R-CNN source code used in our experiment is given in folder <code>ccss/experiment/sources/faster_rcnn</code>. The weights of the fully-trained Faster R-CNN model are stored in file <code>ccss/experiment/trained_models/faster_rcnn.pth</code>. The performance measurements of Faster R-CNN are stored in folder <code>ccss/experiment/performance_indicators/faster_rcnn</code>. <strong>2.3.2. SSD</strong> backbone: resnet50 we downloaded pre-training weights from &lt;https://download.pytorch.org/models/resnet50-19c8e357.pth&gt; the same training method as Faster R-CNN is applied. The SSD source code used in our experiment is given in folder <code>ccss/experiment/sources/ssd</code>. The weights of the fully-trained SSD model are stored in file <code>ccss/experiment/trained_models/ssd.pth</code>. The performance measurements of SSD are stored in folder <code>ccss/experiment/performance_indicators/ssd</code>. <strong>2.3.4. YOLOv5</strong> backbone: CSP_DarkNet we modified the type information of the YML file to match our application run <code>trans_voc2yolo.py</code> to convert the XML file in VOC format to a txt file. the weights used are: yolov5s. The YOLOv5 source code used in our experiment is given in folder <code>ccss/experiment/sources/yolov5</code>. The weights of the fully-trained YOLOv5 model are stored in file <code>ccss/experiment/trained_models/yolov5.pt</code>. The performance measurements of YOLOv5 are stored in folder <code>ccss/experiment/performance_indicators/yolov5</code>. <strong>2.4. Evaluation</strong> The computed evaluation metrics as well as the code needed to compute them from our dataset are provided in the folder <code>ccss/experiment/performance_indicators</code>. They are provided over the complete test st as well as separately for the image features (over the test set). <strong>3. Code Sources</strong> Faster R-CNN &lt;https://github.com/WZMIAOMIAO/deep-learning-for-image-processing/tree/master/pytorch_object_detection/faster_rcnn&gt; official code: &lt;https://github.com/pytorch/vision/blob/main/torchvision/models/detection/faster_rcnn.py&gt; SSD &lt;https://github.com/WZMIAOMIAO/deep-learning-for-image-processing/tree/master/pytorch_object_detection/ssd&gt; official code: &lt;https://github.com/pytorch/vision/blob/main/torchvision/models/detection/ssd.py&gt; YOLOv5 &lt;https://github.com/ultralytics/yolov5&gt; We are particularly thankful to the author of the GitHub repository WZMIAOMIAO/deep-learning-for-image-processing (with whom we are not affiliated).<br> Their instructive videos and codes were most helpful during our work. In particular, we based our own experimental codes on his work (and obtained permission to include it in this archive). <strong>4. Licensing</strong> While our dataset and results are published under the Creative Commons Attribution 4.0 License, this does not hold for the included code sources. These sources are under the particular license of the repository where they have been obtained from (see Section 3 above).