# Optimizing Mobile Vision Transformers for Land Cover Classification
## 3 Materials and Methods
### Datasets  
Models were trained on four multi-class classification GIS datasets: AID [38], EuroSAT [39; 40], UC-Merced [41], and WHU-RS19 [42; 43]. These datasets feature diverse image sizes, spatial resolutions, image types, image formats, and labels. These statistics and data are displayed in Table 3. The labels and their sequence numbers are provided in Table 4. Due to the variety of datasets utilized for this project, we ensured that the better performance of our custom MViT variants was consistent across a wide range of labeled images. The AID dataset is a large aerial image dataset that was formed by collecting images from Google Earth imagery. These Google Earth images are also post-processed with RGB renderings extracted from the original optical aerial images. The images of the AID dataset are labeled with 30 aerial scene class labels, which is the most out of all the datasets. Also, there are 10,000 JPG images inside AID with a size of 600 \(\times\) 600 and an image resolution ranging from 0.5 m to 8 m. Figure 5a-e display five sample images from the AID dataset. The EuroSAT dataset is a large-scale satellite multispectral image dataset that was collated by using Sentinel-2 satellite images that are accessible from the open-source Earth observation program Copernicus [44]. Also, this dataset is unique because the images are multispectral and cover 13 spectral bands that are in the short infrared, near-infrared, and visible parts of the spectrum. Our experiments used a smaller version of EuroSAT, and the images of the dataset are labeled with nine class labels, which is one less than the original and the least out of the four datasets. In addition, EuroSAT is the largest dataset, \begin{table}
\begin{tabular}{l c c c c} \hline \hline \multirow{2}{*}{**Dataset**} & **AID** & **EuroSAT** & **UC-Merced** & **WHU-RS19** \\  & **Parameters** & **Parameters** & **Parameters** & **Parameters** \\ \hline ViT & 21,687,269 & 21,665,744 & 21,678,044 & 21,675,994 \\ \hline MViT & 1,315,646 & 1,308,905 & 1,312,757 & 1,312,115 \\ \hline MViT-DepthConv & 1,170,446 & 1,163,705 & 1,167,557 & 1,166,915 \\ \hline MViT-Combined & 1,016,846 & 1,010,105 & 1,013,957 & 1,013,315 \\ \hline SWIN-Reg & 155,022 & 152,313 & 153,861 & 153,603 \\ \hline SWIN-ConvBlock & 172,846 & 170,137 & 171,685 & 171,427 \\ \hline SWIN-Shuffle & 164,073 & 161,364 & 162,912 & 162,654 \\ \hline \hline \end{tabular}
\end{table} 
Table 2: Comparison of the number of trainable parameters for the transformer variants. as it contains 24,500 JPG images that have a size of 64 pixels by 64 pixels and an image resolution of 10 m. Figure 5f-j display sample images from the EuroSAT dataset. \begin{table}
\begin{tabular}{c c c c c c c} \hline \hline
**Name** & **\# of Images** & **Image Size** & **Spatial Resolution** & **Image Type** & **Image Format** & **\# of Labels** \\ \hline AID & 10,000 & 600 \(\times\) 600 & 0.5–8 m & Aerial RGB & JPG & 30 \\ \hline EuroSAT & 24,500 & 64 \(\times\) 64 & 10 m & Multispectral & JPG & 9 \\ \hline UC-Merced & 2100 & 256 \(\times\) 256 & 0.3 m & Aerial RGB & TIF & 21 \\ \hline WHU-RS19 & 1005 & 600 \(\times\) 600 & \(\leq\)0.5 m & Aerial RGB & JPG & 19 \\ \hline \hline \end{tabular}
\end{table} 
Table 3: Dataset features used in this study. Figure 5: Sample images from the four datasets used in this study. The UC-Merced dataset [41] is a large aerial image dataset that was formed by extracting a diverse range of smaller images from large images that were collated in the USGS National Map Urban Area Imagery Collection. The sizes of these smaller images are \(256\times 256\), and the images come from different urban areas around the United States of America. The dataset's images feature the smallest spatial resolution of the four datasets at 0.3 m, and they are the only dataset with TIF images. In addition, the dataset features images that belong to 21 classes, and there are 100 images per image class, which leads to a total of 2100 images in the dataset. Figure 5k-o display five sample images from the UC-Merced dataset.