Miracle-dz/UniFAR-FTUs huggingface dataset:
Deep Distillation Recursive Network for Remote Sensing Imagery Super-Resolution

Deep convolutional neural networks (CNNs) have been widely used and achieved state-of-the-art performance in many image or video processing and analysis tasks. In particular, for image super-resolution (SR) processing, previous CNN-based methods have led to significant improvements, when compared with shallow learning-based methods. However, previous CNN-based algorithms with simple direct or skip connections are of poor performance when applied to remote sensing satellite images SR. In this study, a simple but effective CNN framework, namely deep distillation recursive network (DDRN), is presented for video satellite image SR. DDRN includes a group of ultra-dense residual blocks (UDB), a multi-scale purification unit (MSPU), and a reconstruction module. In particular, through the addition of rich interactive links in and between multiple-path units in each UDB, features extracted from multiple parallel convolution layers can be shared effectively. Compared with classical dense-connection-based models, DDRN possesses the following main properties. (1) DDRN contains more linking nodes with the same convolution layers. (2) A distillation and compensation mechanism, which performs feature distillation and compensation in different stages of the network, is also constructed. In particular, the high-frequency components lost during information propagation can be compensated in MSPU. (3) The final SR image can benefit from the feature maps extracted from UDB and the compensated components obtained from MSPU. Experiments on Kaggle Open Source Dataset and Jilin-1 video satellite images illustrate that DDRN outperforms the conventional CNN-based baselines and some state-of-the-art feature extraction approaches.
Permafrost Terrain Dynamics and Infrastructure Impacts Revealed by UAV Photogrammetry and Thermal Imaging

Unmanned Aerial Vehicle (UAV) systems, sensors, and photogrammetric processing techniques have enabled timely and highly detailed three-dimensional surface reconstructions at a scale that bridges the gap between conventional remote-sensing and field-scale observations. In this work 29 rotary and fixed-wing UAV surveys were conducted during multiple field campaigns, totaling 47 flights and over 14.3 km2, to document permafrost thaw subsidence impacts on or close to road infrastructure in the Northwest Territories, Canada. This paper provides four case studies: (1) terrain models and orthomosaic time series revealed the morphology and daily to annual dynamics of thaw-driven mass wasting phenomenon (retrogressive thaw slumps; RTS). Scar zone cut volume estimates ranged between 3.2 × 103 and 5.9 × 106 m3. The annual net erosion of RTS surveyed ranged between 0.35 × 103 and 0.39 × 106 m3. The largest RTS produced a long debris tongue with an estimated volume of 1.9 × 106 m3. Downslope transport of scar zone and embankment fill materials was visualized using flow vectors, while thermal imaging revealed areas of exposed ground ice and mobile lobes of saturated, thawed materials. (2) Stratigraphic models were developed for RTS headwalls, delineating ground-ice bodies and stratigraphic unconformities. (3) In poorly drained areas along road embankments, UAV surveys detected seasonal terrain uplift and settlement of up to 0.5 m (>1700 m2 in extent) as a result of injection ice development. (4) Time series of terrain models highlighted the thaw-driven evolution of a borrow pit (6.4 × 105 m3 cut volume) constructed in permafrost terrain, whereby fluvial and thaw-driven sediment transfer (1.1 and 3.9 × 103 m3 a−1 respectively) was observed and whereby annual slope profile reconfiguration was monitored to gain management insights concerning site stabilization. Elevation model vertical accuracies were also assessed as part of the case studies and ranged between 0.02 and 0.13 m Root Mean Square Error, whereby photogrammetric models processed with Post-processed Kinematic image solutions achieved similar accuracies without ground control points over much larger and complex areas than previously reported. The high resolution of UAV surveys, and the capacity to derive quantitative time series provides novel insights into permafrost processes that are otherwise challenging to study. The timely emergence of these tools bridges field-based research and applied studies with broad-scale remote-sensing approaches during a period when climate change is transforming permafrost environments.
Impact of the Elevation Angle on CYGNSS GNSS-R Bistatic Reflectivity as a Function of Effective Surface Roughness over Land Surfaces

The Earth’s surface bistatic reflectivity Γ L H C P , C y G N S S is experimentally characterized using the novel Global Navigation Satellite Systems Reflectometry (GNSS-R) L-band passive multistatic radar technique from the Cyclone Global Navigation Satellite Systems (CyGNSS) eight-microsatellite constellation. The focus of this study is to evaluate the influence of the GNSS satellites’ elevation angle θ e on Γ L H C P , C y G N S S , as a function of soil moisture content (SMC) and effective surface roughness parameter h . As the average response, the change of the scattering regime at a global scale and considering also vegetated surfaces appears at θ e ≈ 55°. This empirical observation is understood as a change on the dominant scattering term, from incoherent to coherent. Then, the correlation of Γ L H C P , C y G N S S and SMC is evaluated as a function of θ e over specific sparsely vegetated target areas. The smoother the surface, the higher the angular variability of the Pearson correlation coefficients. Over croplands (e.g., Argentinian Pampas), an improved correlation coefficient is achieved over angular ranges where the coherent scattering regime becomes the dominant one. As such, this function depends on the surface roughness. The maximum correlation coefficients are found at different θ e for increasing mean roughness levels: r P a m p a s ≈ 0.78 at θ e ≈ [60,70]°, r I n d i a ≈ 0.72 at θ e ≈ [50,60]°, and r S u d a n ≈ 0.74 at θ e ≈ [30,40]°. SMC retrieval algorithms based on GNSS-R multi-angular information could benefit from these findings, so as to improve the accuracy using single-polarized signals.
Estimating Tree Position, Diameter at Breast Height, and Tree Height in Real-Time Using a Mobile Phone with RGB-D SLAM

Accurate estimation of tree position, diameter at breast height (DBH), and tree height measurements is an important task in forest inventory. Mobile Laser Scanning (MLS) is an important solution. However, the poor global navigation satellite system (GNSS) coverage under the canopy makes the MLS system unable to provide globally-consistent point cloud data, and thus, it cannot accurately estimate the forest attributes. SLAM could be an alternative for solutions dependent on GNSS. In this paper, a mobile phone with RGB-D SLAM was used to estimate tree position, DBH, and tree height in real-time. The main aims of this paper include (1) designing an algorithm to estimate the DBH and position of the tree using the point cloud from the time-of-flight (TOF) camera and camera pose; (2) designing an algorithm to measure tree height using the perspective projection principle of a camera and the camera pose; and (3) showing the measurement results to the observer using augmented reality (AR) technology to allow the observer to intuitively judge the accuracy of the measurement results and re-estimate the measurement results if needed. The device was tested in nine square plots with 12 m sides. The tree position estimations were unbiased and had a root mean square error (RMSE) of 0.12 m in both the x-axis and y-axis directions; the DBH estimations had a 0.33 cm (1.78%) BIAS and a 1.26 cm (6.39%) root mean square error (RMSE); the tree height estimations had a 0.15 m (1.08%) BIAS and a 1.11 m (7.43%) RMSE. The results showed that the mobile phone with RGB-D SLAM is a potential tool for obtaining accurate measurements of tree position, DBH, and tree height.
Landscape-Scale Aboveground Biomass Estimation in Buffer Zone Community Forests of Central Nepal: Coupling In Situ Measurements with Landsat 8 Satellite Data

Knowledge of forest productivity status is an important indicator of the amount of biomass accumulated and the role of terrestrial ecosystems in the carbon cycle. However, accurate and up-to-date information on forest biomass and forest succession remain rudimentary within natural forests. This study sought to understand and establish the potential of a new-generation sensor in estimating aboveground biomass (AGB) stored in the natural forest, also known as ‘community forest’ or buffer zone community forest (BZCF), in the Parsa National Park, Nepal. The utility of the 30-m resolution Landsat 8 Operational Land Imager (OLI) and in situ data was tested using two statistical approaches, namely multiple linear regression (MLR) and random forest (RF). The analysis was done based on four computational procedures. These included spectral bands, vegetation indices and pooled dataset (spectral bands + vegetation indices), and model selected important variables. AGB estimation based on pooled data showed that the RF algorithm produced better results when compared to the use of the MLR model. For instance, the RF model estimated AGB with an R2 value of 0.87 and a root mean square error of 20.50 t ha−1, as well as an R2 value of 0.95 and a RMSE of 13.3 t ha−1 when using selected important variables. Comparatively, the MLR using pooled data produced an R2 value of 0.56 and RMSE value of 37.01 t ha−1. The RF model selected Optimized Soil Adjusted Vegetation index (OSAVI), Simple ratio (SR), Modified simple ratio (MSR), and Normalized difference Vegetation index (NDVI) as the most important variables for estimating AGB, whereas MLR selected band 5 and SR. These findings demonstrate the relevance of the relatively new Landsat 8 sensor in the estimation of AGB in community buffer zones.
Application of Spectrally Derived Soil Type as Ancillary Data to Improve the Estimation of Soil Organic Carbon by Using the Chinese Soil Vis-NIR Spectral Library

Ancillary data, such as soil type, may improve the visible and near-infrared (vis-NIR) estimation of soil organic carbon (SOC); however, they require data collection or expert knowledge. The application of a national soil spectral library to local SOC estimations usually requires soil type information, because the relationships between vis-NIR spectra and SOC from different populations may vary. Using 515 samples of five soil types (genetic soil classification of China, GSCC) from the Chinese soil spectral library (CSSL), we compared three strategies in the vis-NIR estimation of SOC. Different regression models were calibrated using the entire dataset (Strategy I, without using soil type as ancillary data) and the subsets stratified by soil type from CSSL as ancillary data (strategies II and III). In Strategy II, the subsets were stratified by soil type from the CSSL for validation. In Strategy III, the subsets were stratified by spectrally derived soil type for validation. The results showed that 86.72% of the samples were successfully discriminated for the soil types by using the vis-NIR spectra. The coefficients of determination in the prediction ( R p 2 ) of SOC estimation by strategies I, II, and III were 0.74, 0.83, and 0.82, respectively. The stratified calibration strategies (strategies II and III) improved the vis-NIR estimation of SOC. The misclassification of the soil type in the application of Strategy III slightly affected the SOC estimations. Nevertheless, this strategy is inexpensive and beneficial when expert knowledge on soil classification is lacking. We concluded that vis-NIR spectroscopy could be applied to distinguish some soil types in terms of GSCC, which further provided essential and easily accessible ancillary data for the application of stratified calibration strategies in the vis-NIR estimation of SOC.
Accuracy Assessment of Global Food Security-Support Analysis Data (GFSAD) Cropland Extent Maps Produced at Three Different Spatial Resolutions

Monitoring global agriculture systems relies on accurate and timely cropland information acquired worldwide. Recently, the NASA Making Earth System Data Records for Use in Research Environments (MEaSUREs) Program has produced Global Food Security-support Analysis Data (GFSAD) cropland extent maps at three different spatial resolutions, i.e., GFSAD1km, GFSAD250m, and GFSAD30m. An accuracy assessment and comparison of these three GFSAD cropland extent maps was performed to establish their quality and reliability for monitoring croplands both at global and regional scales. Large area (i.e., global) assessment of GFSAD cropland extent maps was performed by dividing the entire world into regions using a stratification approach and collecting a reference dataset using a simple random sampling design. All three global cropland extent maps were assessed using a total reference dataset of 28,733 samples. The assessment results showed an overall accuracy of 72.3%, 80–98%, and 91.7% for GFSAD1km, 250 m (only for four continents), and 30 m maps, respectively. Additionally, a regional comparison of the three GFSAD cropland extent maps was analyzed for nine randomly selected study sites of different agriculture field sizes (i.e., small, medium, and large). The similarity among the three GFSAD cropland extent maps in these nine study sites was represented using a similarity matrix approach and two landscape metrics (i.e., Proportion of Landscape (PLAND) and Per Patch Unit (PPU)), which categorized the crop proportion and the crop pattern. A comparison of the results showed the similarities and differences in the cropland areas and their spatial extent when mapped at the three spatial resolutions and considering the different agriculture field sizes. Finally, specific recommendations were suggested for when to apply each of the three different GFSAD cropland extent maps for agriculture monitoring based on these agriculture field sizes.
Mapping Paddy Rice Using a Convolutional Neural Network (CNN) with Landsat 8 Datasets in the Dongting Lake Area, China

Rice is one of the world’s major staple foods, especially in China. Highly accurate monitoring on rice-producing land is, therefore, crucial for assessing food supplies and productivity. Recently, the deep-learning convolutional neural network (CNN) has achieved considerable success in remote-sensing data analysis. A CNN-based paddy-rice mapping method using the multitemporal Landsat 8, phenology data, and land-surface temperature (LST) was developed during this study. First, the spatial–temporal adaptive reflectance fusion model (STARFM) was used to blend the moderate-resolution imaging spectroradiometer (MODIS) and Landsat data for obtaining multitemporal Landsat-like data. Subsequently, the threshold method is applied to derive the phenological variables from the Landsat-like (Normalized difference vegetation index) NDVI time series. Then, a generalized single-channel algorithm was employed to derive LST from the Landsat 8. Finally, multitemporal Landsat 8 spectral images, combined with phenology and LST data, were employed to extract paddy-rice information using a patch-based deep-learning CNN algorithm. The results show that the proposed method achieved an overall accuracy of 97.06% and a Kappa coefficient of 0.91, which are 6.43% and 0.07 higher than that of the support vector machine method, and 7.68% and 0.09 higher than that of the random forest method, respectively. Moreover, the Landsat-derived rice area is strongly correlated (R2 = 0.9945) with government statistical data, demonstrating that the proposed method has potential in large-scale paddy-rice mapping using moderate spatial resolution images.
Hidden Singer: Distinguishing Imitation Singers Based on Training with Only the Original Song

Hidden Singer is a television program in Korea. In the show, the original singer and four imitating singers sing a song in hiding behind a screen. The audience and TV viewers attempt to guess who the original singer is by listening to the singing voices. Usually, there are few correct answers from the audience, because the imitators are well trained and highly skilled. We propose a computerized system for distinguishing the original singer from the imitating singers. During the training phase, the system learns only the original singer’s song because it is the one the audience has heard before. During the testing phase, the songs of five candidates are provided to the system and the system then determines the original singer. The system uses a 1-class authentication method, in which only a subject model is made. The subject model is used for measuring similarities between the candidate songs. In this problem, unlike other existing studies that require artist identification, we cannot utilize multi-class classifiers and supervised learning because songs of the imitators and the labels are not provided during the training phase. Therefore, we evaluate the performances of several 1-class learning algorithms to choose which one is more efficient in distinguishing an original singer from among highly skilled imitators. The experiment results show that the proposed system using the autoencoder performs better (63.33%) than other 1-class learning algorithms: Gaussian mixture model (GMM) (50%) and one class support vector machines (OCSVM) (26.67%). We also conduct a human contest to compare the performance of the proposed system with human perception. The accuracy of the proposed system is found to be better (63.33%) than the average accuracy of human perception (33.48%). key words: singer authentication, autoencoder, neural network, artificial intelligence
Avoiding Performance Impacts by Re-Replication Workload Shifting in HDFS Based Cloud Storage

SUMMARY Data replication in cloud storage systems brings a lot of beneﬁts, such as fault tolerance, data availability, data locality and load balancing both from reliability and performance perspectives. However, each time a datanode fails, data blocks stored on the failed datanode must be restored to maintain replication level. This may be a large burden for the system in which resources are highly utilized with users’ application workloads. Although there have been many proposals for replication, the approach of re-replication has not been properly addressed yet. In this paper, we present a deferred re-replication algorithm to dynamically shift the re-replication workload based on current resource utilization status of the system. As workload pattern varies depending on the time of the day, simulation results from synthetic workload demonstrate a large opportunity for minimizing impacts on users’ application workloads with the simple algo-rithm that adjusts re-replication based on current resource utilization. Our approach can reduce performance impacts on users’ application workloads while ensuring the same reliability level as default HDFS can provide.
Multi-Temporal Loess Landslide Inventory Mapping with C-, X- and L-Band SAR Datasets - A Case Study of Heifangtai Loess Landslides, China

The Interferometric Synthetic Aperture Radar (InSAR) technique is a well-developed remote sensing tool which has been widely used in the investigation of landslides. Average deformation rates are calculated by weighted averaging (stacking) of the interferograms to detect small-scale loess landslides. Heifangtai loess terrace, Gansu province China, is taken as a test area. Aiming to generate multi-temporal landslide inventory maps and to analyze the landslide evolution features from December 2006 to November 2017, a large number of Synthetic Aperture Radar (SAR) datasets acquired by L-band ascending ALOS/PALSAR, L-band ascending and descending ALOS/PALSAR-2, X-band ascending and descending TerraSAR-X and C-band descending Sentinel-1A/B images covering different evolution stages of Heifangtai terrace are fully exploited. Firstly, the surface deformation of Heifangtai terrace is calculated for independent SAR data using the InSAR technique. Subsequently, InSAR-derived deformation maps, SAR intensity images and a DEM gradient map are jointly used to detect potential loess landslides by setting the appropriate thresholds. More than 40 active loess landslides are identified and mapped. The accuracy of the landslide identification results is verified by comparison with published literatures, the results of geological field surveys and remote sensing images. Furthermore, the spatiotemporal evolution characteristics of the landslides during the last 11 years are revealed for the first time. Finally, strengths and limitations of different wavelength SAR data, and the effects of track direction, geometric distortions of SAR images and the differences in local incidence angle between two adjacent satellite tracks in terms of small-scale loess landslides identification, are analyzed and summarized, and some suggestions are given to guide the future identification of small-scale loess landslides with the InSAR technique.
Combining Camera Relascope-Measured Field Plots and Multi-Seasonal Landsat 8 Imagery for Enhancing the Forest Inventory of Boreal Forests in Central Russia

The study considers a forest inventory for the mean volume, basal area, and coniferous/deciduous mapping of a large territory in central Siberia (Russia), employing a camera relascope at arbitrary sized sample plots and medium resolution satellite imagery Landsat 8 from the leaf-on and leaf-off seasons. The research bases are on field plots and satellite data that are acquired for the real operational forest inventory, performed for industrial purposes during summer–fall 2015. Sparse Bayesian regression was used to estimate linear regression models between field-measured variables and features derived from satellite data. Coniferous/deciduous mapping was done, applying maximum likelihood classification. The study reported the root mean square error for the mean volume and basal area under 25% for both the plot level and compartment level. The overall accuracy of the forest-type classification in coniferous, mixed coniferous/deciduous, and deciduous classes was 71.6%. The features of Landsat 8 images from both seasons were selected in almost every model, indicating that the use of satellite imagery from different seasons improved the estimation accuracy. It has been shown that the combination of camera relascope-based field data and medium-resolution satellite imagery gives accurate enough results that compare well with previous studies in that field, and provide fast and solid data about forests of large areas for efficient investment decision making.
Extrinsic Camera Calibration of Display-Camera System with Cornea Reflections

In this paper, we propose a novel method to extrinsically calibrate a camera to a 3D reference object that is not directly visible from the camera. We use a human cornea as a spherical mirror and calibrate the extrinsic parameters from the reflections of the reference points. The main contribution of this paper is to present a cornea-reflection-based calibration algorithm with a simple configuration: five reference points on a single plane and one mirror pose. In this paper, we derive a linear equation and obtain a closed-form solution of extrinsic calibration by introducing two ideas. The first is to model the cornea as a virtual sphere, which enables us to estimate the center of the cornea sphere from its projection. The second is to use basis vectors to represent the position of the reference points, which enables us to deal with 3D information of reference points compactly. We demonstrate the performance of the proposed method with qualitative and quantitative evaluations using synthesized and real data. key words: camera calibration, cornea reflection, spherical mirror