Miracle-dz/UniFAR-FTUs huggingface dataset:
Increased Ecosystem Carbon Storage between 2001 and 2019 in the Northeastern Margin of the Qinghai-Tibet Plateau

Global alpine ecosystems contain a large amount of carbon, which is sensitive to global change. Changes to alpine carbon sources and sinks have implications for carbon and climate feedback processes. To date, few studies have quantified the spatial-temporal variations in ecosystem carbon storage and its response to global change in the alpine regions of the Qinghai-Tibet Plateau (QTP). Ecosystem carbon storage in the northeastern QTP between 2001 and 2019 was simulated and systematically analyzed using the Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) model. Furthermore, the Hurst exponent was obtained and used as an input to perform an analysis of the future dynamic consistency of ecosystem carbon storage. Our study results demonstrated that: (1) regression between the normalized difference vegetation index (NDVI) and biomass (coefficient of determination (R2) = 0.974, p < 0.001), and between NDVI and soil organic carbon density (SOCD) (R2 = 0.810, p < 0.001) were valid; (2) the spatial distribution of ecosystem carbon storage decreased from the southeast to the northwest; (3) ecosystem carbon storage increased by 13.69% between 2001 and 2019, and the significant increases mainly occurred in the low-altitude regions; (4) climate and land use (LULC) changes caused increases in ecosystem carbon storage of 4.39 Tg C and 2.25 Tg C from 2001 to 2019, respectively; and (5) the future trend of ecosystem carbon storage in 92.73% of the study area shows high inconsistency but that in 7.27% was consistent. This study reveals that climate and LULC changes have positive effects on ecosystem carbon storage in the alpine regions of the QTP, which will provide valuable information for the formulation of eco-environmental policies and sustainable development.
Detecting High-Rise Buildings from Sentinel-2 Data Based on Deep Learning Method

High-rise buildings (HRBs) as a modern and visually distinctive land use play an important role in urbanization. Large-scale monitoring of HRBs is valuable in urban planning and environmental protection and so on. Due to the complex 3D structure and seasonal dynamic image features of HRBs, it is still challenging to monitor large-scale HRBs in a routine way. This paper extends our previous work on the use of the Fully Convolutional Networks (FCN) model to extract HRBs from Sentinel-2 data by studying the influence of seasonal and spatial factors on the performance of the FCN model. 16 Sentinel-2 subset images covering four diverse regions in four seasons were selected for training and validation. Our results indicate the performance of the FCN-based method at the extraction of HRBs from Sentinel-2 data fluctuates among seasons and regions. The seasonal change of accuracy is larger than that of the regional change. If an optimal season can be chosen to get a yearly best result, F1 score of detected HRBs can reach above 0.75 for all regions with most errors located on the boundary of HRBs. FCN model can be trained on seasonally and regionally combined samples to achieve similar or even better overall accuracy than that of the model trained on an optimal combination of season and region. Uncertainties exist on the boundary of detected results and may be relieved by revising the definition of HRBs in a more rigorous way. On the whole, the FCN based method can be largely effective at the extraction of HRBs from Sentinel-2 data in regions with a large diversity in culture, latitude, and landscape. Our results support the possibility to build a powerful FCN model on a larger size of training samples for operational monitoring HRBs at the regional level or even on a country scale.
On-Demand Satellite Payload Execution Strategy for Natural Disasters Monitoring Using LoRa: Observation Requirements and Optimum Medium Access Layer Mechanisms

Natural disasters and catastrophes are responsible for numerous casualties and important economic losses. They can be monitored either with in-situ or spaceborne instruments. However, these monitoring systems are not optimal for an early detection and constant monitoring. An optimisation of these systems could benefit from networks of Internet of Things (IoT) sensors on the Earth’s surface, capable of automatically triggering on-demand executions of the spaceborne instruments. However, having a vast amount of sensors communicating at once with one satellite in view also poses a challenge in terms of the medium access layer (MAC), since, due to packet collisions, packet losses can occur. As part of this study, the monitoring requirements for an ideal spatial nodes density and measurement update frequencies of those sensors are provided. In addition, a study is performed to compare different MAC protocols, and to assess the sensors density that can be achieved with each of these protocols, using the LoRa technology, and concluding the feasibility of the monitoring requirements identified.
Tree Recognition on the Plantation Using UAV Images with Ultrahigh Spatial Resolution in a Complex Environment

The survival rate of seedlings is a decisive factor of afforestation assessment. Generally, ground checking is more accurate than any other methods. However, the survival rate of seedlings can be higher in the growing season, and this can be estimated in a larger area at a relatively lower cost by extracting the tree crown from the unmanned aerial vehicle (UAV) images, which provides an opportunity for monitoring afforestation in an extensive area. At present, studies on extracting individual tree crowns under the complex ground vegetation conditions are limited. Based on the afforestation images obtained by airborne consumer-grade cameras in central China, this study proposes a method of extracting and fusing multiple radii morphological features to obtain the potential crown. A random forest (RF) was used to identify the regions extracted from the images, and then the recognized crown regions were fused selectively according to the distance. A low-cost individual crown recognition framework was constructed for rapid checking of planted trees. The method was tested in two afforestation areas of 5950 m2 and 5840 m2, with a population of 2418 trees (Koelreuteria) in total. Due to the complex terrain of the sample plot, high weed coverage, the crown width of trees, and spacing of saplings vary greatly, which increases both the difficulty and complexity of crown extraction. Nevertheless, recall and F-score of the proposed method reached 93.29%, 91.22%, and 92.24% precisions, respectively, and 2212 trees were correctly recognized and located. The results show that the proposed method is robust to the change of brightness and to splitting up of a multi-directional tree crown, and is an automatic solution for afforestation verification.
Three-Dimensional Convolutional Neural Network Model for Early Detection of Pine Wilt Disease Using UAV-Based Hyperspectral Images

As one of the most devastating disasters to pine forests, pine wilt disease (PWD) has caused tremendous ecological and economic losses in China. An effective way to prevent large-scale PWD outbreaks is to detect and remove the damaged pine trees at the early stage of PWD infection. However, early infected pine trees do not show obvious changes in morphology or color in the visible wavelength range, making early detection of PWD tricky. Unmanned aerial vehicle (UAV)-based hyperspectral imagery (HI) has great potential for early detection of PWD. However, the commonly used methods, such as the two-dimensional convolutional neural network (2D-CNN), fail to simultaneously extract and fully utilize the spatial and spectral information, whereas the three-dimensional convolutional neural network (3D-CNN) is able to collect this information from raw hyperspectral data. In this paper, we applied the residual block to 3D-CNN and constructed a 3D-Res CNN model, the performance of which was then compared with that of 3D-CNN, 2D-CNN, and 2D-Res CNN in identifying PWD-infected pine trees from the hyperspectral images. The 3D-Res CNN model outperformed the other models, achieving an overall accuracy (OA) of 88.11% and an accuracy of 72.86% for detecting early infected pine trees (EIPs). Using only 20% of the training samples, the OA and EIP accuracy of 3D-Res CNN can still achieve 81.06% and 51.97%, which is superior to the state-of-the-art method in the early detection of PWD based on hyperspectral images. Collectively, 3D-Res CNN was more accurate and effective in early detection of PWD. In conclusion, 3D-Res CNN is proposed for early detection of PWD in this paper, making the prediction and control of PWD more accurate and effective. This model can also be applied to detect pine trees damaged by other diseases or insect pests in the forest.
Hydrometeor and Latent Heat Nudging for Radar Reflectivity Assimilation: Response to the Model States and Uncertainties

Radar data are essential to convection nowcasting and nudging-based radar data assimilation through diabatic initialization is one of the most effective approaches for forecasting convective systems with numerical weather prediction (NWP) models, used at several advanced global weather centers. It is desired to assess the uncertainty and physical consistency of this assimilation process. This paper investigated impacts of relaxation coefficient, radar data update intervals and continuous assimilation time duration and addressed the key issues and possible solutions of the radar data assimilation based on the WRF hydrometeor and latent heat nudging (HLHN) developed at the National Center for Atmospheric Research (NCAR). It is revealed that excessively large relaxation coefficient forced the model to observations with a tendency greater than the physical terms of the convection, causing the dynamic imbalances and serious convection “ramp-down” right after the free forecast starts. Assimilating high update frequency radar data can make the tendency terms moderate and sustained thereby maintaining the assimilation effect and reducing fortuitous convection. HLHN requires a minimum continuous assimilation duration to contain the initial forced disturbance of the model. For a summer Meiyu precipitation case studied, the minimum duration is ~1 h. Appropriate selection of the HLHN parameters is able to effectively improve the temperature, humidity, and dynamic fields of the model. In addition, several issues still remain to be solved to further enhance HLHN.
Serial GANs: A Feature-Preserving Heterogeneous Remote Sensing Image Transformation Model

In recent years, the interpretation of SAR images has been significantly improved with the development of deep learning technology, and using conditional generative adversarial nets (CGANs) for SAR-to-optical transformation, also known as image translation, has become popular. Most of the existing image translation methods based on conditional generative adversarial nets are modified based on CycleGAN and pix2pix, focusing on style transformation in practice. In addition, SAR images and optical images are characterized by heterogeneous features and large spectral differences, leading to problems such as incomplete image details and spectral distortion in the heterogeneous transformation of SAR images in urban or semiurban areas and with complex terrain. Aiming to solve the problems of SAR-to-optical transformation, Serial GANs, a feature-preserving heterogeneous remote sensing image transformation model, is proposed in this paper for the first time. This model uses the Serial Despeckling GAN and Colorization GAN to complete the SAR-to-optical transformation. Despeckling GAN transforms the SAR images into optical gray images, retaining the texture details and semantic information. Colorization GAN transforms the optical gray images obtained in the first step into optical color images and keeps the structural features unchanged. The model proposed in this paper provides a new idea for heterogeneous image transformation. Through decoupling network design, structural detail information and spectral information are relatively independent in the process of heterogeneous transformation, thereby enhancing the detail information of the generated optical images and reducing its spectral distortion. Using SEN-2 satellite images as the reference, this paper compares the degree of similarity between the images generated by different models and the reference, and the results revealed that the proposed model has obvious advantages in feature reconstruction and the economical volume of the parameters. It also showed that Serial GANs have great potential in decoupling image transformation.
A New Analysis of Caldera Unrest through the Integration of Geophysical Data and FEM Modeling: The Long Valley Caldera Case Study

The Long Valley Caldera, located at the eastern edge of the Sierra Nevada range in California, has been in a state of unrest since the late 1970s. Seismic, gravity and geodetic data strongly suggest that the source of unrest is an intrusion beneath the caldera resurgent dome. However, it is not clear yet if the main contribution to the deformation comes from pulses of ascending high-pressure hydrothermal fluids or low viscosity magmatic melts. To characterize the nature of the intrusion, we developed a 3D finite element model which includes topography and crust heterogeneities. We first performed joint numerical inversions of uplift and Electronic Distance Measurement baseline length change data, collected during the period 1985–1999, to infer the deformation-source size, position, and overpressure. Successively, we used this information to refine the source overpressure estimation, compute the gravity potential and infer the intrusion density from the inversion of deformation and gravity data collected in 1982–1998. The deformation source is located beneath the resurgent dome, at a depth of 7.5 ± 0.5 km and a volume change of 0.21 ± 0.04 km3. We assumed a rhyolite compressibility of 0.026 ± 0.0011 GPa−1 (volume fraction of water between 0% and 30%) and estimated a reservoir compressibility of 0.147 ± 0.037 GPa−1. We obtained a density of 1856 ± 72 kg/m3. This density is consistent with a rhyolite melt, with 20% to 30% of dissolved hydrothermal fluids.
Branch-Pipe: Improving Graph Skeletonization around Branch Points in 3D Point Clouds

Modern plant phenotyping requires tools that are robust to noise and missing data, while being able to efficiently process large numbers of plants. Here, we studied the skeletonization of plant architectures from 3D point clouds, which is critical for many downstream tasks, including analyses of plant shape, morphology, and branching angles. Specifically, we developed an algorithm to improve skeletonization at branch points (forks) by leveraging the geometric properties of cylinders around branch points. We tested this algorithm on a diverse set of high-resolution 3D point clouds of tomato and tobacco plants, grown in five environments and across multiple developmental timepoints. Compared to existing methods for 3D skeletonization, our method efficiently and more accurately estimated branching angles even in areas with noisy, missing, or non-uniformly sampled data. Our method is also applicable to inorganic datasets, such as scans of industrial pipes or urban scenes containing networks of complex cylindrical shapes.
Cloud Seeding Evidenced by Coherent Doppler Wind Lidar

Evaluation of the cloud seeding effect is a challenge due to lack of directly physical observational evidence. In this study, an approach for directly observing the cloud seeding effect is proposed using a 1548 nm coherent Doppler wind lidar (CDWL). Normalized skewness was employed to identify the components of the reflectivity spectrum. The spectrum detection capability of a CDWL was verified by a 24.23-GHz Micro Rain Radar (MRR) in Hefei, China (117°15′ E, 31°50′ N), and different types of lidar spectra were detected and separated, including aerosol, turbulence, cloud droplet, and precipitation. Spectrum analysis was applied as a field experiment performed in Inner Mongolia, China (112°39′ E, 42°21′ N ) to support the cloud seeding operation for the 70th anniversary of China’s national day. The CDWL can monitor the cloud motion and provide windshear and turbulence information ensuring operation safety. The cloud-precipitation process is detected by the CDWL, microwave radiometer (MWR) and Advanced Geosynchronous Radiation Imager (AGRI) in FY4A satellites. In particular, the spectrum width and skewness of seeded cloud show a two-layer structure, which reflects cloud component changes, and it is possibly related to cloud seeding effects. Multi-component spectra are separated into four clusters, which are well distinguished by spectrum width and vertical velocity. In general, our findings provide new evidence that the reflectivity spectrum of CDWL has potential for assessing cloud seeding effects.
Sentinel-2 Cloud Removal Considering Ground Changes by Fusing Multitemporal SAR and Optical Images

Publicly available optical remote sensing images from platforms such as Sentinel-2 satellites contribute much to the Earth observation and research tasks. However, information loss caused by clouds largely decreases the availability of usable optical images so reconstructing the missing information is important. Existing reconstruction methods can hardly reflect the real-time information because they mainly make use of multitemporal optical images as reference. To capture the real-time information in the cloud removal process, Synthetic Aperture Radar (SAR) images can serve as the reference images due to the cloud penetrability of SAR imaging. Nevertheless, large datasets are necessary because existing SAR-based cloud removal methods depend on network training. In this paper, we integrate the merits of multitemporal optical images and SAR images to the cloud removal process, the results of which can reflect the ground information change, in a simple convolution neural network. Although the proposed method is based on deep neural network, it can directly operate on the target image without training datasets. We conduct several simulation and real data experiments of cloud removal in Sentinel-2 images with multitemporal Sentinel-1 SAR images and Sentinel-2 optical images. Experiment results show that the proposed method outperforms those state-of-the-art multitemporal-based methods and overcomes the constraint of datasets of those SAR-based methods.
Deep Learning-Based Instance Segmentation Method of Litchi Canopy from UAV-Acquired Images

Instance segmentation of fruit tree canopies from images acquired by unmanned aerial vehicles (UAVs) is of significance for the precise management of orchards. Although deep learning methods have been widely used in the fields of feature extraction and classification, there are still phenomena of complex data and strong dependence on software performances. This paper proposes a deep learning-based instance segmentation method of litchi trees, which has a simple structure and lower requirements for data form. Considering that deep learning models require a large amount of training data, a labor-friendly semi-auto method for image annotation is introduced. The introduction of this method allows for a significant improvement in the efficiency of data pre-processing. Facing the high requirement of a deep learning method for computing resources, a partition-based method is presented for the segmentation of high-resolution digital orthophoto maps (DOMs). Citrus data is added to the training set to alleviate the lack of diversity of the original litchi dataset. The average precision (AP) is selected to evaluate the metric of the proposed model. The results show that with the help of training with the litchi-citrus datasets, the best AP on the test set reaches 96.25%.
Facial Expression Recognition Using Enhanced Convolution Neural Network with Attention Mechanism

Facial Expression Recognition (FER) has been an interesting area of research in places where there is human-computer interaction. Human psychology, emotions and behaviors can be analyzed in FER. Classifiers used in FER have been perfect on normal faces but have been found to be constrained in occluded faces. Recently, Deep Learning Techniques (DLT) have gained popularity in applications of real-world problems including recognition of human emotions. The human face reflects emotional states and human intentions. An expression is the most natural and powerful way of communicating non-verbally. Systems which form communications between the two are termed Human Machine Interaction (HMI) systems. FER can improve HMI systems as human expressions convey useful information to an observer. This paper proposes a FER scheme called EECNN (Enhanced Convolution Neural Network with Attention mechanism) to recognize seven types of human emotions with satisfying results in its experiments. Proposed EECNN achieved 89.8% accuracy in classifying the images.
Real-time motion tracking enhancement via data-fusion based particle filter

: Motion tracking is a well-defined yet application-specific problem of computer vision field, mostly entailing real-time constraints. Methods addressing such problems are expected also to ensure achievements such as high accuracy and robustness. A probabilistic estimation-based approach is proposed in this paper, in order to enhance the real-time motion tracking process of an RGB-Depth device, in terms of accuracy. A novel method is presented for tracking hand-palm of a moving human subject to this end, under a sequence of assumptions such as indoor environment, single object, smooth movement and stable illumination. Tracking accuracy is improved within a particle filter framework by fusing device output with the newly extracted information from RGB and depth images. Experimental results are shared revealing the advantages of the proposed method over the built-in device algorithms. The results demonstrate that the proposed method produces smaller RMSE values both for single implementations and multiexecution trials without violating real-time constraints.
The Fusion Strategy of 2D and 3D Information Based on Deep Learning: A Review

Recently, researchers have realized a number of achievements involving deep-learning-based neural networks for the tasks of segmentation and detection based on 2D images, 3D point clouds, etc. Using 2D and 3D information fusion for the advantages of compensation and accuracy improvement has become a hot research topic. However, there are no critical reviews focusing on the fusion strategies of 2D and 3D information integration based on various data for segmentation and detection, which are the basic tasks of computer vision. To boost the development of this research domain, the existing representative fusion strategies are collected, introduced, categorized, and summarized in this paper. In addition, the general structures of different kinds of fusion strategies were firstly abstracted and categorized, which may inspire researchers. Moreover, according to the methods included in this paper, the 2D information and 3D information of different methods come from various kinds of data. Furthermore, suitable datasets are introduced and comparatively summarized to support the relative research. Last but not least, we put forward some open challenges and promising directions for future research.