Miracle-dz/UniFAR-FTUs huggingface dataset:
Towards a Framework for Cloud Computing use by Governments: Leaders, Followers and Laggers

There are large varieties of governmental organizations using clouds in different ways. The purpose of this article is to explore and classify the types of public organizations using cloud computing. This will help to improve our understanding of cloud adoption and use by governments. For this, a systematic review of literature on cloud government (CloudGov) was performed by searching for articles in several databases. The review resulted into the main elements of the framework for classifying cloud use. In addition, using diffusion of innovation and institutional theory a categorization of public organizations was made. When applying the CloudGov framework empirically in government organizations, we identified three types of organizations: Leaders, Followers and Laggers. The types differ in various ways including their technology expertise, attitude towards innovation and level of political support. In further research, we recommend investigating which drivers influence the type of CloudGov users and generalize the framework to other contexts.
Analyzing Brexit’s impact using sentiment analysis and topic modeling on Twitter discussion

In this paper we evaluate public sentiment and opinion on Brexit during September and October 2019 by collecting over 16 million user messages from Twitter - world’s largest online micro-blogging service. We perform sentiment analysis using the Python VADER library, and topic modeling using Latent Dirichlet Allocation function of the gensim library. Through sentiment analysis, we quantify daily public sentiment towards Brexit and use it to evaluate Brexit’s impact on the British currency exchange rate and stock markets in Britain. With the aid of topic modeling, we discover the most popular daily topics of discussion on Twitter using the keyword ”Brexit”. Some of our findings include the discovery of positive correlation between Twitter sentiment towards Brexit and British pound sterling exchange rate. We also found daily discussion topics on Twitter, identified through unsupervised machine learning to be a good proxy of important current events related with Brexit.
KDetect: Unsupervised Anomaly Detection for Cloud Systems Based on Time Series Clustering

To improve the user experience in Cloud systems, it is of major interest for Cloud management tools to be able to automatically detect and notify anomalies in the behavior of services executed in virtual machines in a non-intrusive manner. To this end, this paper presents KDetect, an unsupervised learning algorithm to detect anomalies in periodic time series using clustering techniques. Using unlabeled time series representing the resource consumption of an unknown service executing in a virtual machine as input, KDetect is able to identify patterns that correspond to anomalies in the behavior of that service, assuming that the service behaves normally most of the time. Our evaluation, run with data extracted from a production dataset and coming from virtual machines exhibiting very different normal and abnormal behaviors, shows that KDetect is able to achieve a very high accuracy in the detection of anomalies (with more than 98% of recall and precision in most cases).
Transfer Learning Approach for Botnet Detection Based on Recurrent Variational Autoencoder

Machine Learning (ML) methods have been widely used in Intrusion Detection Systems (IDS). In particular, many botnet detection methods are based on ML. However, due to the fast-evolving nature of network security threats, it is necessary to frequently retrain the ML tools with up-to-date data, especially because data labeling takes a long time and requires a lot of effort, making it difficult to generate training data. We propose transfer learning as a more effective approach for botnet detection, as it can learn from well curated source data and transfer the knowledge to a target problem domain not seen before. We devise an approach that is effective regardless whether or not the data from the target domain is labeled. More specifically, we train a neural network with the Recurrrent Variation Autoencoder (RVAE) structure on the source data, and use RVAE to compute anomaly scores for data records from the target domain. In an evaluation of this transfer learning framework, we use CTU-13 dataset as a source domain and a fresh set of network monitoring data as a target domain. Tests show that the proposed transfer learning method is able to detect botnets better than semi-supervised learning method that was trained on the target domain data. The area under Receiver Operating Characteristic is 0.810 for transfer learning, and 0.779 for directly using RVAE on the target domain data.
Hyperspectral Image Classification Based on a Shuffled Group Convolutional Neural Network with Transfer Learning

Convolutional neural networks (CNNs) have been widely applied in hyperspectral imagery (HSI) classification. However, their classification performance might be limited by the scarcity of labeled data to be used for training and validation. In this paper, we propose a novel lightweight shuffled group convolutional neural network (abbreviated as SG-CNN) to achieve efficient training with a limited training dataset in HSI classification. SG-CNN consists of SG conv units that employ conventional and atrous convolution in different groups, followed by channel shuffle operation and shortcut connection. In this way, SG-CNNs have less trainable parameters, whilst they can still be accurately and efficiently trained with fewer labeled samples. Transfer learning between different HSI datasets is also applied on the SG-CNN to further improve the classification accuracy. To evaluate the effectiveness of SG-CNNs for HSI classification, experiments have been conducted on three public HSI datasets pretrained on HSIs from different sensors. SG-CNNs with different levels of complexity were tested, and their classification results were compared with fine-tuned ShuffleNet2, ResNeXt, and their original counterparts. The experimental results demonstrate that SG-CNNs can achieve competitive classification performance when the amount of labeled data for training is poor, as well as efficiently providing satisfying classification results.
Ship Recognition from Chaff Clouds with Sophisticated Polarimetric Decomposition

Ship recognition from chaff cloud jamming is challenging since they have similar dimensions and radar cross sections. In this paper, a polarimetric recognition technique with sophisticated polarimetric decomposition is proposed. To this end, a seven-component model-based decomposition is first put forward by integrating three sophisticated scattering models, thus the dominant and local scattering of ships can be characterized accurately. According to the derived scattering contributions, a robust discrimination feature is then designed based on the concept of contrast and suppression. Coupled with the average scattering angle estimated from eigen-based decomposition, the constructed feature vector is inputted into the support vector machine and the recognition is finally fulfilled. The proposed method is tested on simulated and real polarimetric radar data and the results demonstrate that the proposed method achieves the highest recognition rate of over 98%, which outperforms the state-of-the-art methods.
Estimating Yields of Household Fields in Rural Subsistence Farming Systems to Study Food Security in Burkina Faso

Climate change has an increasing impact on food security and child nutrition, particularly among rural smallholder farmers in sub-Saharan Africa. Their limited resources and rainfall dependent farming practices make them sensitive to climate change-related effects. Data and research linking yield, human health, and nutrition are scarce but can provide a basis for adaptation and risk management strategies. In support of studies on child undernutrition in Burkina Faso, this study analyzed the potential of remote sensing-based yield estimates at household level. Multi-temporal Sentinel-2 data from the growing season 2018 were used to model yield of household fields (median 1.4 hectares (ha), min 0.01 ha, max 12.6 ha) for the five most prominent crops in the Nouna Health and Demographic Surveillance (HDSS) area in Burkina Faso. Based on monthly metrics of vegetation indices (VIs) and in-situ harvest measurements from an extensive field survey, yield prediction models for different crops of high dietary importance (millet, sorghum, maize, and beans) were successfully generated producing R² between 0.4 and 0.54 (adj. R² between 0.32 and 0.5). The models were spatially applied and resulted in a yield estimation map at household level, enabling predictions of up to 2 months prior to harvest. The map links yield on a 10-m spatial resolution to households and consequently can display potential food insecurity. The results highlight the potential for satellite imagery to provide yield predictions of smallholder fields and are discussed in the context of health-related studies such as child undernutrition and food security in rural Africa under climate change.
A Hybrid Approach Combining Conceptual Hydrological Models, Support Vector Machines and Remote Sensing Data for Rainfall-Runoff Modeling

Understanding catchment response to rainfall events is important for accurate runoff estimation in many water-related applications, including water resources management. This study introduced a hybrid model, the Tank-least squared support vector machine (LSSVM), that incorporated intermediate state variables from a conceptual tank model within the least squared support vector machine (LSSVM) framework in order to describe aspects of the rainfall-runoff (RR) process. The efficacy of the Tank-LSSVM model was demonstrated with hydro-meteorological data measured in the Yongdam Catchment between 2007 and 2016, South Korea. We first explored the role of satellite soil moisture (SM) data (i.e., European Space Agency (ESA) CCI) in the rainfall-runoff modeling. The results indicated that the SM states inferred from the ESA CCISWI provided an effective means of describing the temporal dynamics of SM. Further, the Tank-LSSVM model’s ability to simulate daily runoff was assessed by using goodness of fit measures (i.e., root mean square error, Nash Sutcliffe coefficient (NSE), and coefficient of determination). The Tank-LSSVM models’ NSE were all classified as “very good” based on their performance during the training and testing periods. Compared to individual LSSVM and Tank models, improved daily runoff simulations were seen in the proposed Tank-LSSVM model. In particular, low flow simulations demonstrated the improvement of the Tank-LSSVM model compared to the conventional tank model.
The Performance Analysis of INS/GNSS/V-SLAM Integration Scheme Using Smartphone Sensors for Land Vehicle Navigation Applications in GNSS-Challenging Environments

Modern smartphones contain embedded global navigation satellite systems (GNSSs), inertial measurement units (IMUs), cameras, and other sensors which are capable of providing user position, velocity, and attitude. However, it is difficult to utilize the actual navigation performance capabilities of smartphones due to the low-cost and disparate sensors, software technologies adopted by manufacturers, and the significant influence of environmental conditions. In this study, we proposed a scheme that integrated sensor data from smartphone IMUs, GNSS chipsets, and cameras using an extended Kalman filter (EKF) to enhance the navigation performance. The visual data from the camera was preprocessed using oriented FAST (Features from accelerated segment test) and rotated BRIEF (Binary robust independent elementary features)-simultaneous localization and mapping (ORB-SLAM), rescaled by applying GNSS measurements, and converted to velocity data before being utilized to update the integration filter. In order to verify the performance of the integrated system, field test data was collected in a downtown area of Tainan City, Taiwan. Experimental results indicated that visual data contributed significantly to improving the accuracy of the navigation performance, demonstrating improvements of 43.0% and 51.3% in position and velocity, respectively. It was verified that the proposed integrated system, which used data from smartphone sensors, was efficient in terms of increasing navigation accuracy in GNSS-challenging environments.
Change Detection Techniques Based on Multispectral Images for Investigating Land Cover Dynamics

Satellite images provide an accurate, continuous, and synoptic view of seamless global extent. Within the fields of remote sensing and image processing, land surface change detection (CD) has been amongst the most discussed topics. This article reviews advances in bitemporal and multitemporal two-dimensional CD with a focus on multispectral images. In addition, it reviews some CD techniques used for synthetic aperture radar (SAR). The importance of data selection and preprocessing for CD provides a starting point for the discussion. CD techniques are, then, grouped based on the change analysis products they can generate to assist users in identifying suitable procedures for their applications. The discussion allows users to estimate the resources needed for analysis and interpretation, while selecting the most suitable technique for generating the desired information such as binary changes, direction or magnitude of changes, “from-to” information of changes, probability of changes, temporal pattern, and prediction of changes. The review shows that essential and innovative improvements are being made in analytical processes for multispectral images. Advantages, limitations, challenges, and opportunities are identified for understanding the context of improvements, and this will guide the future development of bitemporal and multitemporal CD methods and techniques for understanding land cover dynamics.
The Context-Dependent Effect of Urban Form on Air Pollution: A Panel Data Analysis

There have been debates and a lack of understanding about the complex effects of urban-scale urban form on air pollution. Based on the remotely sensed data of 150 cities in the Beijing-Tianjin-Hebei agglomeration in China from 2000 to 2015, we studied the effects of urban form on fine particulate matter (PM2.5) and nitrogen dioxide (NO2) concentrations from multiple perspectives. The panel models show that the elastic coefficients of aggregation index and fractal dimension are the highest among all factors for the whole region. Population density, aggregation index, and fractal dimension have stronger influences on air pollution in small cities, while area size demonstrates the opposite effect. Population density has a stronger impact on medium/high-elevation cities, while night light intensity (NLI), fractal dimension, and area size show the opposite effect. Low road network density can enlarge the influence magnitude of NLI and population density. The results of the linear regression model with multiplicative interactions provide evidence of interactions between population density and NLI or aggregation index. The slope of the line that captures the relationship between NLI on PM2.5 is positive at low levels of population density, flat at medium levels of population density, and negative at high levels of population density. The study results also show that when increasing the population density, the air pollution in a city with low economic and low morphological aggregation degrees will be impacted more greatly.
Detailed Lacustrine Calving Iceberg Inventory from Very High Resolution Optical Imagery and Object-Based Image Analysis

In the field of iceberg and glacier calving studies, it is important to collect comprehensive datasets of populations of icebergs. Particularly, calving of lake-terminating glaciers has been understudied. The aim of this work is to present an object-based method of iceberg detection and to create an inventory of icebergs located in a proglacial lagoon of San Quintín glacier, Northern Patagonia Icefield, Chile. This dataset is created using high-resolution WorldView-2 imagery and a derived DEM. We use it to briefly discuss the iceberg size distribution and area–volume scaling. Segmentation of the multispectral imagery produced a map of objects, which were classified with use of Random Forest supervised classification algorithm. An intermediate classification product was corrected with a ruleset exploiting contextual information and a watershed algorithm that was used to divide multiple touching icebergs into separate objects. Common theoretical heavy-tail statistical distributions were tested as descriptors of iceberg area and volume distributions. Power law models were proposed for the area–volume relationship. The proposed method performed well over the open lake detecting correctly icebergs in all size bands except 5–15 m2 where many icebergs were missed. A section of the lagoon with ice melange was not reliably mapped due to uniformity of the area in the imagery and DEM. The precision of the DEM limited the scaling effort to icebergs taller than 1.7 m and larger than 99 m2, despite the inventory containing icebergs as small as 4 m2. The work demonstrates viability of object-based analysis for lacustrine iceberg detection and shows that the statistical properties of iceberg population at San Quintín glacier match those of populations produced by tidewater glaciers.
Towards Tree Green Crown Volume: A Methodological Approach Using Terrestrial Laser Scanning

Crown volume is a tree attribute relevant in a number of contexts, including photosynthesis and matter production, storm resistance, shadowing of lower layers, habitat for various taxa. While commonly the total crown volume is being determined, for example by wrapping a convex hull around the crown, we present here a methodological approach towards assessing the tree green crown volume (TGCVol), the crown volume with a high density of foliage, which we derive by terrestrial laser scanning in a case study of solitary urban trees. Using the RGB information, we removed the hits on stem and branches within the tree crown and used the remaining leaf hits to determine TGCVol from k-means clustering and convex hulls for the resulting green 3D clusters. We derived a tree green crown volume index (TGCVI) relating the green crown volume to the total crown volume. This TGCVI is a measure of how much a crown is “filled with green” and scale-dependent (a function of specifications of the k-means clustering). Our study is a step towards a standardized assessment of tree green crown volume. We do also address a number of remaining methodological challenges.
Exploring TanDEM-X Interferometric Products for Crop-Type Mapping

The application of satellite single-pass interferometric data to crop-type mapping is demonstrated for the first time in this work. A set of nine TanDEM-X dual-pol pairs of images acquired during its science phase, from June to August 2015, is exploited for this purpose. An agricultural site located in Sevilla (Spain), composed of fields of 13 different crop species, is employed for validation. Sets of input features formed by polarimetric and interferometric observables are tested for crop classification, including single-pass coherence and repeat-pass coherence formed by consecutive images. The backscattering coefficient at HH and VV channels and the correlation between channels form the set of polarimetric features employed as a reference set upon which the added value of interferometric coherence is evaluated. The inclusion of single-pass coherence as feature improves by 2% the overall accuracy (OA) with respect to the reference case, reaching 92%. More importantly, in single-pol configurations OA increases by 10% for the HH channel and by 8% for the VV channel, reaching 87% and 88%, respectively. Repeat-pass coherence also improves the classification performance, but with final scores slightly worse than with single-pass coherence. However, it improves the individual performance of the backscattering coefficient by 6–7%. Furthermore, in products evaluated at field level the dual-pol repeat-pass coherence features provide the same score as single-pass coherence features (overall accuracy above 94%). Consequently, the contribution of interferometry, both single-pass and repeat-pass, to crop-type mapping is proved.
Is Radar Phase Information Useful for Sea Ice Detection in the Marginal Ice Zone?

With continuing sea ice reductions in the Arctic, dynamic physical and ecological processes have more active roles compared to the ice-locked, isolated Arctic Ocean of previous decades. To better understand these changes, observations of high-resolution sea ice conditions are needed. Remote sensing is a useful tool for observations in the harsh Arctic environment. For unsupervised ice detection, we demonstrate the promising value of radar phase difference from polarimetric radar measurements in this study, based on full polarimetric complex RADARSAT-2 SAR images in the marginal ice zone. It is demonstrated that the phase difference from co-polarized and cross-polarized synthetic aperture radar (SAR) images show promising capability for high resolution sea ice discrimination from open water. In particular, the phase difference shows superior potential for the detection of frazil ice compared to the traditional methodology based on the radar intensity ratio. The relationship between phase difference and radar incidence angle is also analyzed, as well as the potential influence of high sea state. The new methodology provides an additional tool for ice detection. In order to make the best use of this tool, directions for further studies are discussed for operational ice detection and possible ice classification.
Predicting Complete Remission of Acute Myeloid Leukemia: Machine Learning Applied to Gene Expression

Machine learning (ML) is a useful tool for advancing our understanding of the patterns and significance of biomedical data. Given the growing trend on the application of ML techniques in precision medicine, here we present an ML technique which predicts the likelihood of complete remission (CR) in patients diagnosed with acute myeloid leukemia (AML). In this study, we explored the question of whether ML algorithms designed to analyze gene-expression patterns obtained through RNA sequencing (RNA-seq) can be used to accurately predict the likelihood of CR in pediatric AML patients who have received induction therapy. We employed tests of statistical significance to determine which genes were differentially expressed in the samples derived from patients who achieved CR after 2 courses of treatment and the samples taken from patients who did not benefit. We tuned classifier hyperparameters to optimize performance and used multiple methods to guide our feature selection as well as our assessment of algorithm performance. To identify the model which performed best within the context of this study, we plotted receiver operating characteristic (ROC) curves. Using the top 75 genes from the k-nearest neighbors algorithm (K-NN) model (K = 27) yielded the best area-under-the-curve (AUC) score that we obtained: 0.84. When we finally tested the previously unseen test data set, the top 50 genes yielded the best AUC = 0.81. Pathway enrichment analysis for these 50 genes showed that the guanosine diphosphate fucose (GDP-fucose) biosynthesis pathway is the most significant with an adjusted P value = . 0092, which may suggest the vital role of N-glycosylation in AML.