Reviewerly/exHarmony huggingface dataset:
Improving Multiple Pedestrian Tracking by Track Management and Occlusion Handling

Multi-pedestrian trackers perform well when targets are clearly visible making the association task quite easy. However, when heavy occlusions are present, a mechanism to re-identify persons is needed. The common approach is to extract visual features from new detections and compare them with the features of previously found tracks. Since those detections can have substantial overlaps with nearby targets – especially in crowded scenarios – the extracted features are insufficient for a reliable re-identification. In contrast, we propose a novel occlusion handling strategy that explicitly models the relation between occluding and occluded tracks outperforming the feature-based approach, while not depending on a separate re-identification network. Furthermore, we improve the track management of a regression-based method in order to bypass missing detections and to deal with tracks leaving the scene at the border of the image. Finally, we apply our tracker in both temporal directions and merge tracklets belonging to the same target, which further enhances the performance. We demonstrate the effectiveness of our tracking components with ablative experiments and surpass the state-of-the-art methods on the three popular pedestrian tracking benchmarks MOT16, MOT17, and MOT20.
Offboard 3D Object Detection from Point Cloud Sequences

While current 3D object recognition research mostly focuses on the real-time, onboard scenario, there are many offboard use cases of perception that are largely underexplored, such as using machines to automatically generate high-quality 3D labels. Existing 3D object detectors fail to satisfy the high-quality requirement for offboard uses due to the limited input and speed constraints. In this paper, we propose a novel offboard 3D object detection pipeline using point cloud sequence data. Observing that different frames capture complementary views of objects, we design the offboard detector to make use of the temporal points through both multi-frame object detection and novel objectcentric refinement models. Evaluated on the Waymo Open Dataset, our pipeline named 3D Auto Labeling shows significant gains compared to the state-of-the-art onboard detectors and our offboard baselines. Its performance is even on par with human labels verified through a human label study. Further experiments demonstrate the application of auto labels for semi-supervised learning and provide extensive analysis to validate various design choices.
ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flows

Universal style transfer retains styles from reference images in content images. While existing methods have achieved state-of-the-art style transfer performance, they are not aware of the content leak phenomenon that the image content may corrupt after several rounds of stylization process. In this paper, we propose ArtFlow to prevent content leak during universal style transfer. ArtFlow consists of reversible neural flows and an unbiased feature transfer module. It supports both forward and backward inferences and operates in a projection-transfer-reversion scheme. The forward inference projects input images into deep features, while the backward inference remaps deep features back to input images in a lossless and unbiased way. Extensive experiments demonstrate that ArtFlow achieves comparable performance to state-of-the-art style transfer methods while avoiding content leak.
Graph Neural Networks for Anomaly Detection in Industrial Internet of Things

The Industrial Internet of Things (IIoT) plays an important role in digital transformation of traditional industries toward Industry 4.0. By connecting sensors, instruments, and other industry devices to the Internet, IIoT facilitates the data collection, data analysis, and automated control, thereby improving the productivity and efficiency of the business as well as the resulting economic benefits. Due to the complex IIoT infrastructure, anomaly detection becomes an important tool to ensure the success of IIoT. Due to the nature of IIoT, graph-level anomaly detection has been a promising means to detect and predict anomalies in many different domains, such as transportation, energy, and factory, as well as for dynamically evolving networks. This article provides a useful investigation on graph neural networks (GNNs) for anomaly detection in IIoT-enabled smart transportation, smart energy, and smart factory. In addition to the GNN-empowered anomaly detection solutions on point, contextual, and collective types of anomalies, useful data sets, challenges, and open issues for each type of anomalies in the three identified industry sectors (i.e., smart transportation, smart energy, and smart factory) are also provided and discussed, which will be useful for future research in this area. To demonstrate the use of GNN in concrete scenarios, we show three case studies in smart transportation, smart energy, and smart factory, respectively.
SAR-U-Net: Squeeze-and-excitation block and atrous spatial pyramid pooling based residual U-Net for automatic liver segmentation in Computed Tomography

Liver segmentation is an essential prerequisite for liver cancer diagnosis and surgical planning. Traditionally, liver contour is delineated manually by radiologist in a slice-by-slice fashion. However, this process is time-consuming and prone to errors depending on radiologist's experience. In this paper, a modified U-Net based framework is presented, which leverages techniques from Squeeze-and-Excitation (SE) block, Atrous Spatial Pyramid Pooling (ASPP) and residual learning for accurate and robust liver Computed Tomography (CT) segmentation, and the effectiveness of the proposed method was tested on two public datasets LiTS17 and SLiver07. A new network architecture, called SAR-U-Net was designed, which is grounded in the classical U-Net. Firstly, the SE block is introduced to adaptively extract image features after each convolution in the U-Net encoder, while suppressing irrelevant regions, and highlighting features of specific segmentation task; Secondly, the ASPP is employed to replace the transition layer and the output layer, and acquire multi-scale image information via different receptive fields. Thirdly, to alleviate the gradient vanishment problem, the traditional convolution block is replaced with the residual structures, and thus prompt the network to gain accuracy from considerably increased depth. In the LiTS17 database experiment, five popular metrics were used for evaluation, including Dice coefficient, VOE, RVD, ASD and MSD. Compared with other closely related models, the proposed method achieved the highest accuracy. In addition, in the experiment of the SLiver07 dataset, compared with other closely related models, the proposed method achieved the highest segmentation accuracy except for the RVD. An improved U-Net network combining SE, ASPP, and residual structures is developed for automatic liver segmentation from CT images. This new model shows a great improvement on the accuracy compared to other closely related models, and its robustness to challenging problems, including small liver regions, discontinuous liver regions, and fuzzy liver boundaries, is also well demonstrated and validated.
Stim: a fast stabilizer circuit simulator

This paper presents ``Stim", a fast simulator for quantum stabilizer circuits. The paper explains how Stim works and compares it to existing tools. With no foreknowledge, Stim can analyze a distance 100 surface code circuit (20 thousand qubits, 8 million gates, 1 million measurements) in 15 seconds and then begin sampling full circuit shots at a rate of 1 kHz. Stim uses a stabilizer tableau representation, similar to Aaronson and Gottesman's CHP simulator, but with three main improvements. First, Stim improves the asymptotic complexity of deterministic measurement from quadratic to linear by tracking the {\em inverse} of the circuit's stabilizer tableau. Second, Stim improves the constant factors of the algorithm by using a cache-friendly data layout and 256 bit wide SIMD instructions. Third, Stim only uses expensive stabilizer tableau simulation to create an initial reference sample. Further samples are collected in bulk by using that sample as a reference for batches of Pauli frames propagating through the circuit.
Blockchain-enabled Peer-to-Peer energy trading

The increasing amount of distributed power generation from rooftop solar panels allows new electricity markets to emerge in which prosumers and consumers can trade locally produced energy. The use of blockchain technology has increasingly emerged in energy markets and shows great potential to facilitate Peer-to-Peer energy trading. However, blockchain technology is still in its infancy meaning it is not yet being used to its' full potential. In this paper, blockchain technology for Peer-to-Peer energy trading and its implications are explored, especially in view of the 'trilemma': scalability, security, and decentralisation. Peer-to-Peer energy trading is the focus of this paper, which ultimately proposes a blockchain scalability solution. This solution is empirically modelled using data collected in a trial case study. The proposed solution increases scalability without compromising security and decentralisation when compared to base layer models.
Confidence interval for micro-averaged F1 and macro-averaged F1 scores

A binary classification problem is common in medical field, and we often use sensitivity, specificity, accuracy, negative and positive predictive values as measures of performance of a binary predictor. In computer science, a classifier is usually evaluated with precision (positive predictive value) and recall (sensitivity). As a single summary measure of a classifier's performance, F1 score, defined as the harmonic mean of precision and recall, is widely used in the context of information retrieval and information extraction evaluation since it possesses favorable characteristics, especially when the prevalence is low. Some statistical methods for inference have been developed for the F1 score in binary classification problems; however, they have not been extended to the problem of multi-class classification. There are three types of F1 scores, and statistical properties of these F1 scores have hardly ever been discussed. We propose methods based on the large sample multivariate central limit theorem for estimating F1 scores with confidence intervals.
Simulating 2D Effects in Lattice Gauge Theories on a Quantum Computer

Quantum computing is in its greatest upswing, with so-called noisy-intermediate-scale-quantum devices heralding the computational power to be expected in the near future. While the field is progressing toward quantum advantage, quantum computers already have the potential to tackle classically intractable problems. Here, we consider gauge theories describing fundamental-particle interactions. On the way to their full-fledged quantum simulations, the challenge of limited resources on near-term quantum devices has to be overcome. We propose an experimental quantum simulation scheme to study ground-state properties in two-dimensional quantum electrodynamics (2D QED) using existing quantum technology. Our protocols can be adapted to larger lattices and offer the perspective to connect the lattice simulation to low-energy observable quantities, e.g., the hadron spectrum, in the continuum theory. By including both dynamical matter and a nonminimal gauge-field truncation, we provide the novel opportunity to observe 2D effects on present-day quantum hardware. More specifically, we present two variational-quantum-eigensolver- (VQE) based protocols for the study of magnetic field effects and for taking an important first step toward computing the running coupling of QED. For both instances, we include variational quantum circuits for qubit-based hardware. We simulate the proposed VQE experiments classically to calculate the required measurement budget under realistic conditions. While this feasibility analysis is done for trapped ions, our approach can be directly adapted to other platforms. The techniques presented here, combined with advancements in quantum hardware, pave the way for reaching beyond the capabilities of classical simulations.5 MoreReceived 21 August 2020Accepted 4 August 2021DOI:https://doi.org/10.1103/PRXQuantum.2.030334Published by the American Physical Society under the terms of the Creative Commons Attribution 4.0 International license. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.Published by the American Physical SocietyPhysics Subject Headings (PhySH)Research AreasQuantum algorithmsQuantum computationQuantum simulationQuantum Information
The processing methods of geochemical exploration data: past, present, and future

Geochemical exploration data is popular in mineral exploration in that it plays a notable role in discovering unknown mineral deposits. In this study, we review the state-of-the-art popular methods for processing geochemical exploration data and for identifying geochemical anomalies associated with mineralization. The distribution laws of geochemical elements concentrations, including normal, log-normal, power-law, and multimodal and complex distributions, have been extensively studied over the past several decades. Accordingly, methods for processing geochemical exploration data have shifted from classic statistics, multivariate statistics, geostatistics, to fractal/multifractal models and machine learning algorithms. Geochemical exploration data, as compositional data, suffer from the closure problem. We need first to open them using logratio transformation. In the future, deep learning algorithms will become a popular technique for mining geochemical exploration data and for extracting targets associated with mineralization in mineral exploration.
Balance learning for ship detection from synthetic aperture radar remote sensing imagery

Synthetic aperture radar (SAR) is playing an important role in maritime domain awareness. As a fundamental ocean mission, SAR ship detection can offer high-quality services for marine surveillance. It receives widespread concern in the SAR remote sensing community. Recently, deep learning (DL) has greatly improved SAR ship detection accuracy. However, there are still some unperceived imbalance problems that seriously hinder further accuracy improvements among current DL-based SAR ship detectors. Therefore, we propose a novel concept of balance learning (BL) for high-quality SAR ship detection. We first point out the four unperceived imbalance problems, i.e., image sample scene imbalance, positive negative sample imbalance, ship scale feature imbalance, and classification regression task imbalance. Then, we offer some profound insights into these imbalances. Immediately, we propose four effective solutions to handle the above four imbalances correspondingly, i.e., balance scene learning mechanism (BSLM), balance interval sampling mechanism (BISM), balance feature pyramid network (BFPN), and balance classification regression network (BCRN). Finally, combined with the four solutions, a novel balance learning network (BL-Net) is proposed. Ablation studies can confirm each solution’s effectiveness. Experimental results on five open datasets (SSDD, Gaofen-SSDD, Sentinel-SSDD, SAR-Ship-Dataset, and HRSID) reveal BL-Net’s state-of-the-art SAR ship detection performance compared to the other 30 DL-based SAR ship detectors. Specifically, in contrast to the current most competitive method, the accuracy increase of BL-Net is 2.98% on SSDD, 1.97% on Gaofen-SSDD, 1.49% on Sentinel-SSDD, 0.55% on SAR-Ship-Dataset, and 4.95% on HRSID. Last but not least, the satisfactory ship detection results on another two large-scene Sentinal-1 SAR images confirm BL-Net’s strong migration capability. This indicates BL-Net’s potential value in marine surveillance.
Explainable AI (XAI): A systematic meta-survey of current challenges and future opportunities

The past decade has seen significant progress in artificial intelligence (AI), which has resulted in algorithms being adopted for resolving a variety of problems. However, this success has been met by increasing model complexity and employing black-box AI models that lack transparency. In response to this need, Explainable AI (XAI) has been proposed to make AI more transparent and thus advance the adoption of AI in critical domains. Although there are several reviews of XAI topics in the literature that have identified challenges and potential research directions of XAI, these challenges and research directions are scattered. This study, hence, presents a systematic meta-survey of challenges and future research directions in XAI organized in two themes: (1) general challenges and research directions of XAI and (2) challenges and research directions of XAI based on machine learning life cycle’s phases: design, development, and deployment. We believe that our meta-survey contributes to XAI literature by providing a guide for future exploration in the XAI area.
Exemplar Fine-Tuning for 3D Human Model Fitting Towards In-the-Wild 3D Human Pose Estimation

Differently from 2D image datasets such as COCO, largescale human datasets with 3D ground-truth annotations are very difficult to obtain in the wild. In this paper, we address this problem by augmenting existing 2D datasets with high-quality 3D pose fits. Remarkably, the resulting annotations are sufficient to train from scratch 3D pose regressor networks that outperform the current state-of-the-art on in the-wild benchmarks such as 3DPW. Additionally, training on our augmented data is straightforward as it does not require to mix multiple and incompatible 2D and 3D datasets or to use complicated network architectures and training procedures. This simplified pipeline affords additional improvements, including injecting extreme crop augmentations to better reconstruct highly truncated people, and incorporating auxiliary inputs to improve 3D pose estimation accuracy. It also reduces the dependency on 3D datasets such as H36M that have restrictive licenses. We also use our method to introduce new benchmarks for the study of real-world challenges such as occlusions, truncations, and rare body poses. In order to obtain such high quality 3D pseudo-annotations, inspired by progress in internal learning, we introduce Exemplar Fine-Tuning (EFT). EFT combines the re-projection accuracy of fitting methods like SMPLify with a 3D pose prior implicitly captured by a pre-trained 3D pose regressor network. We show that EFT produces 3D annotations that result in better downstream performance and are qualitatively preferable in an extensive human-based assessment.
Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

This article presents a transformer and convolutional neural network (CNN) hybrid deep neural network for semantic segmentation of very high resolution (VHR) remote sensing imagery. The model follows an encoder–decoder structure. The encoder module uses a new universal backbone Swin transformer to extract features to achieve better long-range spatial dependencies modeling. The decoder module draws on some effective blocks and successful strategies of CNN-based models in remote sensing image segmentation. In the middle of the framework, an atrous spatial pyramid pooling block based on depthwise separable convolution (SASPP) is applied to obtain a multiscale context. A U-shaped decoder is used to gradually restore the size of the feature maps. Three skip connections are built between the encoder and decoder feature maps of the same size to maintain the transmission of local details and enhance the communication of multiscale features. A squeeze-and-excitation (SE) channel attention block is added before segmentation for feature augmentation. An auxiliary boundary detection branch is combined to provide edge constraints for semantic segmentation. Extensive ablation experiments were conducted on the International Society for Photogrammetry and Remote Sensing (ISPRS) Vaihingen and Potsdam benchmarks to test the effectiveness of multiple components of the network. At the same time, the proposed method is compared with the current state-of-the-art methods on the two benchmarks. The proposed hybrid network achieved the second highest overall accuracy (OA) on both the Potsdam and Vaihingen benchmarks (code and models are available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/zq7734509/mmsegmentation-</uri> multilayer).
The dawn of digital public health in Europe: Implications for public health policy and practice

The COVID-19 pandemic has highlighted the importance of digital health technologies and the role of effective surveillance systems. While recent events have accelerated progress towards the expansion of digital public health (DPH), there remains significant untapped potential in harnessing, leveraging, and repurposing digital technologies for public health. There is a particularly growing need for comprehensive action to prepare citizens for DPH, to regulate and effectively evaluate DPH, and adopt DPH strategies as part of health policy and services to optimise health systems improvement. As representatives of the European Public Health Association's (EUPHA) Digital Health Section, we reflect on the current state of DPH, share our understanding at the European level, and determine how the application of DPH has developed during the COVID-19 pandemic. We also discuss the opportunities, challenges, and implications of the increasing digitalisation of public health in Europe.
Edge Computing Driven Low-Light Image Dynamic Enhancement for Object Detection

With fast increase in volume of mobile multimedia data, how to apply powerful deep learning methods to process data with real-time response becomes a major issue. Meanwhile, edge computing structure helps improve response time and user experience by bringing flexible computation and storage capabilities. Considering both technologies for successful AI-based applications, we propose an edge-computing driven and end-to-end framework to perform tasks of image enhancement and object detection under low-light conditions. The framework consists of a cloud-based enhancement and an edge-based detection stage. In the first stage, we establish connections between edge devices and cloud servers to input re-scaled illumination parts of low-light images, where enhancement subnetworks are dynamically and parallel coupled to compute enhanced illumination parts based on low-light context. During the edge-based detection stage, edge devices could accurately and rapidly detect objects based on cloud-computed informative feature map. Experimental results show the proposed method significantly improves detection performance in low-light conditions with low latency running on edge devices.