nils-herrmann/clean_scirepeval huggingface dataset:
Soft Rasterizer: Differentiable Rendering for Unsupervised Single-View Mesh Reconstruction

Rendering is the process of generating 2D images from 3D assets, simulated in a virtual environment, typically with a graphics pipeline. By inverting such renderer, one can think of a learning approach to predict a 3D shape from an input image. However, standard rendering pipelines involve a fundamental discretization step called rasterization, which prevents the rendering process to be differentiable, hence suitable for learning. We present the first non-parametric and truly differentiable rasterizer based on silhouettes. Our method enables unsupervised learning for high-quality 3D mesh reconstruction from a single image. We call our framework `soft rasterizer' as it provides an accurate soft approximation of the standard rasterizer. The key idea is to fuse the probabilistic contributions of all mesh triangles with respect to the rendered pixels. When combined with a mesh generator in a deep neural network, our soft rasterizer is able to generate an approximated silhouette of the generated polygon mesh in the forward pass. The rendering loss is back-propagated to supervise the mesh generation without the need of 3D training data. Experimental results demonstrate that our approach significantly outperforms the state-of-the-art unsupervised techniques, both quantitatively and qualitatively. We also show that our soft rasterizer can achieve comparable results to the cutting-edge supervised learning method and in various cases even better ones, especially for real-world data.
Visual Reasoning of Feature Attribution with Deep Recurrent Neural Networks

Deep Recurrent Neural Network (RNN) has gained popularity in many sequence classification tasks. Beyond predicting a correct class for each data instance, data scientists also want to understand what differentiating factors in the data have contributed to the classification during the learning process. We present a visual analytics approach to facilitate this task by revealing the RNN attention for all data instances, their temporal positions in the sequences, and the attribution of variables at each value level. We demonstrate with real-world datasets that our approach can help data scientists to understand such dynamics in deep RNNs from the training results, hence guiding their modeling process.
Generating Realistic Sequences of Customer-Level Transactions for Retail Datasets

In order to better engage with customers, retailers rely on extensive customer and product databases which allows them to better understand customer behaviour and purchasing patterns. This has long been a challenging task as customer modelling is a multi-faceted, noisy and time-dependent problem. The most common way to tackle this problem is indirectly through task-specific supervised learning prediction problems, with relatively little literature on modelling a customer by directly simulating their future transactions. In this paper we propose a method for generating realistic sequences of baskets that a given customer is likely to purchase over a period of time. Customer embedding representations are learned using a Recurrent Neural Network (RNN) which takes into account the entire sequence of transaction data. Given the customer state at a specific point in time, a Generative Adversarial Network (GAN) is trained to generate a plausible basket of products for the following week. The newly generated basket is then fed back into the RNN to update the customer's state. The GAN is thus used in tandem with the RNN module in a pipeline alternating between basket generation and customer state updating steps. This allows for sampling over a distribution of a customer's future sequence of baskets, which then can be used to gain insight into how to service the customer more effectively. The methodology is empirically shown to produce baskets that appear similar to real baskets and enjoy many common properties, including frequencies of different product types, brands, and prices. Furthermore, the generated data is able to replicate most of the strongest sequential patterns that exist between product types in the real data.
CodeX: Bit-Flexible Encoding for Streaming-based FPGA Acceleration of DNNs

This paper proposes CodeX, an end-to-end framework that facilitates encoding, bitwidth customization, fine-tuning, and implementation of neural networks on FPGA platforms. CodeX incorporates nonlinear encoding to the computation flow of neural networks to save memory. The encoded features demand significantly lower storage compared to the raw full-precision activation values; therefore, the execution flow of CodeX hardware engine is completely performed within the FPGA using on-chip streaming buffers with no access to the off-chip DRAM. We further propose a fully-automated algorithm inspired by reinforcement learning which determines the customized encoding bitwidth across network layers. CodeX full-stack framework comprises of a compiler which takes a high-level Python description of an arbitrary neural network architecture. The compiler then instantiates the corresponding elements from CodeX Hardware library for FPGA implementation. Proof-of-concept evaluations on MNIST, SVHN, and CIFAR-10 datasets demonstrate an average of 4.65x throughput improvement compared to stand-alone weight encoding. We further compare CodeX with six existing full-precision DNN accelerators on ImageNet, showing an average of 3.6x and 2.54x improvement in throughput and performance-per-watt, respectively.
Secular evolution of compact binaries revolving around a spinning massive black hole

The leading order effect of the spin of a distant supermassive black hole (SMBH) on the orbit of compact binary revolving around it appears at the 1.5 post Newtonian (PN) expansion through coupling with the inner and outer orbital angular momenta, and makes an oscillating characteristic contribution to the secular evolution of the compact binary eccentricity over a long time scale compared to the Kozai-Lidov dynamics caused by a non-spinning SMBH.
Quadratic Autoencoder (Q-AE) for Low-Dose CT Denoising

Inspired by complexity and diversity of biological neurons, our group proposed quadratic neurons by replacing the inner product in current artificial neurons with a quadratic operation on input data, thereby enhancing the capability of an individual neuron. Along this direction, we are motivated to evaluate the power of quadratic neurons in popular network architectures, simulating human-like learning in the form of “quadratic-neuron-based deep learning”. Our prior theoretical studies have shown important merits of quadratic neurons and networks in representation, efficiency, and interpretability. In this paper, we use quadratic neurons to construct an encoder-decoder structure, referred as the quadratic autoencoder, and apply it to low-dose CT denoising. The experimental results on the Mayo low-dose CT dataset demonstrate the utility and robustness of quadratic autoencoder in terms of image denoising and model efficiency. To our best knowledge, this is the first time that the deep learning approach is implemented with a new type of neurons and demonstrates a significant potential in the medical imaging field.
Virtual-to-Real-World Transfer Learning for Robots on Wilderness Trails

Robots hold promise in many scenarios involving outdoor use, such as search-and-rescue, wildlife management, and collecting data to improve environment, climate, and weather forecasting. However, autonomous navigation of outdoor trails remains a challenging problem. Recent work has sought to address this issue using deep learning. Although this approach has achieved state-of-the-art results, the deep learning paradigm may be limited due to a reliance on large amounts of annotated training data. Collecting and curating training datasets may not be feasible or practical in many situations, especially as trail conditions may change due to seasonal weather variations, storms, and natural erosion. In this paper, we explore an approach to address this issue through virtual-to-real-world transfer learning using a variety of deep learning models trained to classify the direction of a trail in an image. Our approach utilizes synthetic data gathered from virtual environments for model training, bypassing the need to collect a large amount of real images of the outdoors. We validate our approach in three main ways. First, we demonstrate that our models achieve classification accuracies upwards of 95% on our synthetic data set. Next, we utilize our classification models in the control system of a simulated robot to demonstrate feasibility. Finally, we evaluate our models on real-world trail data and demonstrate the potential of virtual-to-real-world transfer learning.
Hamiltonian spectral invariants, symplectic spinors and Frobenius structures I

This is the first of two articles aiming to introduce symplectic spinors into the field of symplectic topology and the subject of Frobenius structures. After exhibiting a (tentative) axiomating setting for Frobenius structures resp. ’Higgs pairs’ in the context of symplectic spinors, we present immediate observations concerning a local Schroedinger equation, the first structure connection and the existence of ’spectrum’, its topological interpretation and its connection to ’formality’ which are valid for the case of standard Frobenius structures. We give a classification of the irreducibles and the indecomposables of the latter in terms of certain U(n)-reductions of the G-extension of the metaplectic frame bundle and a certain connection on it, where G is the semi-direct product of the metaplectic group and the Heisenberg group, while the indecomposable case involves in addition the combinatorial structure of the eigenstates of the n-dimensional harmonic oscillator. In the second ∗
Hand Sign to Bangla Speech: A Deep Learning in Vision based system for Recognizing Hand Sign Digits and Generating Bangla Speech

Recent advancements in the field of computer vision with the help of deep neural networks have led us to explore and develop many existing challenges that were once unattended due to the lack of necessary technologies. Hand Sign/Gesture Recognition is one of the significant areas where the deep neural network is making a substantial impact. In the last few years, a large number of researches has been conducted to recognize hand signs and hand gestures, which we aim to extend to our mother-tongue, Bangla (also known as Bengali). The primary goal of our work is to make an automated tool to aid the people who are unable to speak. We developed a system that automatically detects hand sign based digits and speaks out the result in Bangla language. According to the report of the World Health Organization (WHO), 15% of people in the world live with some kind of disabilities. Among them, individuals with communication impairment such as speech disabilities experience substantial barrier in social interaction. The proposed system can be invaluable to mitigate such a barrier. The core of the system is built with a deep learning model which is based on convolutional neural networks (CNN). The model classifies hand sign based digits with 92% accuracy over validation data which ensures it a highly trustworthy system. Upon classification of the digits, the resulting output is fed to the text to speech engine and the translator unit eventually which generates audio output in Bangla language. A web application to demonstrate our tool is available at this http URL.
Deep transfer across domains for face antispoofing

A practical face recognition system demands not only high recognition performance but also the capability of detecting spoofing attacks. While emerging approaches to face antispoofing have been proposed in recent years, most of them perform poorly on unseen samples. The generalizability of face antispoofing needs to be significantly improved before it can be adopted by practical application systems. The main reason for the poor generalization of current approaches is the variety of materials among the spoofing devices. As the attacks are produced by putting a spoofing display (e.g., paper, electronic screen, forged mask) in front of a camera, the variety of spoofing materials makes the spoofing attacks quite different. Another reason for the poor generalizability is that limited labeled data are available for training for face antispoofing. We focus on improving the generalizability of convolutional neural network (CNN)-based face antispoofing methods across different kinds of datasets. We propose a deep domain transfer CNN using sparsely unlabeled data from the target domain to learn features that are invariant across domains for face antispoofing. Experiments on five face spoofing datasets show that the proposed method significantly improves the cross-test performance only with a small number of unlabeled samples from the target domain.
The Magellanic System: the puzzle of the leading gas stream

The Magellanic Clouds (MCs) are the most massive gas-bearing systems falling into the Galaxy at the present epoch. They show clear signs of interaction, manifested in particular by the Magellanic Stream, a spectacular gaseous wake that trails from the MCs extending more than 150° across the sky. Ahead of the MCs is the ‘Leading Arm’ usually interpreted as the tidal counterpart of the Magellanic Stream, an assumption we now call into question. We revisit the formation of these gaseous structures in a first-infall scenario, including for the first time a Galactic model with a weakly magnetized, spinning hot corona. In agreement with previous studies, we recover the location and the extension of the Stream on the sky. In contrast, we find that the formation of the Leading Arm – that is otherwise present in models without a corona – is inhibited by the hydrodynamic interaction with the hot component. These results hold with or without coronal rotation or a weak, ambient magnetic field. Since the existence of the hot corona is well established, we are led to two possible interpretations: (i) the Leading Arm survives because the coronal density beyond 20 kpc is a factor ≳10 lower than required by conventional spheroidal coronal X-ray models, in line with recent claims of rapid coronal rotation; or (ii) the ‘Leading Arm’ is cool gas trailing from a frontrunner, a satellite moving ahead of the MCs, consistent with its higher metallicity compared to the trailing stream. Both scenarios raise issues that we discuss.
Machine Learning with Neural Networks

This modern and self-contained book offers a clear and accessible introduction to the important topic of machine learning with neural networks. In addition to describing the mathematical principles of the topic, and its historical evolution, strong connections are drawn with underlying methods from statistical physics and current applications within science and engineering. Closely based around a well-established undergraduate course, this pedagogical text provides a solid understanding of the key aspects of modern machine learning with artificial neural networks, for students in physics, mathematics, and engineering. Numerous exercises expand and reinforce key concepts within the book and allow students to hone their programming skills. Frequent references to current research develop a detailed perspective on the state-of-the-art in machine learning research.
RESULTS FROM IMPACT ASSESSMENT ON SOCIETY AND SCIENTISTS OF FRASCATI SCIENZA EUROPEAN RESEARCHERS’ NIGHTS IN YEARS 2006 – 2015

The aim of this paper is to present the impact achieved by Frascati Scienza Association on society and research through the European Researchers' Night project funded by the European Commission within the years 2006-2015. The project has been devoted to raise awareness of researchers' work, encourage the dialogue between researchers and citizens and the choice of young people to pursue a career in science. The first scientific activities and cultural events took shape in 2006, under the coordination of the National Institute for Nuclear Physics (INFN), through the European Researchers' Night project, the most important and significant event to promote the role of the researcher and bring people of all ages closer to the scientific world. The positive and successful experience of the first two events, pushed the researchers and citizens of Frascati, where most of Italian research centers and infrastructures are located, to formally associate in the Frascati Scienza in 2008, who started to coordinate the event from 2008. Frascati Scienza was driven by the need to promote educational activities to citizens, young people and schools, in order to involve the general public in science and to bring researchers closer to society.
Pricing Path-Dependent Bermudan Options Using Wiener Chaos Expansion: An Embarrassingly Parallel Approach

In this work, we propose a new policy iteration algorithm for pricing Bermudan options when the payoff process cannot be written as a function of a lifted Markov process. Our approach is based on a modification of the well-known Longstaff Schwartz algorithm, in which we basically replace the standard least square regression by a Wiener chaos expansion. Not only does it allow us to deal with a non Markovian setting, but it also breaks the bottleneck induced by the least square regression as the coefficients of the chaos expansion are given by scalar products on the L^2 space and can therefore be approximated by independent Monte Carlo computations. This key feature enables us to provide an embarrassingly parallel algorithm.
Background Subtraction on Depth Videos with Convolutional Neural Networks

Background subtraction is a significant component of computer vision systems. It is widely used in video surveillance, object tracking, anomaly detection, etc. A new data source for background subtraction appeared as the emergence of low-cost depth sensors like Microsof t Kinect, Asus Xtion PRO, etc. In this paper, we propose a background subtraction approach on depth videos, which is based on convolutional neural networks (CNNs), called BGSNet-D (BackGround Subtraction neural Networks for Depth videos). The method can be used in color unavailable scenarios like poor lighting situations, and can also be applied to combine with existing RGB background subtraction methods. A preprocessing strategy is designed to reduce the influences incurred by noise from depth sensors. The experimental results on the SBM-RGBD dataset show that the proposed method outperforms existing methods on depth data, and even reaches the performance of the methods that use RGB-D data.
Efficient Matrix Profile Computation Using Different Distance Functions

Matrix profile has been recently proposed as a promising technique to the problem of all-pairs-similarity search on time series. Efficient algorithms have been proposed for computing it, e.g., STAMP [13], STOMP  and SCRIMP++ . All these algorithms use the z-normalized Euclidean distance to measure the distance between subsequences. However, as we observed, for some datasets other Euclidean measurements are more useful for knowledge discovery from time series. In this paper, we propose efficient algorithms for computing matrix profile for a general class of Euclidean distances. We first propose a simple but efficient algorithm called AAMP for computing matrix profile with the "pure" (non-normalized) Euclidean distance. Then, we extend our algorithm for the p- norm distance. We also propose an algorithm, called ACAMP, that uses the same principle as AAMP, but for the case of z-normalized Euclidean distance. We implemented our algorithms, and evaluated their performance through experimentation. The experiments show excellent performance results. For example, they show that AAMP is very efficient for com- putting matrix profile for non-normalized Euclidean distances. The results also show that the ACAMP algorithm is significantly faster than SCRIMP++ (the state of the art matrix profile algorithm) for the case of z-normalized Euclidean distance.
Telescopic groups and symmetries of combinatorial maps

In the present paper, we show that many combinatorial and topological objects, such as maps, hypermaps, three-dimensional pavings, constellations and branched coverings of the two--sphere admit any given automorphism group. This enhances the already known results by Cori -- Machi, Siran -- Skoviera, and other authors. We also provide a more universal technique for showing that `any automorphism group is possible', that is applicable to a wider classes or, in contrast, to more particular sub-classes of said combinatorial and geometric objects. Finally, we show that any given automorphism group can be realised by sufficiently many such non-isomorphic entities (super-exponentially many with respect to a certain combinatorial complexity measure).
Multiple Sclerosis Lesion Synthesis in MRI Using an Encoder-Decoder U-NET

Magnetic resonance imaging (MRI) synthesis has attracted attention due to its various applications in the medical imaging domain. In this paper, we propose generating synthetic multiple sclerosis (MS) lesions on MRI images with the final aim to improve the performance of supervised machine learning algorithms, therefore, avoiding the problem of the lack of available ground truth. We propose a two-input two-output fully convolutional neural network model for MS lesion synthesis in MRI images. The lesion information is encoded as discrete binary intensity level masks passed to the model and stacked with the input images. The model is trained end-to-end without the need for manually annotating the lesions in the training set. We then perform the generation of synthetic lesions on healthy images via registration of patient images, which are subsequently used for data augmentation to increase the performance for supervised MS lesion detection algorithms. Our pipeline is evaluated on MS patient data from an in-house clinical dataset and the public ISBI2015 challenge dataset. The evaluation is based on measuring the similarities between the real and the synthetic images as well as in terms of lesion detection performance by segmenting both the original and synthetic images individually using a state-of-the-art segmentation framework. We also demonstrate the usage of synthetic MS lesions generated on healthy images as data augmentation. We analyze a scenario of limited training data (one-image training) to demonstrate the effect of the data augmentation on both datasets. Our results significantly show the effectiveness of the usage of synthetic MS lesion images. For the ISBI2015 challenge, our one-image model trained using only a single image plus the synthetic data augmentation strategy showed a performance similar to that of other CNN methods that were fully trained using the entire training set, yielding a comparable human expert rater performance.