Reviewerly/exHarmony huggingface dataset:
Symbolic Learning to Optimize: Towards Interpretability and Scalability

Recent studies on Learning to Optimize (L2O) suggest a promising path to automating and accelerating the optimization procedure for complicated tasks. Existing L2O models parameterize optimization rules by neural networks, and learn those numerical rules via meta-training. However, they face two common pitfalls: (1) scalability: the numerical rules represented by neural networks create extra memory overhead for applying L2O models, and limit their applicability to optimizing larger tasks; (2) interpretability: it is unclear what an L2O model has learned in its black-box optimization rule, nor is it straightforward to compare different L2O models in an explainable way. To avoid both pitfalls, this paper proves the concept that we can "kill two birds by one stone", by introducing the powerful tool of symbolic regression to L2O. In this paper, we establish a holistic symbolic representation and analysis framework for L2O, which yields a series of insights for learnable optimizers. Leveraging our findings, we further propose a lightweight L2O model that can be meta-trained on large-scale problems and outperformed human-designed and tuned optimizers. Our work is set to supply a brand-new perspective to L2O research. Codes are available at: https://github.com/VITA-Group/Symbolic-Learning-To-Optimize.
RobIn: A Robust Interpretable Deep Network for Schizophrenia Diagnosis

Schizophrenia is a severe mental health condition that requires a long and complicated diagnostic process. However, early diagnosis is vital to control symptoms. Deep learning has recently become a popular way to analyse and interpret medical data. Past attempts to use deep learning for schizophrenia diagnosis from brain-imaging data have shown promise but suffer from a large training-application gap - it is difficult to apply lab research to the real world. We propose to reduce this training-application gap by focusing on readily accessible data. We collect a data set of psychiatric observations of patients based on DSM-5 criteria. Because similar data is already recorded in all mental health clinics that diagnose schizophrenia using DSM-5, our method could be easily integrated into current processes as a tool to assist clinicians, whilst abiding by formal diagnostic criteria. To facilitate real-world usage of our system, we show that it is interpretable and robust. Understanding how a machine learning tool reaches its diagnosis is essential to allow clinicians to trust that diagnosis. To interpret the framework, we fuse two complementary attention mechanisms, 'squeeze and excitation' and 'self-attention', to determine global attribute importance and attribute interactivity, respectively. The model uses these importance scores to make decisions. This allows clinicians to understand how a diagnosis was reached, improving trust in the model. Because machine learning models often struggle to generalise to data from different sources, we perform experiments with augmented test data to evaluate the model's applicability to the real world. We find that our model is more robust to perturbations, and should therefore perform better in a clinical setting. It achieves 98% accuracy with 10-fold cross-validation.
The King is Naked: on the Notion of Robustness for Natural Language  Processing

There is growing evidence that the classical notion of adversarial robustness originally introduced for images has been adopted as a de facto standard by a large part of the NLP research community. We show that this notion is problematic in the context of NLP as it considers a narrow spectrum of linguistic phenomena. In this paper, we argue for semantic robustness, which is better aligned with the human concept of linguistic fidelity. We characterize semantic robustness in terms of biases that it is expected to induce in a model. We study semantic robustness of a range of vanilla and robustly trained architectures using a template-based generative test bed. We complement the analysis with empirical evidence that, despite being harder to implement, semantic robustness can improve performance %gives guarantees for on complex linguistic phenomena where models robust in the classical sense fail.
Contributions to interframe coding

Advanced motion models (4 or 6 parameters) are needed for a good representation of the motion experimented by the different objects contained in a sequence of images. If the image is split in very small blocks, then an accurate description of complex movements can be achieved with only 2 parameters. This alternative implies a large set of vectors per image. We propose a new approach to reduce the number of vectors, using different block sizes as a function of the local characteristics of the image, without increasing the error accepted with the smallest blocks. A second algorithm is proposed for an inter/intraframe coder.
Teknologi Informasi dan Komunikasi (TIK) dalam Peningkatan Mutu Administrasi Pendidikan di Temanggung

Information and communication technology is very influential in improving the quality of education administration to carry out tasks in accordance with the vision, mission and goals of the school. The importance of technology in improving the quality of education administration will affect the quality and quality of schools. The research method uses field research. Sources of data obtained through information and communication with SMA Negeri 1 Temanggung. The results of the study are 1) Through the process of developing information and communication technology at SMA N 1 Temanggung, it has developed and made a significant contribution. 2) The urgency of information and communication technology plays a role in improving the quality of education.
Load Balancing Simulation Android Application as an Online Learning Media

Learning activities during the covid pandemic are carried out online. Learning materials are delivered synchronously or asynchronously. Asynchronous techniques allow students to learn independently, and materials can be studied repeatedly. One way that can be used to convey material is through simulation. The students will understand the learning material better using simulation. The simulation made in this paper is a load balancing material simulation. This material is studied by students in computer network studies at both high school and college. Load balancing is a technique for dividing the load on the server. The algorithms discussed in this simulation are round-robin and least connected. In this simulation, the user is invited to interact with the application and see the difference between the two algorithms. The method used to create the application consists of five stages. The stages are problem analysis, application design, development, and testing. This simulation application is made using GameMakerStudio 14.9 and can be installed on Android devices. The application was tested on 20 users with vocational education backgrounds and students. More than 50% of users say this application is easy to use and the material is easy to understand.
Quantum Implementation of Database Operators and Queries

Quantum Computing has a potential, if realized, to significantly alter the computing landscape. However, developing efficient quantum algorithms and/or programming quantum computers is challenging. In this paper, we develop quantum algorithms for the database queries, in particular, the SQL/relational database operators: select, project, join, and set manipulation (intersect, union, and difference) operators. This also involves representation of relational database tables using quantum states and develop appropriate mechanism to extract output tuples from quantum states. Developing efficient quantum algorithms for general database queries has the potential to yield a declarative programming paradigm amenable to automatic optimizations.
End to End Software Engineering Research

End to end learning is machine learning starting in raw data and predicting a desired concept, with all steps done automatically. In software engineering context, we see it as starting from the source code and predicting process metrics. This framework can be used for predicting defects, code quality, productivity and more. End-to-end improves over features based machine learning by not requiring domain experts and being able to extract new knowledge. We describe a dataset of 5M files from 15k projects constructed for this goal. The dataset is constructed in a way that enables not only predicting concepts but also investigating their causes.
Coherence measure of ensembles with nonlocality without entanglement

Irreversibility between preparation and discrimination processes is manifested in the indistinguishability of orthogonal product states via local operations and classical communication (LOCC). Characterizing quantum properties for sets of states according to their local distinguishing property is one of the avenues to explain the surprising results obtained in the LOCC indistinguishability domain. We introduce a measure based on l1 norm and relative entropy of coherence whose lower values capture more quantumness in ensembles. In particular, it reaches the maximum for two-way distinguishable product ensembles with minimum rounds. Moreover, to establish the hierarchy between different product ensembles, we report that the trends of success probabilities for orthogonal product ensembles with one-way LOCC via minimum error discrimination scheme are also connected with the coherence-based measures.
Using Geographic Load Shifting to Reduce Carbon Emissions

An increasing focus on the electricity use and carbon emissions associated with computing has lead to pledges by major cloud computing companies to lower their carbon footprint. Data centers have a unique ability to shift computing load between different geographical locations, giving rise to geographic load flexibility that can be employed to reduce carbon emissions. In this paper, we present a model where data centers shift load independently of the ISOs. We first consider the impact of load shifting guided by locational marginal carbon emissions, denoted by $\lambda_{\text{CO}_2}$, a sensitivity metric that measures the impact of incremental load shifts. Relative to previous models for data center load shifting, the presented model improves accuracy and include more realistic assumptions regarding the operation of both data centers and the electricity market. Further, we introduce a new benchmark model in which data centers have access to the full information about the power system and can identify optimal shifts for the current time period. We demonstrate the efficacy of our model on the IEEE RTS GMLC system using 5 minute load and generation data for an entire year. Our results show that the proposed accuracy improvements for the shifting model based on $\lambda_{\text{CO}_2}$ are highly effective, leading to results that outperform the benchmark model.
Expressive Communication: A Common Framework for Evaluating Developments  in Generative Models and Steering Interfaces

There is an increasing interest from ML and HCI communities in empowering creators with better generative models and more intuitive interfaces with which to control them. In music, ML researchers have focused on training models capable of generating pieces with increasing long-range structure and musical coherence, while HCI researchers have separately focused on designing steering interfaces that support user control and ownership. In this study, we investigate through a common framework how developments in both models and user interfaces are important for empowering co-creation where the goal is to create music that communicates particular imagery or ideas (e.g., as is common for other purposeful tasks in music creation like establishing mood or creating accompanying music for another media). Our study is distinguished in that it measures communication through both composer's self-reported experiences, and how listeners evaluate this communication through the music. In an evaluation study with 26 composers creating 100+ pieces of music and listeners providing 1000+ head-to-head comparisons, we find that more expressive models and more steerable interfaces are important and complementary ways to make a difference in composers communicating through music and supporting their creative empowerment.
Generating Fluent Fact Checking Explanations with Unsupervised  Post-Editing

Fact-checking systems have become important tools to verify fake and misguiding news. These systems become more trustworthy when human-readable explanations accompany the veracity labels. However, manual collection of such explanations is expensive and time-consuming. Recent works frame explanation generation as extractive summarization, and propose to automatically select a sufficient subset of the most important facts from the ruling comments (RCs) of a professional journalist to obtain fact-checking explanations. However, these explanations lack fluency and sentence coherence. In this work, we present an iterative edit-based algorithm that uses only phrase-level edits to perform unsupervised post-editing of disconnected RCs. To regulate our editing algorithm, we use a scoring function with components including fluency and semantic preservation. In addition, we show the applicability of our approach in a completely unsupervised setting. We experiment with two benchmark datasets, LIAR-PLUS and PubHealth. We show that our model generates explanations that are fluent, readable, non-redundant, and cover important information for the fact check.
On equivalence between linear-chain conditional random fields and hidden  Markov chains

Practitioners successfully use hidden Markov chains (HMCs) in different problems for about sixty years. HMCs belong to the family of generative models and they are often compared to discriminative models, like conditional random fields (CRFs). Authors usually consider CRFs as quite different from HMCs, and CRFs are often presented as interesting alternative to HMCs. In some areas, like natural language processing (NLP), discriminative models have completely supplanted generative models. However, some recent results show that both families of models are not so different, and both of them can lead to identical processing power. In this paper we compare the simple linear-chain CRFs to the basic HMCs. We show that HMCs are identical to CRFs in that for each CRF we explicitly construct an HMC having the same posterior distribution. Therefore, HMCs and linear-chain CRFs are not different but just differently parametrized models.
Adversarial Transformation of Spoofing Attacks for Voice Biometrics

Voice biometric systems based on automatic speaker verification (ASV) are exposed to \textit{spoofing} attacks which may compromise their security. To increase the robustness against such attacks, anti-spoofing or presentation attack detection (PAD) systems have been proposed for the detection of replay, synthesis and voice conversion based attacks. Recently, the scientific community has shown that PAD systems are also vulnerable to adversarial attacks. However, to the best of our knowledge, no previous work have studied the robustness of full voice biometrics systems (ASV + PAD) to these new types of adversarial \textit{spoofing} attacks. In this work, we develop a new adversarial biometrics transformation network (ABTN) which jointly processes the loss of the PAD and ASV systems in order to generate white-box and black-box adversarial \textit{spoofing} attacks. The core idea of this system is to generate adversarial \textit{spoofing} attacks which are able to fool the PAD system without being detected by the ASV system. The experiments were carried out on the ASVspoof 2019 corpus, including both logical access (LA) and physical access (PA) scenarios. The experimental results show that the proposed ABTN clearly outperforms some well-known adversarial techniques in both white-box and black-box attack scenarios.
Text-To-Speech Data Augmentation for Low Resource Speech Recognition

Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve ASR models for agglutinative and low-resource languages. This novel data augmentation method generates both synthetic text and synthetic audio. Some experiments were conducted using the corpus of the Quechua language, which is an agglutinative and low-resource language. In this study, a sequence-to-sequence (seq2seq) model was applied to generate synthetic text, in addition to generating synthetic speech using a text-to-speech (TTS) model for Quechua. The results show that the new data augmentation method works well to improve the ASR model for Quechua. In this research, an 8.73% improvement in the word-error-rate (WER) of the ASR model is obtained using a combination of synthetic text and synthetic speech.
TEACHER TRAINING IN THE CONTEXT OF LIFELONG EDUCATION

The Bologna process ensured the unification of educational systems and cemented the foundations for the European Higher Education Area as an integral system. Currently, pedagogical education is implemented at three levels, the basic of which is the bachelor's level. The system of tertiary pedagogical education and the continuing professional development of acquired competencies can be defined as a crosscutting technology. The paper shows the implementation of lifelong education of teachers in the context of the Bologna process on the example of individual countries. The article reveals the national characteristics of higher pedagogical education, describes the implementation of lifelong education of teachers in the context of the Bologna process on the example of individual countries, identifies the conditions necessary for a graduate to start teaching practice in secondary education. The results of the study are generalization of best practices in national education systems and the identification of conditions for the development of crosscutting competencies in the system of tertiary education.
HeteroQA: Learning towards Question-and-Answering through Multiple Information Sources via Heterogeneous Graph Modeling

Community Question Answering (CQA) is a well-defined task that can be used in many scenarios, such as E-Commerce and online user community for special interests. In these communities, users can post articles, give comment, raise a question and answer it. These data form the heterogeneous information sources where each information source have their own special structure and context (comments attached to an article or related question with answers). Most of the CQA methods only incorporate articles or Wikipedia to extract knowledge and answer the user's question. However, various types of information sources in the community are not fully explored by these CQA methods and these multiple information sources (MIS) can provide more related knowledge to user's questions. Thus, we propose a question-aware heterogeneous graph transformer to incorporate the MIS in the user community to automatically generate the answer. To evaluate our proposed method, we conduct the experiments on two datasets: $\text{MSM}^{\text{plus}}$ the modified version of benchmark dataset MS-MARCO and the AntQA dataset which is the first large-scale CQA dataset with four types of MIS. Extensive experiments on two datasets show that our model outperforms all the baselines in terms of all the metrics.
Scene-Adaptive Attention Network for Crowd Counting

In recent years, significant progress has been made on the research of crowd counting. However, as the challenging scale variations and complex scenes existed in crowds, neither traditional convolution networks nor recent Transformer architectures with fixed-size attention could handle the task well. To address this problem, this paper proposes a scene-adaptive attention network, termed SAANet. First of all, we design a deformable attention in-built Transformer backbone, which learns adaptive feature representations with deformable sampling locations and dynamic attention weights. Then we propose the multi-level feature fusion and count-attentive feature enhancement modules further, to strengthen feature representation under the global image context. The learned representations could attend to the foreground and are adaptive to different scales of crowds. We conduct extensive experiments on four challenging crowd counting benchmarks, demonstrating that our method achieves state-of-the-art performance. Especially, our method currently ranks No.1 on the public leaderboard of the NWPU-Crowd benchmark. We hope our method could be a strong baseline to support future research in crowd counting. The source code will be released to the community.
O DELIVERY COMO FENÔMENO CONTEMPORÂNEO E OS IMPACTOS SOCIAIS

This study focuses on analyzing the impacts generated by the home delivery service for society, especially during the COVID-19 pandemic. Methodologically, we will review the literature on physical and digital collections. This project aims to identify the importance of this new profession, as well as the changes brought to society since its emergence. Justifies the accomplishment of this research, the importance of bringing to society important aspects of this new work format and its positive and negative points in the current labor scenario. The first results point to a reality of ease and convenience for the consumer, which contributes to slowly moving the consumer and the worker away from living in society, giving rise to labor problems, such as the increase in informal work and emotional issues, given the absence of social conviviality. The corpus of analysis will be taken from documents, electronic addresses and published articles about the advancement of this informal work environment after the emergence of COVID-19.
SLIP: Self-supervision meets Language-Image Pre-training

Recent work has shown that self-supervised pre-training leads to improvements over supervised learning on challenging visual recognition tasks. CLIP, an exciting new approach to learning with language supervision, demonstrates promising performance on a wide variety of benchmarks. In this work, we explore whether self-supervised learning can aid in the use of language supervision for visual representation learning. We introduce SLIP, a multi-task learning framework for combining self-supervised learning and CLIP pre-training. After pre-training with Vision Transformers, we thoroughly evaluate representation quality and compare performance to both CLIP and self-supervised learning under three distinct settings: zero-shot transfer, linear classification, and end-to-end finetuning. Across ImageNet and a battery of additional datasets, we find that SLIP improves accuracy by a large margin. We validate our results further with experiments on different model sizes, training schedules, and pre-training datasets. Our findings show that SLIP enjoys the best of both worlds: better performance than self-supervision (+8.1% linear accuracy) and language supervision (+5.2% zero-shot accuracy).
On the relevance of language in speaker recognition

This paper presents a new database collected from a bilingual speakers set (49), in two different languages: Spanish and Catalan. Phonetically there are significative differences between both languages. These differences have let us to establish several conclusions on the relevance of language in speaker recognition, using two methods: vector quantization and covariance matrices