pwc-archive/papers-with-abstracts huggingface dataset:
Towards Next-Generation LLM-based Recommender Systems: A Survey and Beyond
Authors: Qi Wang, Jindong Li, Shiqi Wang, Qianli Xing, Runliang Niu, He Kong, Rui Li, Guodong Long, Yi Chang, Chengqi Zhang
Date: 2024-10-10 00:00:00
Tasks: Large Language Model, Recommendation Systems

Large language models (LLMs) have not only revolutionized the field of natural language processing (NLP) but also have the potential to bring a paradigm shift in many other fields due to their remarkable abilities of language understanding, as well as impressive generalization capabilities and reasoning skills. As a result, recent studies have actively attempted to harness the power of LLMs to improve recommender systems, and it is imperative to thoroughly review the recent advances and challenges of LLM-based recommender systems. Unlike existing work, this survey does not merely analyze the classifications of LLM-based recommendation systems according to the technical framework of LLMs. Instead, it investigates how LLMs can better serve recommendation tasks from the perspective of the recommender system community, thus enhancing the integration of large language models into the research of recommender system and its practical application. In addition, the long-standing gap between academic research and industrial applications related to recommender systems has not been well discussed, especially in the era of large language models. In this review, we introduce a novel taxonomy that originates from the intrinsic essence of recommendation, delving into the application of large language model-based recommendation systems and their industrial implementation. Specifically, we propose a three-tier structure that more accurately reflects the developmental progression of recommendation systems from research to practical implementation, including representing and understanding, scheming and utilizing, and industrial deployment. Furthermore, we discuss critical challenges and opportunities in this emerging field. A more up-to-date version of the papers is maintained at: https://github.com/jindongli-Ai/Next-Generation-LLM-based-Recommender-Systems-Survey.
Tourism destination events classifier based on artificial intelligence techniques
Authors: Miguel Camacho-Ruiz, Ramón Alberto Carrasco, Gema Fernández-Avilés, Antonio LaTorre
Date: 2024-10-07 00:00:00
Tasks: Management

Identifying client needs to provide optimal services is crucial in tourist destination management. The events held in tourist destinations may help to meet those needs and thus contribute to tourist satisfaction. As with product management, the creation of hierarchical catalogs to classify those events can aid event management. The events that can be found on the internet are listed in dispersed, heterogeneous sources, which makes direct classification a difficult, time-consuming task. The main aim of this work is to create a novel process for automatically classifying an eclectic variety of tourist events using a hierarchical taxonomy, which can be applied to support tourist destination management. Leveraging data science methods such as CRISP-DM, supervised machine learning, and natural language processing techniques, the automatic classification process proposed here allows the creation of a normalized catalog across very different geographical regions. Therefore, we can build catalogs with consistent filters, allowing users to find events regardless of the event categories assigned at source, if any. This is very valuable for companies that offer this kind of information across multiple regions, such as airlines, travel agencies or hotel chains. Ultimately, this tool has the potential to revolutionize the way companies and end users interact with tourist events information.
Adaptive Real-Time Multi-Loss Function Optimization Using Dynamic Memory Fusion Framework: A Case Study on Breast Cancer Segmentation
Authors: Amin Golnari, Mostafa Diba
Date: 2024-10-10 00:00:00
Tasks: Deep Learning, Image Segmentation, Multi-Loss Function Penalizing

Deep learning has proven to be a highly effective tool for a wide range of applications, significantly when leveraging the power of multi-loss functions to optimize performance on multiple criteria simultaneously. However, optimal selection and weighting loss functions in deep learning tasks can significantly influence model performance, yet manual tuning of these functions is often inefficient and inflexible. We propose a novel framework called dynamic memory fusion for adaptive multi-loss function penalizing in real-time to address this. This framework leverages historical loss values data to dynamically adjust the weighting of multiple loss functions throughout the training process. Additionally, this framework integrates an auxiliary loss function to enhance model performance in the early stages. To further research horizons, we introduce the class-balanced dice loss function, designed to address class imbalance by prioritizing underrepresented classes. Experiments on breast ultrasound datasets demonstrate that the framework improves segmentation performance across various metrics. These results demonstrate the effectiveness of our proposed framework in ensuring that the model dynamically adjusts its focus to prioritize the most relevant criteria, leading to improved performance in evolving environments. The source code for our proposed methodology is publicly available on GitHub.
DivShift: Exploring Domain-Specific Distribution Shifts in Large-Scale, Volunteer-Collected Biodiversity Datasets
Authors: Elena Sierra, Lauren E. Gillespie, Salim Soltani, Moises Exposito-Alonso, Teja Kattenborn
Date: 2024-10-17 00:00:00
Tasks: Deep Learning, Fine-Grained Image Classification

Large-scale, volunteer-collected datasets of community-identified natural world imagery like iNaturalist have enabled marked performance gains for fine-grained visual classification of species using machine learning methods. However, such data -- sometimes referred to as citizen science data -- are opportunistic and lack a structured sampling strategy. This volunteer-collected biodiversity data contains geographic, temporal, taxonomic, observers, and sociopolitical biases that can have significant effects on biodiversity model performance, but whose impacts are unclear for fine-grained species recognition performance. Here we introduce Diversity Shift (DivShift), a framework for quantifying the effects of domain-specific distribution shifts on machine learning model performance. To diagnose the performance effects of biases specific to volunteer-collected biodiversity data, we also introduce DivShift - North American West Coast (DivShift-NAWC), a curated dataset of almost 7.5 million iNaturalist images across the western coast of North America partitioned across five types of expert-verified bias. We compare species recognition performance across these bias partitions using a diverse variety of species- and ecosystem-focused accuracy metrics. We observe that these biases confound model performance less than expected from the underlying label distribution shift, and that more data leads to better model performance but the magnitude of these improvements are bias-specific. These findings imply that while the structure within natural world images provides generalization improvements for biodiversity monitoring tasks, the biases present in volunteer-collected biodiversity data can also affect model performance; thus these models should be used with caution in downstream biodiversity monitoring tasks.
Optimal planning for heterogeneous autonomous teams with precedence and compatibility constraints and its application on power grid inspection with Unmanned Aerial Vehicles
Authors: Antonio Sojo, Iván Maza, Aníbal Ollero
Date: 2024-10-28 00:00:00
Tasks: Task Planning, Traveling Salesman Problem

In this paper we address the optimal planning of autonomous teams for general purpose tasks including a wide spectrum of situations: from project management of human teams to the coordination of an automated assembly lines, focusing in the automated inspection of power grids. There exist many methods for task planning. However, the vast majority of such methods are conceived for very specific problems or situations and are often based in certain assumptions and simplifications. Consider for example all the different algorithms developed to solve the Vehicle Routing Problem (VRP) for all the different vehicles and environment characteristics. This means that no robust general planning method exists and that a possible extension of any of them to a more general situation is often not a trivial task. To address this, we propose a new truly general method ultimately based on a generalization of the Traveling Salesman Problem (TSP). We call this new model the Heterogeneous Multi-worker Task Planning Problem (HMWTPP). It provides a natural framework to model many situations typical in task planning of all kinds. Task-Worker compatibility, precedence/order and time-windows constraints are already encoded into the HMWTPP while it can be easily extended to include weight capacity or battery per node constraints in an intuitive manner. Several classical TSP problems included in the TSPLIB library are solved for validation and performance analysis of HMWTPP showing a comparable numerical performance to that of existing models. In addition, a synthetic example modeling an automated assembly line is analyzed to prove the potential capabilities of the HMWTPP in real-life scenarios. Ultimately, we focus in the computation of the optimal plan of Unmanned Aerial Vehicles (UAVs) specifically in the context of automated inspection of electrical power grids.
Radon Implicit Field Transform (RIFT): Learning Scenes from Radar Signals
Authors: Daqian Bao, Alex Saad-Falcon, Justin Romberg
Date: 2024-10-16 00:00:00
Tasks: SSIM

Data acquisition in array signal processing (ASP) is costly because achieving high angular and range resolutions necessitates large antenna apertures and wide frequency bandwidths, respectively. The data requirements for ASP problems grow multiplicatively with the number of viewpoints and frequencies, significantly increasing the burden of data collection, even for simulation. Implicit Neural Representations (INRs) -- neural network-based models of 3D objects and scenes -- offer compact and continuous representations with minimal radar data. They can interpolate to unseen viewpoints and potentially address the sampling cost in ASP problems. In this work, we select Synthetic Aperture Radar (SAR) as a case from ASP and propose Radon Implicit Field Transform (RIFT). RIFT consists of two components: a classical forward model for radar (Generalized Radon Transform, GRT), and an INR based scene representation learned from radar signals. This method can be extended to other ASP problems by replacing the GRT with appropriate algorithms corresponding to different data modalities. In our experiments, we first synthesize radar data using the GRT. We then train the INR model on this synthetic data by minimizing the reconstruction error of the radar signal. After training, we render the scene using the trained INR and evaluate our scene representation against the ground truth scene. Due to the lack of existing benchmarks, we introduce two main new error metrics: phase-Root Mean Square Error (p-RMSE) for radar signal interpolation, and magnitude-Structural Similarity Index measure(m-SSIM) for scene reconstruction. These metrics adapt traditional error measures to account for the complex nature of radar signals. Compared to traditional scene models in radar signal processing, with only 10% data footprint, our RIFT model achieves up to 188% improvement in scene reconstruction.
NARX Transformer: A Dynamic Model for Leveraging Multicycle Data in Long-Term Battery State of Health Estimation
Authors: Amirhossein Heydarian Ardakani, Seyed Ali Abdollahian, Farzaneh Abdollahi
Date: 2024-09-16 00:00:00
Proceeding: IEEE Transactions on Instrumentation and Measurement 2024 9
Tasks: Battery cycle life prediction, Battery diagnosis, Li-ion battery degradation modes diagnosis, Li-ion State of Health Estimation

Battery state of health (SoH) is a vital indicator of its performance and longevity, making accurate SoH predictions crucial for effectively managing and maintaining battery-powered systems. Deep learning (DL) frameworks enhance SoH prediction accuracy by learning complex patterns from large datasets. Transformer architecture is particularly beneficial for processing sequential data, capturing temporal dependencies within battery data, and improving SoH estimation reliability. In this research, we introduce a novel dynamic model that integrates nonlinear auto-regressive with exogenous (NARXs) inputs into a transformer encoder-decoder architecture. This model aims to predict long-term battery SoH and end-of-life (EoL), focusing on multiple cycles and the dynamic behavior of SoH changes. We evaluated our model using a unique half-half experiment, showing that it reduces the mean absolute percentage error in long-term predictions to 1.4%. This method enables accurate battery health and EoL predictions in practical applications, showing robustness against measurement noise.
International vulnerability of inflation
Authors: Ignacio Garrón, C. Vladimir Rodríguez-Caballero, Esther Ruiz
Date: 2024-10-27 00:00:00

In a globalised world, inflation in a given country may be becoming less responsive to domestic economic activity, while being increasingly determined by international conditions. Consequently, understanding the international sources of vulnerability of domestic inflation is turning fundamental for policy makers. In this paper, we propose the construction of Inflation-at-risk and Deflation-at-risk measures of vulnerability obtained using factor-augmented quantile regressions estimated with international factors extracted from a multi-level Dynamic Factor Model with overlapping blocks of inflations corresponding to economies grouped either in a given geographical region or according to their development level. The methodology is implemented to inflation observed monthly from 1999 to 2022 for over 115 countries. We conclude that, in a large number of developed countries, international factors are relevant to explain the right tail of the distribution of inflation, and, consequently, they are more relevant for the vulnerability related to high inflation than for average or low inflation. However, while inflation of developing low-income countries is hardly affected by international conditions, the results for middle-income countries are mixed. Finally, based on a rolling-window out-of-sample forecasting exercise, we show that the predictive power of international factors has increased in the most recent years of high inflation.
test
Authors: test
Date: 2024-01-01 00:00:00
Proceeding: Some Journal 2024 1

test
Collective Intelligence in Human-AI Teams A Bayesian Theory of Mind Approach
Authors: Samuel Westby, Christoph Riedl
Date: 2023-06-26 00:00:00
Proceeding: AAAI Conference on Artificial Intelligence 2023 6
Tasks: Decision Making, Decision Making Under Uncertainty, Theory of Mind Modeling

We develop a network of Bayesian agents that collectively model the mental states of teammates from the observed communication. Using a generative computational approach to cognition, we make two contributions. First, we show that our agent could generate interventions that improve the collective intelligence of a human-AI team beyond what humans alone would achieve. Second, we develop a real-time measure of human's theory of mind ability and test theories about human cognition. We use data collected from an online experiment in which 145 individuals in 29 human-only teams of five communicate through a chat-based system to solve a cognitive task. We find that humans (a) struggle to fully integrate information from teammates into their decisions, especially when communication load is high, and (b) have cognitive biases which lead them to underweight certain useful, but ambiguous, information. Our theory of mind ability measure predicts both individual-and team-level performance. Observing teams' first 25% of messages explains about 8% of the variation in final team performance, a 170% improvement compared to the current state of the art.
Enhancing Deep Learning based RMT Data Inversion using Gaussian Random Field
Authors: Koustav Ghosal, Arun Singh, Samir Malakar, Shalivahan Srivastava, Deepak Gupta
Date: 2024-10-22 00:00:00
Tasks: Deep Learning

Deep learning (DL) methods have emerged as a powerful tool for the inversion of geophysical data. When applied to field data, these models often struggle without additional fine-tuning of the network. This is because they are built on the assumption that the statistical patterns in the training and test datasets are the same. To address this, we propose a DL-based inversion scheme for Radio Magnetotelluric data where the subsurface resistivity models are generated using Gaussian Random Fields (GRF). The network's generalization ability was tested with an out-of-distribution (OOD) dataset comprising a homogeneous background and various rectangular-shaped anomalous bodies. After end-to-end training with the GRF dataset, the pre-trained network successfully identified anomalies in the OOD dataset. Synthetic experiments confirmed that the GRF dataset enhances generalization compared to a homogeneous background OOD dataset. The network accurately recovered structures in a checkerboard resistivity model, and demonstrated robustness to noise, outperforming traditional gradient-based methods. Finally, the developed scheme is tested using exemplary field data from a waste site near Roorkee, India. The proposed scheme enhances generalization in a data-driven supervised learning framework, suggesting a promising direction for OOD generalization in DL methods.
Enhancing Trust and Safety in Digital Payments: An LLM-Powered Approach
Authors: Devendra Dahiphale, Naveen Madiraju, Justin Lin, Rutvik Karve, Monu Agrawal, Anant Modwal, Ramanan Balakrishnan, Shanay Shah, Govind Kaushal, Priya Mandawat, Prakash Hariramani, Arif Merchant
Date: 2024-10-21 00:00:00

Digital payment systems have revolutionized financial transactions, offering unparalleled convenience and accessibility to users worldwide. However, the increasing popularity of these platforms has also attracted malicious actors seeking to exploit their vulnerabilities for financial gain. To address this challenge, robust and adaptable scam detection mechanisms are crucial for maintaining the trust and safety of digital payment ecosystems. This paper presents a comprehensive approach to scam detection, focusing on the Unified Payments Interface (UPI) in India, Google Pay (GPay) as a specific use case. The approach leverages Large Language Models (LLMs) to enhance scam classification accuracy and designs a digital assistant to aid human reviewers in identifying and mitigating fraudulent activities. The results demonstrate the potential of LLMs in augmenting existing machine learning models and improving the efficiency, accuracy, quality, and consistency of scam reviews, ultimately contributing to a safer and more secure digital payment landscape. Our evaluation of the Gemini Ultra model on curated transaction data showed a 93.33% accuracy in scam classification. Furthermore, the model demonstrated 89% accuracy in generating reasoning for these classifications. A promising fact, the model identified 32% new accurate reasons for suspected scams that human reviewers had not included in the review notes.
FoldMark: Protecting Protein Generative Models with Watermarking
Authors: Zaixi Zhang, Ruofan Jin, Kaidi Fu, Le Cong, Marinka Zitnik, Mengdi Wang
Date: 2024-10-27 00:00:00
Tasks: Drug Discovery, Protein Structure Prediction

Protein structure is key to understanding protein function and is essential for progress in bioengineering, drug discovery, and molecular biology. Recently, with the incorporation of generative AI, the power and accuracy of computational protein structure prediction/design have been improved significantly. However, ethical concerns such as copyright protection and harmful content generation (biosecurity) pose challenges to the wide implementation of protein generative models. Here, we investigate whether it is possible to embed watermarks into protein generative models and their outputs for copyright authentication and the tracking of generated structures. As a proof of concept, we propose a two-stage method FoldMark as a generalized watermarking strategy for protein generative models. FoldMark first pretrain watermark encoder and decoder, which can minorly adjust protein structures to embed user-specific information and faithfully recover the information from the encoded structure. In the second step, protein generative models are fine-tuned with watermark-conditioned Low-Rank Adaptation (LoRA) modules to preserve generation quality while learning to generate watermarked structures with high recovery rates. Extensive experiments are conducted on open-source protein structure prediction models (e.g., ESMFold and MultiFlow) and de novo structure design models (e.g., FrameDiff and FoldFlow) and we demonstrate that our method is effective across all these generative models. Meanwhile, our watermarking framework only exerts a negligible impact on the original protein structure quality and is robust under potential post-processing and adaptive attacks.
Human-Centric eXplainable AI in Education
Authors: Subhankar Maity, Aniket Deroy
Date: 2024-10-18 00:00:00

As artificial intelligence (AI) becomes more integrated into educational environments, how can we ensure that these systems are both understandable and trustworthy? The growing demand for explainability in AI systems is a critical area of focus. This paper explores Human-Centric eXplainable AI (HCXAI) in the educational landscape, emphasizing its role in enhancing learning outcomes, fostering trust among users, and ensuring transparency in AI-driven tools, particularly through the innovative use of large language models (LLMs). What challenges arise in the implementation of explainable AI in educational contexts? This paper analyzes these challenges, addressing the complexities of AI models and the diverse needs of users. It outlines comprehensive frameworks for developing HCXAI systems that prioritize user understanding and engagement, ensuring that educators and students can effectively interact with these technologies. Furthermore, what steps can educators, developers, and policymakers take to create more effective, inclusive, and ethically responsible AI solutions in education? The paper provides targeted recommendations to address this question, highlighting the necessity of prioritizing explainability. By doing so, how can we leverage AI's transformative potential to foster equitable and engaging educational experiences that support diverse learners?