Reviewerly/exHarmony huggingface dataset:
The Effect of Research and Development on Economic Growth in Ethiopia: The Untapped Potential for Prosperity

Authors:
raw_author_name: Birhanu Haile Agezew
raw_affiliation_string: University of Debrecen, Debrecen, Hungary

Abstract: This research measured the links between R&amp;D and economic growth in Ethiopia employing multiple regression models. Citable journal articles, patents, technology exports, and research expenditures are the four predictor variables that are the focus of the study. GDP per capita growth is the outcome variable of the study, which serves as a proxy indicator for economic growth. The study used a panel dataset with data from a sample of 21 years between 2001 and 2021. The results show a significant link between growth of GDP per capita and citable journal articles, patents, and technology exports, demonstrating that these factors are essential for fostering economic growth. However, government expenditure on research and development has no discernible impact on economic growth, which accordingly, raises the possibility that raising research spending by itself may not be sufficient to boost the economy. These findings have tremendous policy implications because they emphasize the importance of concentrating on particular R&amp;D initiatives that have a direct impact on economic growth. The study adds to the existing frontiers of knowledge inline with the connection between R&amp;D and economic growth by demonstrating the value of citation-worthy journals, patents, and technology exports in fostering economic growth.
VCSEL-based photonic spiking neural networks for ultrafast detection and tracking

Authors:
raw_author_name: Joshua Robertson
raw_affiliation_string: Institute of Photonics, SUPA Department of Physics, University of Strathclyde, Technology and Innovation Centre, 99 George Street, Glasgow, G1 1RD, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
raw_author_name: Paul Kirkland
raw_affiliation_string: Electronic and Electrical Engineering, University of Strathclyde, 204 George Street, Glasgow, G1 1XQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
raw_author_name: Gaetano Di Caterina
raw_affiliation_string: Electronic and Electrical Engineering, University of Strathclyde, 204 George Street, Glasgow, G1 1XQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
raw_author_name: Antonio Hurtado
raw_affiliation_string: Institute of Photonics, SUPA Department of Physics, University of Strathclyde, Technology and Innovation Centre, 99 George Street, Glasgow, G1 1RD, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND

Abstract: Abstract Inspired by efficient biological spike-based neural networks, we demonstrate for the first time the detection and tracking of target patterns in image and video inputs at high-speed rates with networks of multiple artificial spiking optical neurons. Using photonic systems of in-parallel spiking Vertical Cavity Surface Emitting Lasers (VCSELs), we demonstrate the implementation of multiple convolutional kernel operators which, in combination with optical spike signalling, enable the detection and tracking of target features in images/video feeds at an ultrafast photonic operation speed of 1 ns per pixel. Alongside a single layer optical Spiking Neural Network (SNN) demonstration, a multi-layer network of photonic (GHz-rate) spike-firing neurons is reported where the photonic system successfully tracks a large complex feature (Handwritten Digit 3). The consecutive photonic layers perform spike-enabled image reduction and convolution operations, and interact with a software-implemented SNN, that learns the feature patterns that best identify the target to provide a high detection efficiency even in the presence of a distractor feature. This work therefore highlights the effectiveness of combining neuromorphic photonic hardware and software SNNs, for efficient learning and ultrafast operation, thanks to the use of spiking light signals, towards tackling complex AI and computer vision problems.
Sputtered NbN films for ultrahigh performance superconducting nanowire single-photon detectors

Authors:
raw_author_name: Ilya A. Stepanov
raw_affiliation_string: FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia
raw_author_name: Aleksandr S. Baburin
raw_affiliation_string: Dukhov Automatics Research Institute, (VNIIA) 2 , Moscow 127055, Russia; FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia
raw_author_name: Evgeniy V. Sergeev
raw_affiliation_string: Dukhov Automatics Research Institute, (VNIIA) 2 , Moscow 127055, Russia; FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia
raw_author_name: Aleksey R. Matanin
raw_affiliation_string: Dukhov Automatics Research Institute, (VNIIA) 2 , Moscow 127055, Russia; FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia
raw_author_name: Vladimir V. Echeistov
raw_affiliation_string: FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia
raw_author_name: Ilya A. Ryzhikov
raw_affiliation_string: FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia; Institute for Theoretical and Applied Electromagnetics RAS 3 , Moscow 125412, Russia
raw_author_name: Yuri V. Panfilov
raw_affiliation_string: FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia
raw_author_name: Ilya A. Rodionov
raw_affiliation_string: Dukhov Automatics Research Institute, (VNIIA) 2 , Moscow 127055, Russia; FMN Laboratory, Bauman Moscow State Technical University 1 , Moscow 105005, Russia

Abstract: At the present time, ultrahigh performance superconducting nanowire single-photon detectors are the key elements in a variety of devices from biological research to quantum communications and computing. Accurate tuning of superconducting material properties is a powerful resource for fabricating single-photon detectors with desired properties. Here, we report on the major theoretical relations between ultrathin niobium nitride (NbN) film properties and superconducting nanowire single-photon detector characteristics, as well as the dependence of ultrathin NbN film properties on reactive magnetron sputtering recipes. Based on this study, we formulate the exact requirements for ultrathin NbN films for ultrahigh performance superconducting nanowire single-photon detectors. Then, we experimentally studied the properties of ultrathin NbN films (morphology, crystalline structure, critical temperature, and sheet resistance) on silicon, sapphire, silicon dioxide, and silicon nitride substrates sputtered with various recipes. We demonstrate ultrathin NbN films (obtained with more than 100 films deposition) with a wide range of critical temperature from 2.5 to 12.1 K and sheet resistance from 285 to 2000 Ω/sq and report a sheet resistance evolution of more than 40% within two years. Finally, we found out that one should use ultrathin NbN films with a specific critical temperature near 9.5 K and a sheet resistance of about 350 Ω/sq for ultrahigh performance state-of-the-art superconducting nanowire single-photon detectors at 1550 nm wavelength.
Multi-Level Transfer Learning for Optimal Features Prediction

Authors:
raw_author_name: Muhammad Sajid
raw_affiliation_string: PETRONAS Research Sdn Bhd

Abstract: Abstract The quality of the final predictions in machine learning (ML) depends on a multitude of factors, and among these factors, the generalization of features within the input dataset plays a pivotal role. This generalization is particularly crucial when dealing with seismic data, as the complexity of the underlying geological structures and the seismic characteristics themselves exhibit substantial variability across different geological study fields. Such variations pose unique challenges when it comes to model training and achieving optimal predictions for specific seismic features. Considering these challenges, the research proposes a comprehensive approach that involves the application of three stages of transfer learning. This approach has been designed to facilitate the seamless convergence of the model towards an optimal level of adaptability for the extraction of seismic features. Each step of transfer learning in this method incrementally enhances the model's ability to accommodate the idiosyncrasies of seismic data from diverse study fields, ultimately leading to the desired seismic feature prediction. The research seeks to improve the overall accuracy and robustness of seismic feature prediction across varied geological contexts, thereby contributing to the advancement of seismic data analysis and geological interpretation.
Clinical risk prediction using language models: benefits and considerations

Authors:
raw_author_name: Antonios Anastasopoulos
raw_affiliation_string: George Mason University , Fairfax, VA, United States
raw_author_name: Sanmay Das
raw_affiliation_string: George Mason University , Fairfax, VA, United States

Abstract: Abstract Objective The use of electronic health records (EHRs) for clinical risk prediction is on the rise. However, in many practical settings, the limited availability of task-specific EHR data can restrict the application of standard machine learning pipelines. In this study, we investigate the potential of leveraging language models (LMs) as a means to incorporate supplementary domain knowledge for improving the performance of various EHR-based risk prediction tasks. Methods We propose two novel LM-based methods, namely “LLaMA2-EHR” and “Sent-e-Med.” Our focus is on utilizing the textual descriptions within structured EHRs to make risk predictions about future diagnoses. We conduct a comprehensive comparison with previous approaches across various data types and sizes. Results Experiments across 6 different methods and 3 separate risk prediction tasks reveal that employing LMs to represent structured EHRs, such as diagnostic histories, results in significant performance improvements when evaluated using standard metrics such as area under the receiver operating characteristic (ROC) curve and precision-recall (PR) curve. Additionally, they offer benefits such as few-shot learning, the ability to handle previously unseen medical concepts, and adaptability to various medical vocabularies. However, it is noteworthy that outcomes may exhibit sensitivity to a specific prompt. Conclusion LMs encompass extensive embedded knowledge, making them valuable for the analysis of EHRs in the context of risk prediction. Nevertheless, it is important to exercise caution in their application, as ongoing safety concerns related to LMs persist and require continuous consideration.
CM-UTC: A Cost-sensitive Matrix based Method for Unknown Encrypted Traffic Classification

Authors:
raw_author_name: Jinguo Li
raw_affiliation_string: College of Computer Science and Technology , Shanghai University of Electric Power, Shanghai 201306, China
raw_author_name: Liangliang Wang
raw_affiliation_string: College of Computer Science and Technology , Shanghai University of Electric Power, Shanghai 201306, China

Abstract: Abstract Deep learning has been widely adopted in the field of network traffic classification due to its unique advantages in handling encrypted network traffic. However, most existing deep learning models can only classify known encrypted traffic that has been sampled and labeled. In this paper, we propose CM-UTC, a cost-sensitive matrix-based method for classifying unknown encrypted traffic. CM-UTC explores the probability distribution of the DNN output layer to filter out the unknown classes and further designs a cost-sensitive matrix to address the class imbalance problem. Additionally, we propose the utilization of the Harris Hawk optimization algorithm to modify the model parameters and improve its performance. The experiments are validated on two different datasets, and the results demonstrate that CM-UTC not only outperforms existing methods in terms of overall performance but also exhibits superior capability in correctly identifying samples from the minority class.
Selective Partitioned Regression for Accurate Kidney Health Monitoring

Authors:
raw_author_name: David C. Anastasiu
raw_affiliation_string: Computer Science and Engineering, Santa Clara University, 500 El Camino Real, Santa Clara, CA, 95053, USA

Abstract: Abstract The number of people diagnosed with advanced stages of kidney disease have been rising every year. Early detection and constant monitoring are the only minimally invasive means to prevent severe kidney damage or kidney failure. We propose a cost-effective machine learning-based testing system that can facilitate inexpensive yet accurate kidney health checks. Our proposed framework, which was developed into an iPhone application, uses a camera-based bio-sensor and state-of-the-art classical machine learning and deep learning techniques for predicting the concentration of creatinine in the sample, based on colorimetric change in the test strip. The predicted creatinine concentration is then used to classify the severity of the kidney disease as healthy, intermediate, or critical. In this article, we focus on the effectiveness of machine learning models to translate the colorimetric reaction to kidney health prediction. In this setting, we thoroughly evaluated the effectiveness of our novel proposed models against state-of-the-art classical machine learning and deep learning approaches. Additionally, we executed a number of ablation studies to measure the performance of our model when trained using different meta-parameter choices. Our evaluation results indicate that our selective partitioned regression (SPR) model, using histogram of colors-based features and a histogram gradient boosted trees underlying estimator, exhibits much better overall prediction performance compared to state-of-the-art methods. Our initial study indicates that SPR can be an effective tool for detecting the severity of kidney disease using inexpensive lateral flow assay test strips and a smart phone-based application. Additional work is needed to verify the performance of the model in various settings.
Online Sequence-Based Deep Learning Approach for Metallic Debossed and Embossed Turbomachinery Blade Text Recognition Application

Authors:
raw_author_name: A. Youssef
raw_affiliation_string: Baker Hughes, Florence, Tuscany, Italy
raw_author_name: P. Mishra
raw_affiliation_string: Baker Hughes, Bengaluru, Karnataka, India
raw_author_name: G. Veneri
raw_affiliation_string: Baker Hughes, Florence, Tuscany, Italy

Abstract: Abstract Extracting the engraved characters of metal parts in the industrial sphere remains a challenging task due to low visual contrast, uneven illumination, corroded surfaces, and cluttered backgrounds of metal part images. Affected by these factors, generally existing methods could not identify low-contrast text areas very well. Furthermore, the task is complicated by the fact that the embossed and deposed text can have a wide range of appearances, including variations in curvature, orientation, and distortion, which makes it more difficult to accurately recognize the text. In this paper, we investigate a sequence-based approach consisting of detection and recognition deep learning models for blade text recognition. These models are integrated into a feedforward pipeline that segments, detects, and recognizes embossed and debossed imprinted text on metal surfaces. The text localization model utilizes a U-shaped network with a VGG-16 architecture for feature extraction. On the other hand, the text recognition model is an end-to-end convolutional neural network designed for image-based text recognition, capable of handling arbitrary sequence lengths and orientations.
Research and Application of Adaptive Ghost Wave Suppression Method in Time-Space Domain

Authors:
raw_author_name: Yichuan Wang
raw_affiliation_string: Pan yong
raw_author_name: Xugang Ma
raw_affiliation_string: Pan yong

Abstract: Summary Source ghost waves and cable ghost waves can generate frequency trapping effects, resulting in the loss of low-frequency and high-frequency information in seismic data, seriously affecting the imaging quality of seismic data, and increasing the difficulty of later seismic data interpretation and reservoir inversion. The ghost wave delay time can be expressed as a function of the depth of the detector. When the cable depth is accurate, the difference between the total wave field minus the primary wave field and the ghost wave energy should be minimized. Convert the automatic optimization problem of cable depth into a least squares problem, and obtain the true cable depth by solving the objective function. By scanning the depth of the cable and combining it with the matching subtraction algorithm, accurate cable depth can be obtained. Design an anti filter to effectively suppress ghost waves. By designing a single-layer reflection model for algorithm testing, the effectiveness of this method is verified. After removing ghost waves, the energy of the trap points has been greatly restored and improved, and the energy of the low-frequency and high-frequency ends of seismic data has been well improved. Adaptive ghost wave suppression technology can effectively suppress source ghost waves and cable ghost waves, achieving the goal of eliminating traps, expanding seismic frequency bands, and improving seismic data resolution. This method not only has good processing results in actual marine seismic data processing, but also has high processing efficiency and good applicability to seismic data. It can be well applied to conventional horizontal cable seismic data and oblique cable seismic data. Significant improvement in the quality of seismic data provides an important data foundation for reservoir research.
Metaverse: Accelerates Upstream Growth with the Power of Immersive Collaboration

Authors:
raw_author_name: Badr Al-Harbi
raw_affiliation_string: Saudi Aramco, Dhahran, Eastern, Saudi Arabia

Abstract: Abstract The global transition towards sustainable future influenced industries to create a fundamental shift in the way they conduct the business to improve sustainability. This paper presents a comprehensive immersive platform that enables multidisciplinary teams and management to make decisions. It connects professionals to collaboratively demonstrate and share findings, run cross-functions business processes in an intuitive way capitalizing on artificial intelligence and cognitive capabilities. All of this is under a unified platform that we called the Upstream Metaverse. There are four pillars for the Upstream Metaverse: digital assets, real-time collaboration, intelligence, and venues. First digital assets, which include visualization of reservoir simulation static and dynamic properties (e.g., porosity, permeability, water, oil saturation, etc.), other datatypes such as core and well log data. Second is the collaboration and interactive capabilities that allows engineers to be immersed into their models, and run different scenarios. Third is the intelligent layer, which capitalizes on available Industrial Revolution 4.0 (IR4.0) solutions. Fourth is the collaboration venues represented by the Upstream collaboration centers to maximize the user experience. A synthetic model was used in this paper to demonstrate well placement process, which is one of the Upstream complex processes as it involves many stakeholders. Upstream Metaverse streamlined the process by integrating the key data, and workflows needed for the decision process in a single platform. It enables multiple intuitive visualization methods of well logs to address the complexity. In addition, it provides the visualization of structured data including reservoir models that can be cross-referenced with well logs. Moreover, it provides seamless integration with an intelligent voice assistant to enrich the user experience. These capabilities allow multidisciplinary teams to run different business scenarios, conduct effective field reviews, and collaboratively discuss their findings in an interactive and immersive platform. This allows real-time collaboration around the data for all participants. Furthermore, coupling Upstream Metaverse with digital transformation solutions provides a rich platform that is capable to effectively facilitate the meetings. Also, capitalizing on the integrated data sources, and cross-organization functions combined with streamlined IR4.0 processes enabled on spot decision making. The Upstream Metaverse established the main building blocks that are fully integrated with data repositories to address current and future challenges. This will directly increase the efficiency of conducting Upstream cross-functions operations through a single, unified, immersive, and collaborative platform. Upstream Metaverse is a sustainable environment that reduces the need for sequel meetings, supplemental silo efforts, and computation resources.
LLMs, Embeddings and Indexing Pipelines to Enable Natural Language Searching on Upstream Datasets

Authors:
raw_author_name: James Lee Martin
raw_affiliation_string: PETRONAS, Kuala Lumpur, Malaysia, now with Aramco

Abstract: Abstract Large Language Models (LLMs) are attracting an enormous amount of interest at the moment in many domains. Their general nature, and ability to "understand" natural language, has already stimulated multiple areas of research at our company. Here we successfully demonstrate a Natural Language querying system, which is able to search a large repository of unstructured exploration data. The system supports follow up querying on the returned results, plus automatic summarization of content. The system is integrated into our novel end-to-end data-mining platform, which continuously mines our unstructured exploration data for new changes and indexes the results. Important in our method are the enrichment processes that occur prior to use of the LLM. Our approach avoids usual "chunking" techniques, which in our experience results in inferior results, especially in the multiple domain areas of Exploration. By integrating our novel ontology-model AI in the enrichment of the initial Index, we drastically boost the performance of search resulting from the LLM steps. In order to perform the search, key parts of our unstructured data, plus the query itself, need to be transformed into a vector form. This is performed using the embedding feature of the LLM. For this work, we had around 500,000 embeddings to calculate. To improve performance these were indexed in a leading Analytics Engine as a vector object, allowing fast search via cosine or Euclidian similarity. A custom dashboard was made to allow fresh searches of the vector datastore to be returned for further analysis. Our current search time across 500,000 embeddings is under 20 milli-seconds. Our custom dashboard returns the top matches for further interrogation and analysis. This includes follow-up Natural Language question support on the returned matches for summarization tasks and other customised querying. Since our exploration-specific, ontology model is able to tag each piece of data with over 40 exploration-specific labels, we are able to cross-examine the LLM returned results with the tags. Agreement on a range of queries - ranging from targeted, highly specific questions to general, open-ended queries - was surprisingly good. Natural Language based querying of our unstructured data is opening a whole new approach to data discovery in our company. Tailoring it to the exploration domain has required specific domain expertise and a novel ontology-model be used to ensure relevant prompts and query results. Obtaining search results quickly has also required expertise and fine-tuning. Future directions include ingesting more data, scaling the support infrastructure and further capability enhancement.