jimnoneill/paper-to-field-training huggingface dataset:
End-to-End Supermask Pruning: Learning to Prune Image Captioning Models

With the advancement of deep models, research work on image captioning has led to a remarkable gain in raw performance over the last decade, along with increasing model complexity and computational cost. However, surprisingly works on compression of deep networks for image captioning task has received little to no attention. For the first time in image captioning research, we provide an extensive comparison of various unstructured weight pruning methods on three different popular image captioning architectures, namely Soft-Attention, Up-Down and Object Relation Transformer. Following this, we propose a novel end-to-end weight pruning method that performs gradual sparsification based on weight sensitivity to the training loss. The pruning schemes are then extended with encoder pruning, where we show that conducting both decoder pruning and training simultaneously prior to the encoder pruning provides good overall performance. Empirically, we show that an 80% to 95% sparse network (up to 75% reduction in model size) can either match or outperform its dense counterpart. The code and pre-trained models for Up-Down and Object Relation Transformer that are capable of achieving CIDEr scores &gt;120 on the MS-COCO dataset but with only 8.7 MB and 14.5 MB in model size (size reduction of 96% and 94% respectively against dense versions) are publicly available at https://github.com/jiahuei/sparse-image-captioning.

Topic: Multimodal Machine Learning Applications
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Low-Energy Laser Irradiation Reduces Formation of Scar Tissue After Myocardial Infarction in Rats and Dogs

Background —Low-energy laser irradiation (LELI) has been found to attenuate various biological processes in tissue culture and experimental animal models. The aim of the present study was to investigate the effect of LELI on the formation of scar tissue in experimentally induced chronic infarct in rats and dogs. Methods and Results —Myocardial infarction (MI) was induced in 50 dogs and 26 rats by ligation of the left anterior descending coronary artery. After induction of MI, the laser-irradiated (LI) group received laser irradiation (infrared laser, 803-nm wavelength) epicardially. Control MI-induced non–laser irradiated (NLI) dogs were sham-operated, and laser was not applied. All dogs were euthanized at 5 to 6 weeks after MI. Infarct size was determined by TTC staining and histology. The laser treatment ( P &lt;0.05) lowered mortality significantly, from 30% to 6.5%, after induction of MI. The infarct size in the LI dogs was reduced significantly ( P &lt;0.0001) (52%) compared with NLI dogs. Histological observation of the infarct revealed a typical scar tissue in NLI dogs and cellularity in most of the LI dogs. Only 14±3% of the mitochondria in the cardiomyocytes in the ischemic zone (4 hours after MI) of LI MI-induced rats were severely damaged, compared with 36±1% in NLI rats. Accordingly, ATP content in that zone was 7.6-fold (significantly) higher in LI than in NLI rats. Conclusions —Our observations indicate that epicardial LELI of rat and dog hearts after chronic MI caused a marked reduction in infarct size, probably due to a cardioprotective effect of the LELI.

Topic: Laser Applications in Dentistry and Medicine
Subfield: Radiology, Nuclear Medicine and Imaging
Field: Medicine
Domain: Health Sciences
Gastroenterology in Motion

Endoscopic submucosal dissection (ESD) has developed into an accepted therapy for early gastroinestinal neoplasia, especially in Asian countries.1– 4 A ajor benefit of ESD is that it allows en bloc resection nd, thus, decreases risk of neoplastic recurrence.5 Western endoscopists have not embraced ESD techniques nearly as readily as their Eastern counterparts. This is likely due to a multitude of factors including low incidence of gastric malignancies, less exposure to ESD training, reimbursement issues, lengthy procedural times, and higher complication rates as compared to endoscopic mucosal resection (EMR).6 Methods that simplify the steps associated with ESD may help to proliferate its use. A new endoscopic gel (Cook Medical Inc, Winston-Salem, NC) was recently developed. This viscous gel was introduced for submucosal injection prior to excision of lesions of the gastrointestinal tract as the lesions are lifted by a visible bleb. Our exploratory laboratory experiments suggested that the gel also has tissue dissecting properties. Here, we present our initial experience with the use of this novel gel for facilitating submucosal dissection during gastric ESD.

Topic: Gastric Cancer Management and Outcomes
Subfield: Pulmonary and Respiratory Medicine
Field: Medicine
Domain: Health Sciences
Adrenergic Innervation of the Left Side of the Guinea Pig Heart

Histological, histochemical fluorescence, and electron microscopic techniques have been utilized to demonstrate the specific distribution of the noradrenergic sympathetic postganglionic fibers to the guinea pig left atrium and ventricle. The majority of these nerves entered the base of the heart. Paravascular bundles of unmyelinated sympathetic postganglionic fibers traversed the left atrioventricular sulcus. From these paravascular plexuses axons accompanied the arteries via periarterial plexuses to the deeper layers of the heart wall. The vascular tree was extremely complex. In the left atrium a relatively abundant noradrenergic innervation was seen within the interstitial connective tissue surrounding the cardiac muscle. In the left ventricle, most of the noradrenergic innervation was located in the tunica adventitia of all the major coronary arterial branches before they entered the cardiac muscle. These larger branches of the coronary arteries were predominantly innervated by the sympathetic postganglionic fibers. Apparently it is from these perivascular nerve plexuses that the left ventricular muscle receives the majority of its noradrenergic innervation.

Topic: Cardiac Arrhythmias and Treatments
Subfield: Cardiology and Cardiovascular Medicine
Field: Medicine
Domain: Health Sciences
Research on the impact of digital finance on the innovation performance of enterprises

Purpose The purposes of this paper are to analyze whether digital finance can contribute to enterprises' innovation performance and to determine the mediating effect of government subsidies. Design/methodology/approach This paper empirically examines the impacts of digital finance on enterprises' innovation performance by looking at Chinese companies listed on the SME and GEM boards from 2011 to 2018 to build an econometric model to test our hypotheses. The mediating effect of government subsidies, the moderating effect of financial constraints are examined, as well as shareholding of the largest shareholders in each selected company and the asset-liability ratio. Findings The results show that digital finance has a significant promotional effect on firms' innovation performance and that government subsidies play a partial mediating role in digital finance's contribution to firms' innovation performance. In addition, financial constraints and the shareholding of the largest shareholders in each selected company have a negative moderating effect on the relationship between government subsidies and firms' innovation performance. On the contrary, the asset-liability ratio is found to positively affect the relationship. Originality/value There has been limited research to date on the relationship between digital finance and firms' innovation performance, particularly with regard to the extent to which digital finance can influence innovation performance and the mechanisms for doing so. Therefore, it is of great significance to examine the relationship between digital finance and enterprises' innovation performance, which can also provide guidance for both the Chinese government and enterprises.

Topic: Innovation Policy and R&D
Subfield: Economics and Econometrics
Field: Economics, Econometrics and Finance
Domain: Social Sciences
[Renal lesions induced by cyclosporin. Apropos of 4 renal biopsies and 22 necropsies of recipients of heart transplant].

The morphological study of kidney in patients without any preexistent renal disease and treated by cyclosporine corroborated the nephrotoxicity of this immunosuppressive drug. 4 biopsies (in 2 patients with Behçet's disease, in 1 recipient of allogenic medullary graft and 1 recipient of heart transplant) were performed for acute renal failure observed in a variable time after the beginning of treatment (7th day to 14 months). In two cases, they demonstrated obvious vascular lesions (arteriolar or glomerular thrombosis, fibrinoïd necrosis) and they detected constantly changes of proximal convoluted tubules (epithelial vacuolization or necrosis, calcifications). In addition, the ultrastructural study performed in all cases showed a striking increase of lysosomes and some giant mitochondria. The 8 autopsies of recipients with heart transplants treated by cyclosporine for more than 1 month corroborated also these renal changes which were always correlated with biological perturbations of the renal function (increase of level of serum creatinine). Besides the proximal convoluted tubular lesions (vacuolization, necrosis and calcifications), an obvious increase of the interstitial tissue proportional to the long time of treatment was always detected.

Topic: Ocular Diseases and Behçet’s Syndrome
Subfield: Ophthalmology
Field: Medicine
Domain: Health Sciences
Modulation of T-cell activation by the glucocorticoid-induced leucine zipper factor via inhibition of nuclear factor κB

Abstract Previously a novel gene was identified that encodes a glucocorticoid-induced leucine zipper (GILZ) whose expression is up-regulated by dexamethasone. This study analyzed the role of GILZ in the control of T-cell activation and its possible interaction with nuclear factor κB (NF-κB). Results indicate that GILZ inhibits both T-cell receptor (TCR)–induced interleukin-2/interleukin-2 receptor expression and NF-κB activity. In particular, GILZ inhibits NF-κB nuclear translocation and DNA binding due to a direct protein-to-protein interaction of GILZ with the NF-κB subunits. Moreover, GILZ-mediated modulation of TCR-induced responses is part of a circuit because TCR triggering down-regulates GILZ expression. These results identify a new molecular mechanism involved in the dexamethasone-induced regulation of NF-κB activity and T-cell activation.

Topic: NF-κB Signaling Pathways
Subfield: Cancer Research
Field: Biochemistry, Genetics and Molecular Biology
Domain: Life Sciences
A Low-Latency Inference of Randomly Wired Convolutional Neural Networks on an FPGA

Convolutional neural networks (CNNs) are widely used for image processing tasks in both embedded systems and data centers. In data centers, high accuracy and low latency are desired for various tasks such as image processing of streaming videos. We propose an FPGA-based low-latency CNN inference for randomly wired convolutional neural networks (RWCNNs), whose layer structures are based on random graph models. Because RWCNNs have several convolution layers that have no direct dependencies between them, our architecture can process them efficiently using a pipeline method. At each layer, we need to use the calculation results of multiple layers as the input. We use an FPGA with HBM2 to enable parallel access to the input data with multiple HBM2 channels. We schedule the order of execution of the layers to improve the pipeline efficiency. We build a conflict graph using the scheduling results. Then, we allocate the calculation results of each layer to the HBM2 channels by coloring the graph. Because the pipeline execution needs to be properly controlled, we developed an automatic generation tool for hardware functions. We implemented the proposed architecture on the Alveo U50 FPGA. We investigated a trade-off between latency and recognition accuracy for the ImageNet classification task by comparing the inference performances for different input image sizes. We compared our accelerator with a conventional accelerator for ResNet-50. The results show that our accelerator reduces the latency by 2.21 times. We also obtained 12.6 and 4.93 times better efficiency than CPU and GPU, respectively. Thus, our accelerator for RWCNNs is suitable for low-latency inference.

Topic: Advanced Neural Network Applications
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
AGE DYNAMICS OF THE LIVE WEIGHT OF THE KAZAKH WHITE-HEADED BREED OF BEEF CATTLE

The aim of the study is to establish the age dynamics of the variability of live weight with the average daily liveweight gain of the Kazakh whiteheaded breed of beef cattle. In all analyzed agricultural enterprises at the age of six months, the live weight of bulls varied from 172.4 kg to 196.5 kg, and in heifers – from 160.1 kg to 180.7 kg, respectively. According to the indicators of the average daily liveweight gain, there are some differences between bulls and heifers. From birth to 210 days of age, the average daily liveweight gain was 846.03 g in bulls, 784.4 g in heifers; from 210 days of age to one year of age it was 732 g in bulls and 599 g in heifers; from birth to one year of age, the average daily liveweight gain was 793.6 g in bulls and 707.5 g in heifers. Bulls at the age of six months generally meet the requirements of the breed standard, characterized by high coefficients of variability. The live weight of bulls in the farms “Zhannat”, “Tolegen” and “Alem” at the age of six months meets and slightly exceeds the requirements of the breed standard by 15.2 kg (8.2%), 13.0 kg (7.1%), 13.6 kg (7.4%), and in heifers by 15.7 kg (8.9%), 8.1 kg (4.8), 13.2 kg (7.6%), respectively. The value of the coefficient of variability of live weight has average values with a slight excess in heifers. It was found that the live weight of bulls in the farm “Kairat” and the farm “Naryn” exceeded the breed standard by 26.5 kg (13.5%) and 21.1 kg (11%), heifers by 20.7 kg (11.5) and 7.8 kg (4.6%), respectively, and belongs to the elite classes. The average daily liveweight gain of young Kazakh white-headed breed in the studied farms varied from 826.7 to 944.2 g in bulls, and in heifers from 711.1 to 887.2 g, respectively that indicates a relatively high liveweight gain obtained in farm conditions.

Topic: Animal Nutrition and Health
Subfield: Plant Science
Field: Agricultural and Biological Sciences
Domain: Life Sciences
Late Onset Central Hypoventilation Syndrome due to a Heterozygous Polyalanine Repeat Expansion Mutation in the PHOX2B Gene

This report describes a 6 year old girl with late onset central hypoventilation syndrome due to a heterozygous polyalanine repeat expansion mutation in the PHOX2B gene. This report aims to increase the awareness of this condition among physicians to allow earlier clinical and genetic diagnosis and management of cases of unexplained hypoventilation.

Topic: Neuroscience of respiration and sleep
Subfield: Endocrine and Autonomic Systems
Field: Neuroscience
Domain: Life Sciences
ANALYSIS OF CHARACTER EDUCATION VALUES IN THE ELT TEXTBOOK FOR JUNIOR HIGH SCHOOL STUDENTS

Character education (CE) is essential in developing students' personalities. In character development, English Language Teaching (ELT) textbooks have a vital role in supporting character education. However, ELT textbooks published in Indonesia and abroad underrepresent the characters that fulfill the curriculum goals of CE. Based on previous research that had been conducted in Indonesia, English textbooks in the 2013 curriculum were not representative of Indonesian culture and showed character gaps in the textbooks. Therefore, this research investigated CE in the English textbook based on the emancipated curriculum. This study analyzed the ELT textbook for the seventh-grade junior high school in the current curriculum called “English for Nusantara” by utilizing the Pancasila Student Profile to analyze CE. Content analysis by Ary et al. (2010) was selected as an analysis method for analyzing CE through visual materials. The results show that there are character gaps presented in ELT textbooks. The characters of having Faith fear of the Almighty God and noble character are more dominant in the textbook. This provides an opportunity for future researchers to examine CE by investigating diverse research objects so that CE can be conveyed relevantly.

Topic: Education and Character Development
Subfield: Education
Field: Social Sciences
Domain: Social Sciences
Data from Epigenetic Regulation of KPC1 Ubiquitin Ligase Affects the NF-κB Pathway in Melanoma

&lt;div&gt;Abstract&lt;p&gt;&lt;b&gt;Purpose:&lt;/b&gt; Abnormal activation of the NF-κB pathway induces a more aggressive phenotype of cutaneous melanoma. Understanding the mechanisms involved in melanoma NF-κB activation may identify novel targets for this pathway. KPC1, an E3 ubiquitin ligase, is a regulator of the NF-κB pathway. The objective of this study was to investigate the mechanisms regulating KPC1 expression and its clinical impact in melanoma.&lt;/p&gt;&lt;p&gt;&lt;b&gt;Experimental Design:&lt;/b&gt; The clinical impact of KPC1 expression and its epigenetic regulation were assessed in large cohorts of clinically well-annotated melanoma tissues (tissue microarrays; &lt;i&gt;n&lt;/i&gt; = 137, JWCI cohort; &lt;i&gt;n&lt;/i&gt; = 40) and The Cancer Genome Atlas database (TCGA cohort, &lt;i&gt;n&lt;/i&gt; = 370). Using melanoma cell lines, we investigated the functional interactions between KPC1 and NF-κB, and the epigenetic regulations of KPC1, including DNA methylation and miRNA expression.&lt;/p&gt;&lt;p&gt;&lt;b&gt;Results:&lt;/b&gt; We verified that KPC1 suppresses melanoma proliferation by processing NF-κB1 p105 into p50, thereby modulating NF-κB target gene expression. Concordantly, KPC1 expression was downregulated in American Joint Committee on Cancer stage IV melanoma compared with early stages (stage I/II &lt;i&gt;P&lt;/i&gt; = 0.013, stage III &lt;i&gt;P&lt;/i&gt; = 0.004), and low KPC1 expression was significantly associated with poor overall survival in stage IV melanoma (&lt;i&gt;n&lt;/i&gt; = 137; HR 1.810; &lt;i&gt;P&lt;/i&gt; = 0.006). Furthermore, our data showed that high miR-155-5p expression, which is controlled by DNA methylation at its promoter region (TCGA; Pearson's &lt;i&gt;r&lt;/i&gt; −0.455; &lt;i&gt;P&lt;/i&gt; &lt; 0.001), is significantly associated with KPC1 downregulation (JWCI; &lt;i&gt;P&lt;/i&gt; = 0.028, TCGA; &lt;i&gt;P&lt;/i&gt; = 0.003).&lt;/p&gt;&lt;p&gt;&lt;b&gt;Conclusions:&lt;/b&gt; This study revealed novel epigenetic regulation of KPC1 associated with NF-κB pathway activation, promoting metastatic melanoma progression. These findings suggest the potential utility of KPC1 and its epigenetic regulation as theranostic targets. &lt;i&gt;Clin Cancer Res; 23(16); 4831–42. ©2017 AACR&lt;/i&gt;.&lt;/p&gt;&lt;/div&gt;

Topic: Histone Deacetylase Inhibitors Research
Subfield: Molecular Biology
Field: Biochemistry, Genetics and Molecular Biology
Domain: Life Sciences
In vivo Evaluation of the Pathogenicity of Field Isolates of Infectious Bronchitis Virus

The pathogenicity of 13 field isolates of infectious bronchitis virus (IBV) isolated from Georgia broiler farms from 1989 to 1992 was evaluated using the IBV and Escherichia coli mixed-infection model. Based on the clinical signs, mortality, and lesions, the isolates were classified as high, intermediate, and low in pathogenicity. The in vivo classification was compared with the serotype classification results obtained by reverse transcriptase-polymerase chain reaction-restriction fragment length polymorphism analysis. The high-pathogenicity group was composed of five isolates representing three serotypes: Arkansas, Georgia variant (GAV), and Massachusetts. Isolates in the intermediate- and low-pathogenicity groups were all representatives of the Connecticut serotype, except for one isolate, which belonged to the Massachusetts serotype.

Topic: Animal Virus Infections Studies
Subfield: Animal Science and Zoology
Field: Agricultural and Biological Sciences
Domain: Life Sciences
Electromagnetic Properties of a Hot and Dense Medium

We study the properties of an electromagnetically interacting medium in the presence of high concentration of electrons at extremely high temperatures and chemical potentials. We show that the electromagnetic properties of a medium such as the electric permittivity, magnetic permeability, magnetic moments and the propagation speed of electromagnetic waves as well as the corresponding particle processes depend on temperature and density of the medium. Electromagnetic properties of neutrinos are significantly modified due to their interactions with electrons when they propagate through such a medium of hot and dense electrons.

Topic: Magnetic and Electromagnetic Effects
Subfield: Physiology
Field: Biochemistry, Genetics and Molecular Biology
Domain: Life Sciences
EFFICIENCY OF USING ECONOMIC AND STATISTICAL METHODS IN ANALYSIS AND MANAGEMENT OF COMMODITY INVENTORIES

In the given article problems of stock management and procedure of carrying out the analysis of commodity stocks with use of economic and statistical methods at the trading enterprise were considered.Methods of economic and statistical research -the concept is very broad and has a wide range.This general term covers a range of modern scientific approaches, methods, tools, methods of measurement, formalized description, analysis and forecasting of economic phenomena and processes inherent in the financial, investment, tax system, and therefore in modern economic development, business activities of commercial enterprises , which must maintain competitiveness, reliable and profitable operation in the long run, largely depends on their ability to meet the needs of a personal nature, as modern consumers and have the ability to increase their own turnover.To achieve this goal, trading companies must be able to maintain the necessary turnover of goods, provide the necessary range and quality of inventories, to effectively control the use and management in this process, which ensures the profit and efficiency of the enterprise.Thus, the relevance lies in the answers to the following questions: "How to skillfully implement the analysis of inventories and the effectiveness of their use in commercial enterprises, which will ensure effective control and management decisions in terms of this issue?"affects the financial condition of commercial enterprises, because the presence or absence of stocks leads to both costs and revenues.

Topic: Economic and Business Development Strategies
Subfield: Economics and Econometrics
Field: Economics, Econometrics and Finance
Domain: Social Sciences