Miracle-dz/UniFAR-FTUs huggingface dataset:
SHINE: SHaring the INverse Estimate from the forward pass for bi-level optimization and implicit models

In recent years, implicit deep learning has emerged as a method to increase the effective depth of deep neural networks. While their training is memory-efficient, they are still significantly slower to train than their explicit counterparts. In Deep Equilibrium Models (DEQs), the training is performed as a bi-level problem, and its computational complexity is partially driven by the iterative inversion of a huge Jacobian matrix. In this paper, we propose a novel strategy to tackle this computational bottleneck from which many bi-level problems suffer. The main idea is to use the quasi-Newton matrices from the forward pass to efficiently approximate the inverse Jacobian matrix in the direction needed for the gradient computation. We provide a theorem that motivates using our method with the original forward algorithms. In addition, by modifying these forward algorithms, we further provide theoretical guarantees that our method asymptotically estimates the true implicit gradient. We empirically study this approach and the recent Jacobian-Free method in different settings, ranging from hyperparameter optimization to large Multiscale DEQs (MDEQs) applied to CIFAR and ImageNet. Both methods reduce significantly the computational cost of the backward pass. While SHINE has a clear advantage on hyperparameter optimization problems, both methods attain similar computational performances for larger scale problems such as MDEQs at the cost of a limited performance drop compared to the original models.
Gender Bias Hidden Behind Chinese Word Embeddings: The Case of Chinese Adjectives

Gender bias in word embeddings gradually becomes a vivid research field in recent years. Most studies in this field aim at measurement and debiasing methods with English as the target language. This paper investigates gender bias in static word embeddings from a unique perspective, Chinese adjectives. By training word representations with different models, the gender bias behind the vectors of adjectives is assessed. Through a comparison between the produced results and a human scored data set, we demonstrate how gender bias encoded in word embeddings differentiates from people’s attitudes.
Reward is enough for convex MDPs

Maximising a cumulative reward function that is Markov and stationary, i.e., defined over state-action pairs and independent of time, is sufficient to capture many kinds of goals in a Markov decision process (MDP). However, not all goals can be captured in this manner. In this paper we study convex MDPs in which goals are expressed as convex functions of the stationary distribution and show that they cannot be formulated using stationary reward functions. Convex MDPs generalize the standard reinforcement learning (RL) problem formulation to a larger framework that includes many supervised and unsupervised RL problems, such as apprenticeship learning, constrained MDPs, and so-called `pure exploration'. Our approach is to reformulate the convex MDP problem as a min-max game involving policy and cost (negative reward) `players', using Fenchel duality. We propose a meta-algorithm for solving this problem and show that it unifies many existing algorithms in the literature.
The Causal Effect of Transport Infrastructure: Evidence from a New Historical Database

In this paper, we analyze the effect of transport infrastructure investments in railways on three measures of local economic activity: real nonagricultural income, agricultural land values and population size. As a testing ground, we use data from a new historical database that includes annual panel data on approximately 2,400 Swedish geographical units, i.e., local governments, during the period 1860-1917. We use a staggered event study design that is robust to treatment effect heterogeneity. Importantly, we find extremely large reduced-form effects of having access to railways. For real nonagricultural income, the cumulative treatment effect is approximately 120% after 30 years. Therefore, this effect is 20 times larger than most reducedform effects found in previous works on the effect of transport infrastructure on economic activity. Equally important, we also show that our reduced-form effect reflects growth rather than a reorganization of existing economic activity.  We would like to thank Clément de Chaisemartin, Xavier D'Haultfoeuille, Dave Donaldson and Rick Hornbeck for their useful comments. This work was financed by an ERC consolidator grant (616496) (Pettersson-Lidbom).  Department of Economics, Stockholm University; email: erik.lindgren@ne.su. se  Department of Economics, Stockholm University and Research Institute of Industrial Economics (IFN), email: pp@ne.su. se  Research Institute of Industrial Economics (IFN) and Department of Economics, Stockholm University and IFN, email: bjorn.tyrefors@ifn.se.
SpanNER: Named Entity Re-/Recognition as Span Prediction

Recent years have seen the paradigm shift of Named Entity Recognition (NER) systems from sequence labeling to span prediction. Despite its preliminary effectiveness, the span prediction model’s architectural bias has not been fully understood. In this paper, we first investigate the strengths and weaknesses when the span prediction model is used for named entity recognition compared with the sequence labeling framework and how to further improve it, which motivates us to make complementary advantages of systems based on different paradigms. We then reveal that span prediction, simultaneously, can serve as a system combiner to re-recognize named entities from different systems’ outputs. We experimentally implement 154 systems on 11 datasets, covering three languages, comprehensive results show the effectiveness of span prediction models that both serve as base NER systems and system combiners. We make all codes and datasets available: https://github.com/neulab/spanner, as well as an online system demo: http://spanner.sh. Our model also has been deployed into the ExplainaBoard platform, which allows users to flexibly perform a system combination of top-scoring systems in an interactive way: http://explainaboard.nlpedia. ai/leaderboard/task-ner/.
Reconciliation of Statistical and Spatial Sparsity For Robust Image and Image-Set Classification

Recent image classification algorithms, by learning deep features from large-scale datasets, have achieved significantly better results comparing to the classic feature-based approaches. However, there are still various challenges of image classifications in practice, such as classifying noisy image or image-set queries and training deep image classification models over the limited-scale dataset. Instead of applying generic deep features, the model-based approaches can be more effective and data-efficient for robust image and image-set classification tasks, as various image priors are exploited for modeling the inter- and intra-set data variations while preventing over-fitting. In this work, we propose a novel Joint Statistical and Spatial Sparse representation, dubbed \textit{J3S}, to model the image or image-set data for classification, by reconciling both their local patch structures and global Gaussian distribution mapped into Riemannian manifold. To the best of our knowledge, no work to date utilized both global statistics and local patch structures jointly via joint sparse representation. We propose to solve the joint sparse coding problem based on the J3S model, by coupling the local and global image representations using joint sparsity. The learned J3S models are used for robust image and image-set classification. Experiments show that the proposed J3S-based image classification scheme outperforms the popular or state-of-the-art competing methods over FMD, UIUC, ETH-80 and YTC databases.
Electromagnetic waves in Born Electrodynamics

We study two counter–propagating electromagnetic waves in the vacuum within the framework of the Born–Infeld theory in quantum electrodynamics. By choosing the crossed field case E ·B = 0, i.e. G = 0, the Born–Infeld Lagrangian reduces to the Born Lagrangian, therefore for this special case we present study which is identical for the Born–Infeld and the Born electrodynamics. In this paper, we show that the non–linear field equations decouple for ordinary wave case using selfsimilar solutions and we investigate the shock wave steepening. We show that the only solutions are exceptional traveling wave solutions which propagate with constant speed and which do not turn into shocks. We discuss the phase shift and the cross section of the process to be measured together with the our proposed direct detection of the photon–photon scattering [1, 2]. This work serves as a preliminary study towards analyzing the waves in the more general case in the Born–Infeld theory.
Boards in Microbanks : How Do Stakeholders Matter ? January , 2011 Neema

Microbanks provide financial services to low income people. Governance of these organizations is important for them to efficiently reach poor people and survive financially. Board is one among several governance mechanisms. This paper empirically analyses the influence of stakeholders who sit on boards, on board structure and performance of microbanks. Based on agency, resource dependence and stakeholder theories, we analyze four types of stakeholders; donors, customers, employees and creditors. Results show that stakeholders are important and have different influences in microbanks. We find donors to be strict in monitoring by advocating for small boards and non duality. Employees and customers are more of resource providers and we find them to be associated with large boards. We further evidence that stakeholders are more interested in microbanks ability to cover for its operation costs. Study implications and areas for future research are further discussed.
ENCE FROM THE U S PANE L S TUDY OF I NCOME DYNAM I C S

Using a sequence of questions from the 1996 US Panel Study of Income Dynamics (PSID), we explore the implications of interpersonal differences in parent’s attitudes towards risk for the academic test scores of their children focusing on information drawn from the 1997 Child Development Supplement of the PSID. In addition, we explore whether parental risk preference influences whether the child subsequently attends college. Our findings suggest that a parent’s degree of risk aversion is inversely related to the academic test scores of their children as well as being inversely related to the probability of attending college post high school.
Caustic-Side Solvent Extraction Chemical and Physical Properties Progress in FY 2000 and FY 2001.

The purpose of this work was to provide chemical- and physical-property data addressing the technical risks of the Caustic-Side Solvent Extraction (CSSX) process as applied specifically to the removal of cesium from alkaline high-level salt waste stored at the US Department of Energy Savannah River Site. As part of the overall Salt Processing Project, this effort supported decision-making in regards to selecting a preferred technology among three alternatives: (1) CSSX, (2) nonelutable ion-exchange with an inorganic silicotitanate material and (3) precipitation with tetraphenylborate. High risks, innate to CSSX, that needed specific attention included: (1) chemical stability of the solvent matrix, (2) radiolytic stability of the solvent matrix, (3) proof-of-concept performance of the proposed process flowsheet with simulated waste, and (4) performance of the CSSX flowsheet with actual SRS high-level waste. This body of work directly addressed the chemical-stability risk and additionally provided supporting information that served to plan, carry out, and evaluate experiments conducted by other CSSX investigators addressing the other high risks. Information on cesium distribution in extraction, scrubbing, and stripping served as input for flowsheet design, provided a baseline for evaluating solvent performance under numerous stresses, and contributed to a broad understanding of the effects of expected process variables. In parallel, other measurements were directed toward learning how other system components distribute in the flowsheet. Such components include the solvent components themselves, constituents of the waste, and solvent-degradation products. Upon understanding which components influence flowsheet performance, it was then possible to address in a rational fashion how to clean up the solvent and maintain its stable function.
Trends in hospitalization, mortality, and timing of colonoscopy in patients with acute lower gastrointestinal bleeding

Abstract Background and study aims Current guidelines conditionally recommend performing early colonoscopy (EC) (< 24 hours) in patients admitted with acute lower gastrointestinal bleeding (LGIB). It remains unclear whether this practice is implemented widely. Therefore, we used the Nationwide Inpatient Sample to investigate trends for timing of colonoscopy in patients admitted with acute LGIB. We also assessed trend of hospitalization and mortality in patients with LGIB. Patients and methods Adult patients with LGIB admitted from 2005 to 2014 were examined. ICD-9-CM codes were used to extract LGIB discharges. Trends were assessed using Cochrane-Armitage test. Factors associated with mortality, cost of hospitalization, and length of stay (LOS) were assessed by multivariable mixed-effects and exact-matched logistic, linear regression, and accelerated-failure time models, respectively. Results A total of 814,647 patients with LGIB were included. The most common etiology of LGIB was diverticular bleeding (49 %) and 45 % of patients underwent EC. Over the study period, there was no change in the trend of colonoscopy timing. Although admission with LGIB increased over the study period, the mortality rate decreased for patients undergoing colonoscopy. Independent predictors of mortality were age, surgery (colostomy/colectomy) during admission, intensive care unit admission, acute kidney injury, and blood transfusion requirement. Timing of colonoscopy was not associated with mortality benefit. However, cost of hospitalization was $ 1,946 lower and LOS was 1.6 days shorter with EC. Conclusion Trends in colonoscopy timing in management of LGIB have not changed over the years. EC is associated with lower LOS and cost of hospitalization but it does not appear to improve inpatient mortality.
Evaluation of post-ERCP pancreatitis after biliary stenting with self-expandable metal stents vs. plastic stents in benign and malignant obstructions

Abstract Background and study aims There are conflicting data regarding the risk of post-ERCP pancreatitis (PEP) with self-expandable metallic stents (SEMS) compared to polyethylene stents (PS) in malignant biliary obstructions and limited data related to benign obstructions. Patients and methods A retrospective cohort study was performed of 1136 patients who underwent ERCP for biliary obstruction and received SEMS or PS at a tertiary-care medical center between January 2011 and October 2016. We evaluated the association between stent type (SEMS vs PS) and PEP in malignant and benign biliary obstructions. Results Among the 1136 patients included in our study, 399 had SEMS placed and 737 had PS placed. Patients with PS were more likely to have pancreatic duct cannulation, pancreatic duct stent placement, double guidewire technique, sphincterotomy and sphincteroplasty as compared to the SEMS group. On multivariate analysis, PEP rates were higher in the SEMS group (8.0 %) versus the PS group (4.8 %) (OR 2.27 [CI, 1.22, 4.24]) for all obstructions. For malignant obstructions, PEP rates were 7.8 % and 6.6 % for SEMS and plastic stents, respectively (OR 1.54 [CI, 0.72, 3.30]). For benign obstructions the PEP rate was higher in the SEMS group (8.8 %) compared to the PS group (4.2 %) (OR 3.67 [CI, 1.50, 8.97]). No significant differences between PEP severity were identified based on stent type when stratified based on benign and malignant. Conclusions PEP rates were higher when SEMS were used for benign obstruction as compared to PS. For malignant obstruction, no difference was identified in PEP rates with use of SEMS vs PS.
The effect of hypoxia on cytotoxicity, uptake and DNA binding of cisplatin and novel bis(platinum) complexes in Chinese hamster ovary cells

Disagreement exists in the literature as to whether the successful antitumour agent cisplatin exhibits greater toxicity in hypoxia than in air. In this study, Chinese hamster ovary cells were incubated in clinically relevant concentrations of cisplatin for periods of up to three hours in aerobic and hypoxic environments. For all incubation times studied, cells treated in hypoxia were more sensitive to cisplatin than those treated in air. Toxicity in hypoxic cells was up to two times greater than in aerobic cells. Detection of platinum using atomic absorption spectroscopy provided resolution fine enough to characterize whole cell uptake and DNA-binding of cisplatin at these concentrations. Cells treated in hypoxia showed consistently higher levels of platinum within the cells and bound to DNA than those treated in air. Furthermore, cells treated in hypoxia showed greater toxicity per platinum-DNA adduct and per atom of platinum bound per cell than those treated in air. Two novel bis(platinum) compounds AN-38 and AN-36, of structural formula {[Pt(malonate)(NH3)] 2H2N(CH2)„NH21 (n=6 and 4, respectively), were also found to be preferentially toxic to hypoxic cells, up to four times as toxic as in air (for a four hour incubation), although there was little increase in platinum uptake levels. To date, this study represents the most thorough investigation of cisplatin properties in air versus hypoxia, given that survival, whole cell uptake and DNA binding in the same cell population each showed enhanced effects in hypoxia. Suggestions of possible mechanisms explaining these data could form the basis for future studies.
Energy efficiency and appliance’s characteristics considered prior to purchase: Differences and similarities between the United Kingdom, Germany, Portugal, Greece, Poland, Spain and Italy

ABSTRACT This article reports country differences in the consumer’s most considered characteristics when choosing electrical appliances, including but not restricted to the energy efficiency aspect. A survey was performed to store customers from 7 countries: the United Kingdom; Germany; Portugal; Greece; Poland; Spain; Italy. Results showed consistency between countries in the top three characteristics considered: cost; quality; and a balance between price and quality. Differences were found for reported environmental attitudes and behaviours, purchase motives, and store employees evaluation. The results may support national policies and store level energy efficiency interventions. Specifically, they can provide input for store employee’s training, in persuading customers towards the purchase of energy efficient appliances.
Beclomethasone Microparticles for Wet Inhalation, Produced by Supercritical Assisted Atomization

Supercritical assisted atomization (SAA) was used to produce micronized particles of beclomethasone dipropionate (BDP) to be used for inhalation therapy. Methanol, acetone, acetone + water 9% v/v, and methanol + water 4% v/v were tested as liquid solvents to explore their influence on particle size and crystalline structure of the precipitated powder. Particles with narrow size distributions (PSD) were obtained by changing the SAA process operating conditions. In particular, using acetone + water 9% v/v with a BDP concentration of 90 mg/mL, crystalline particles ranging between 0.2 and 4.7 μm were produced and 70% by volume of these particles ranged between 1 and 3 μm. PSD stability analysis in a wet formulation showed that BDP powder obtained by SAA does not modify over a long period of time. The results obtained on the laboratory scale plant were successfully reproduced on a pilot plant and a further refinement of the operating conditions was performed. About 30 g of BDP microparticles were produced per batch and a recovery of about 93 wt % of the micronized powder with respect to the injected quantity was obtained. The largest volumetric fraction of BDP particles falling in the range 1-3 μm was 83% on the pilot scale.
Incidence of delirium in an acute geriatric community hospital: an exploratory analysis of an observational cohort study controlled with a meta-analysis of incidences from literature.

Background Delirium in hospitalised older adults is associated with negative health outcomes. Admission to an alternative care setting may lower the incidence of delirium. The Acute Geriatric Community Hospital (AGCH) was recently opened in the Netherlands and uses a multi-component non-pharmacological intervention strategy to prevent delirium. Objective To describe the incidence of delirium found in the AGCH and compare this incidence to a hospital control group found in literature. Design Prospective cohort study; exploratory meta-analysis of proportions. Setting The AGCH is an acute geriatric unit in an intermediate care facility. Participants Patients aged >65 years with acute medical conditions admitted to the AGCH. Methods Delirium assessment using the Confusion Assessment Method (CAM) upon admission and on day one, two and three or until delirium had resolved. Patients charts were reviewed if CAM was missing. In an logistic mixed-effects model, the delirium incidence rate in AGCH was compared to pooled delirium incidence rates from six studies found in a high-quality review. Results 214 patients from the AGCH (mean age 81.9 years, 47% male, 12% with a history of dementia) were included in the analysis. Delirium developed in 8% (18/214) (95% CI [confidence interval] 5-13%) of patients during AGCH admission compared to 16% (95% CI 12-21%) in hospitals. Admission to the AGCH was associated with a decreased delirium incidence rate compared to the hospital control group (OR [odds ratio]= 0.49, 95% CI 0.24-0.98, p-value=0.044). Conclusions The delirium incidence in the AGCH was relatively low compared to those incidences found in general hospitals.
Signatures of mast cell activation are associated with severe COVID-19

Lung inflammation is a hallmark of Coronavirus disease 2019 (COVID-19) in severely ill patients and the pathophysiology of disease is thought to be immune-mediated. Mast cells (MCs) are polyfunctional immune cells present in the airways, where they respond to certain viruses and allergens, often promoting inflammation. We observed widespread degranulation of MCs during acute and unresolved airway inflammation in SARS-CoV-2-infected mice and non-human primates. In humans, transcriptional changes in patients requiring oxygen supplementation also implicated cells with a MC phenotype. MC activation in humans was confirmed, through detection of the MC-specific protease, chymase, levels of which were significantly correlated with disease severity. These results support the association of MC activation with severe COVID-19, suggesting potential strategies for intervention.
Role of peri‐operative exercise in patients undergoing coronary artery bypass grafting

Peri‐operative exercise regimes are important to minimize complications in patients undergoing coronary artery bypass grafting (CABG). Apart from inspiratory muscle training, aerobics, resistance training, and stretching have all been reported with the potential to promote recovery after cardiac surgery. In the postoperative period, breathing exercises, aerobic and resistance exercises walking, and yoga have all been practiced. However, there is no clarity on the ideal physiotherapy regime in patients undergoing CABG or the intensity of exercise these patients can be subjected to. Future studies need to focus on these unanswered questions.