SoroushVahidi/scidocs huggingface dataset:
Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima
(2013)

We establish theoretical results concerning all local optima of various regularized M-estimators, where both loss and penalty functions are allowed to be nonconvex. Our results show that as long as the loss function satisfies restricted strong convexity and the penalty function satisfies suitable regularity conditions, any local optimum of the composite objective function lies within statistical precision of the true parameter vector. Our theory covers a broad class of nonconvex objective functions, including corrected versions of the Lasso for errors-in-variables linear models; regression in generalized linear models using nonconvex regularizers such as SCAD and MCP; and graph and inverse covariance matrix estimation. On the optimization side, we show that a simple adaptation of composite gradient descent may be used to compute a global optimum up to the statistical precision εstat in log(1/εstat) iterations, which is the fastest possible rate of any first-order method. We provide a variety of simulations to illustrate the sharpness of our theoretical predictions. Disciplines Statistics and Probability This conference paper is available at ScholarlyCommons: http://repository.upenn.edu/statistics_papers/222 Regularized M -estimators with nonconvexity: Statistical and algorithmic theory for local optima Po-Ling Loh Department of Statistics University of California, Berkeley Berkeley, CA 94720 ploh@berkeley.edu Martin J. Wainwright Departments of Statistics and EECS University of California, Berkeley Berkeley, CA 94720 wainwrig@stat.berkeley.edu
On the Quality of the Initial Basin in Overspecified Neural Networks
(2016)

Deep learning, in the form of artificial neural networks, has achieved remarkable practical success in recent years, for a variety of difficult machine learning applications. However, a theoretical explanation for this remains a major open problem, since training neural networks involves optimizing a highly non-convex objective function, and is known to be computationally hard in the worst case. In this work, we study the geometric structure of the associated non-convex objective function, in the context of ReLU networks and starting from a random initialization of the network parameters. We identify some conditions under which it becomes more favorable to optimization, in the sense of (i) High probability of initializing at a point from which there is a monotonically decreasing path to a global minimum; and (ii) High probability of initializing at a basin (suitably defined) with a small minimal objective value. A common theme in our results is that such properties are more likely to hold for larger (“overspecified”) networks, which accords with some recent empirical and theoretical observations.
2D electronics - opportunities and limitations
(2016)

2D materials (2Ds), in particular the 2Ds beyond graphene, have attracted considerable attention in the transistor community. While rapid progress on 2D transistors has been achieved recently, the prospects of 2D electronics is still under debate. In the present paper we discuss our view of the potential of 2D transistors for digital CMOS and for flexible electronics. We show that 2D MOSFETs show promise for ultimately scaled CMOS due their excellent electrostatic integrity and their ability to suppress source-drain tunneling. Moreover, the 2Ds represent a promising option for radio frequency (RF) flexible electronics since they offer an attractive combination of mechanical (bendability, stretchability), and electrical (reasonable mobility) properties.
Advancing Land-Sea Conservation Planning: Integrating Modelling of Catchments, Land-Use Change, and River Plumes to Prioritise Catchment Management and Protection
(2015)

Human-induced changes to river loads of nutrients and sediments pose a significant threat to marine ecosystems. Ongoing land-use change can further increase these loads, and amplify the impacts of land-based threats on vulnerable marine ecosystems. Consequently, there is a need to assess these threats and prioritise actions to mitigate their impacts. A key question regarding prioritisation is whether actions in catchments to maintain coastal-marine water quality can be spatially congruent with actions for other management objectives, such as conserving terrestrial biodiversity. In selected catchments draining into the Gulf of California, Mexico, we employed Land Change Modeller to assess the vulnerability of areas with native vegetation to conversion into crops, pasture, and urban areas. We then used SedNet, a catchment modelling tool, to map the sources and estimate pollutant loads delivered to the Gulf by these catchments. Following these analyses, we used modelled river plumes to identify marine areas likely influenced by land-based pollutants. Finally, we prioritised areas for catchment management based on objectives for conservation of terrestrial biodiversity and objectives for water quality that recognised links between pollutant sources and affected marine areas. Our objectives for coastal-marine water quality were to reduce sediment and nutrient discharges from anthropic areas, and minimise future increases in coastal sedimentation and eutrophication. Our objectives for protection of terrestrial biodiversity covered species of vertebrates. We used Marxan, a conservation planning tool, to prioritise interventions and explore spatial differences in priorities for both objectives. Notable differences in the distributions of land values for terrestrial biodiversity and coastal-marine water quality indicated the likely need for trade-offs between catchment management objectives. However, there were priority areas that contributed to both sets of objectives. Our study demonstrates a practical approach to integrating models of catchments, land-use change, and river plumes with conservation planning software to inform prioritisation of catchment management.
Machine Learning in Medical Applications
(2001)

Research in Machine Learning methods to-date remains centered on technological issues and is mostly application driven. This letter summarizes successful applications of machine learning methods that were presented at the Workshop on Machine Learning in Medical Applications. The goals of the workshop were to foster fundamental and applied research in the application of machine learning methods to medical problem solving and to medical research, to provide a forum for reporting significant results, to determine whether Machine Learning methods are able to underpin the research and development on intelligent systems for medical applications, and to identify those areas where increased research is likely to yield advances. A number of recommendations for a research agenda were produced, including both technical and human-centered issues.
Multi-view Clustering via Multi-manifold Regularized Nonnegative Matrix Factorization
(2014)

Multi-view clustering integrates complementary information from multiple views to gain better clustering performance rather than relying on a single view. NMF based multi-view clustering algorithms have shown their competitiveness among different multi-view clustering algorithms. However, NMF fails to preserve the locally geometrical structure of the data space. In this paper, we propose a multi-manifold regularized nonnegative matrix factorization framework (MMNMF) which can preserve the locally geometrical structure of the manifolds for multi-view clustering. MMNMF regards that the intrinsic manifold of the dataset is embedded in a convex hull of all the views' manifolds, and incorporates such an intrinsic manifold and an intrinsic (consistent) coefficient matrix with a multi-manifold regularizer to preserve the locally geometrical structure of the multi-view data space. We use linear combination to construct the intrinsic manifold, and propose two strategies to find the intrinsic coefficient matrix, which lead to two instances of the framework. Experimental results show that the proposed algorithms outperform existing NMF based algorithms for multi-view clustering.
Extracting 3D Vascular Structures from Microscopy Images using Convolutional Recurrent Networks
(2017)

Vasculature is known to be of key biological significance, especially in the study of cancer. As such, considerable effort has been focused on the automated measurement and analysis of vasculature in medical and pre-clinical images. In tumors in particular, the vascular networks may be extremely irregular and the appearance of the individual vessels may not conform to classical descriptions of vascular appearance. Typically, vessels are extracted by either a segmentation and thinning pipeline, or by direct tracking. Neither of these methods are well suited to microscopy images of tumor vasculature. In order to address this we propose a method to directly extract a medial representation of the vessels using Convolutional Neural Networks. We then show that these two-dimensional centerlines can be meaningfully extended into 3D in anisotropic and complex microscopy images using the recently popularized Convolutional Long Short-Term Memory units (ConvLSTM). We demonstrate the effectiveness of this hybrid convolutional-recurrent architecture over both 2D and 3D convolutional comparators.
Building fast and compact convolutional neural networks for offline handwritten Chinese character recognition
(2017)

Like other problems in computer vision, offline handwritten Chinese character recognition (HCCR) has achieved impressive results using convolutional neural network (CNN)-based methods. However, larger and deeper networks are needed to deliver state-of-the-art results in this domain. Such networks intuitively appear to incur high computational cost, and require the storage of a large number of parameters, which render them unfeasible for deployment in portable devices. To solve this problem, we propose a Global Supervised Low-rank Expansion (GSLRE) method and an Adaptive Drop-weight (ADW) technique to solve the problems of speed and storage capacity. We design a nine-layer CNN for HCCR consisting of 3,755 classes, and devise an algorithm that can reduce the network’s computational cost by nine times and compress the network to 1/18 of the original size of the baseline model, with only a 0.21% drop in accuracy. In tests, the proposed algorithm can still surpass the best single-network performance reported thus far in the literature while requiring only 2.3 MB for storage. Furthermore, when integrated with our effective forward implementation, the recognition of an offline character image takes only 9.7 ms on a CPU. Compared with the state-of-the-art CNN model for HCCR, ∗Corresponding author Email addresses: xiaoxuefengchina@gmail.com (Xuefeng Xiao), lianwen.jin@gmail.com (Lianwen Jin) Preprint submitted to Pattern Recognition June 30, 2017
Circuit Fingerprinting Attacks: Passive Deanonymization of Tor Hidden Services
(2015)

This paper sheds light on crucial weaknesses in the design of hidden services that allow us to break the anonymity of hidden service clients and operators passively. In particular, we show that the circuits, paths established through the Tor network, used to communicate with hidden services exhibit a very different behavior compared to a general circuit. We propose two attacks, under two slightly different threat models, that could identify a hidden service client or operator using these weaknesses. We found that we can identify the users’ involvement with hidden services with more than 98% true positive rate and less than 0.1% false positive rate with the first attack, and 99% true positive rate and 0.07% false positive rate with the second. We then revisit the threat model of previous website fingerprinting attacks, and show that previous results are directly applicable, with greater efficiency, in the realm of hidden services. Indeed, we show that we can correctly determine which of the 50 monitored pages the client is visiting with 88% true positive rate and false positive rate as low as 2.9%, and correctly deanonymize 50 monitored hidden service servers with true positive rate of 88% and false positive rate of 7.8% in an open world setting.
MarrNet: 3D Shape Reconstruction via 2.5D Sketches
(2017)

3D object reconstruction from a single image is a highly under-determined problem, requiring strong prior knowledge of plausible 3D shapes. This introduces challenges for learning-based approaches, as 3D object annotations are scarce in real images. Previous work chose to train on synthetic data with ground truth 3D information, but suffered from domain adaptation when tested on real data. In this work, we propose MarrNet, an end-to-end trainable model that sequentially estimates 2.5D sketches and 3D object shape. Our disentangled, two-step formulation has three advantages. First, compared to full 3D shape, 2.5D sketches are much easier to be recovered from a 2D image; models that recover 2.5D sketches are also more likely to transfer from synthetic to real data. Second, for 3D reconstruction from 2.5D sketches, systems can learn purely from synthetic data. This is because we can easily render realistic 2.5D sketches without modeling object appearance variations in real images, including lighting, texture, etc. This further relieves the domain adaptation problem. Third, we derive differentiable projective functions from 3D shape to 2.5D sketches; the framework is therefore end-to-end trainable on real images, requiring no human annotations. Our model achieves state-of-the-art performance on 3D shape reconstruction.
Exploring the influential factors in continuance usage of mobile social Apps: Satisfaction, habit, and customer value perspectives
(2016)

The emergence of mobile application software (App) has explosively grown in conjunction with the worldwide use of smartphones in recent years. Among numerous categories of mobile Apps, social Apps were one of those with the greatest growth in 2013. Despite abundant research on users’ behavior intention of mobile App usage, few studies have focused on investigating key determinants of users’ continuance intention regarding social Apps. To fill this gap, we integrated customer value perspectives to explore the influential factors in the continuance intention of social App use. Moreover, users’ satisfaction and habit from both the marketing and psychology literature were also incorporated into the research model. A total of 378 valid questionnaires were collected by survey method, and structural equation modeling was employed in the subsequent data analysis. The results indicate that the continuance usage of social Apps is driven by users’ satisfaction, tight connection with others, and hedonic motivation to use the Apps. In addition, full mediation effects of satisfaction and habit were found between perceived usefulness and intention to continue use. These findings extend our understanding of users’ continuance intention in the context of social Apps. Discussion and implications are provided. 2015 Elsevier Ltd. All rights reserved.
Perceivable Light Fields: Matching the Requirements Between the Human Visual System and Autostereoscopic 3-D Displays
(2014)

Recently, there has been a substantial increase in efforts to develop 3-D visualization technologies that can provide the viewers with a realistic 3-D visual experience. Various terms such as “reality communication” have been used to categorize these efforts. In order to provide the viewers with a complete and realistic visual sensation, the display or visualization system and the displayed content need to match the physiological 3-D information sensing capabilities of the human visual system which can be quite complex. These may include spatial and temporal resolutions, depth perception, dynamic range, spectral contents, nonlinear effects, and vergence accommodation effects. In this paper, first we present an overview of some of the 3-D display research efforts which have been extensively pursued in Asia, Europe, and North America among other areas. Based on the limitations and comfort-based requirements of the human visual system when viewing a nonnatural visual input from 3-D displays, we present an analytical framework that combines main perception and human visual requirements with analytical tools and principles used in related disciplines such as optics, computer graphics, computational imaging, and signal processing. Building on the widely used notion of light fields, we define a notion of perceivable light fields to account for the human visual system physiological requirements, and propagate it back to the display device to determine the display device specifications. This helps us clarify the fundamental and practical requirements of the 3-D display devices for reality viewing communication. In view of the proposed analytical framework, we overview various methods that can be applied to overcome the extensive information needed to be displayed in order to meet the requirements imposed by the human visual system.
Advances in data stream mining
(2012)

Mining data streams has been a focal point of research interest over the past decade. Hardware and software advances have contributed to the significance of this area of research by introducing faster than ever data generation. This rapidly generated data has been termed as data streams. Credit card transactions, Google searches, phone calls in a city, and many others\are typical data streams. In many important applications, it is inevitable to analyze this streaming data in real time. Traditional data mining techniques have fallen short in addressing the needs of data stream mining. Randomization, approximation, and adaptation have been used extensively in developing new techniques or adopting exiting ones to enable them to operate in a streaming environment. This paper reviews key milestones and state of the art in the data stream mining area. Future insights are also be presented. C © 2011 Wiley Periodicals, Inc.
Visual tracking with online Multiple Instance Learning
(2009)

In this paper, we address the problem of learning an adaptive appearance model for object tracking. In particular, a class of tracking techniques called “tracking by detection” have been shown to give promising results at real-time speeds. These methods train a discriminative classifier in an online manner to separate the object from the background. This classifier bootstraps itself by using the current tracker state to extract positive and negative examples from the current frame. Slight inaccuracies in the tracker can therefore lead to incorrectly labeled training examples, which degrades the classifier and can cause further drift. In this paper we show that using Multiple Instance Learning (MIL) instead of traditional supervised learning avoids these problems, and can therefore lead to a more robust tracker with fewer parameter tweaks. We present a novel online MIL algorithm for object tracking that achieves superior results with real-time performance.
Frontal terminations for the inferior fronto-occipital fascicle: anatomical dissection, DTI study and functional considerations on a multi-component bundle
(2011)

The anatomy and functional role of the inferior fronto-occipital fascicle (IFOF) remain poorly known. We accurately analyze its course and the anatomical distribution of its frontal terminations. We propose a classification of the IFOF in different subcomponents. Ten hemispheres (5 left, 5 right) were dissected with Klingler’s technique. In addition to the IFOF dissection, we performed a 4-T diffusion tensor imaging study on a single healthy subject. We identified two layers of IFOF. The first one is superficial and antero-superiorly directed, terminating in the inferior frontal gyrus. The second is deeper and consists of three portions: posterior, middle and anterior. The posterior component terminates in the middle frontal gyrus (MFG) and dorso-lateral prefrontal cortex. The middle component terminates in the MFG and lateral orbito-frontal cortex. The anterior one is directed to the orbito-frontal cortex and frontal pole. In vivo tractography study confirmed these anatomical findings. We suggest that the distribution of IFOF fibers within the frontal lobe corresponds to a fine functional segmentation. IFOF can be considered as a “multi-function” bundle, with each anatomical subcomponent subserving different brain processing. The superficial layer and the posterior component of the deep layer, which connects the occipital extrastriate, temporo-basal and inferior frontal cortices, might subserve semantic processing. The middle component of the deep layer could play a role in a multimodal sensory–motor integration. Finally, the anterior component of the deep layer might be involved in emotional and behavioral aspects.
Digital Marketing Maturity Models : Overview and Comparison
(2017)

The variety of available digital tools, strategies and activities might confuse and disorient even an experienced marketer. This applies in particular to B2B companies, which are usually less flexible in uptaking of digital technology than B2C companies. B2B companies are lacking a framework that corresponds to the specifics of the B2B business, and which helps to evaluate a company’s capabilities and to choose an appropriate path. A B2B digital marketing maturity model helps to fill this gap. However, modern marketing offers no widely approved digital marketing maturity model, and thus, some marketing institutions provide their own tools. The purpose of this paper is building an optimized B2B digital marketing maturity model based on a SWOT (strengths, weaknesses, opportunities, and threats) analysis of existing models. The current study provides an analytical review of the existing digital marketing maturity models with open access. The results of the research are twofold. First, the provided SWOT analysis outlines the main advantages and disadvantages of existing models. Secondly, the strengths of existing digital marketing maturity models, helps to identify the main characteristics and the structure of an optimized B2B digital marketing maturity model. The research findings indicate that only one out of three analyzed models could be used as a separate tool. This study is among the first examining the use of maturity models in digital marketing. It helps businesses to choose between the existing digital marketing models, the most effective one. Moreover, it creates a base for future research on digital marketing maturity models. This study contributes to the emerging B2B digital marketing literature by providing a SWOT analysis of the existing digital marketing maturity models and suggesting a structure and main characteristics of an optimized B2B digital marketing maturity model. Keywords—B2B digital marketing strategy, digital marketing, digital marketing maturity model, SWOT analysis.
Watershed Cuts: Minimum Spanning Forests and the Drop of Water Principle
(2009)

We study the watersheds in edge-weighted graphs. We define the watershed cuts following the intuitive idea of drops of water flowing on a topographic surface. We first establish the consistency of these watersheds: they can be equivalently defined by their "catchment basinsrdquo (through a steepest descent property) or by the "dividing linesrdquo separating these catchment basins (through the drop of water principle). Then, we prove, through an equivalence theorem, their optimality in terms of minimum spanning forests. Afterward, we introduce a linear-time algorithm to compute them. To the best of our knowledge, similar properties are not verified in other frameworks and the proposed algorithm is the most efficient existing algorithm, both in theory and in practice. Finally, the defined concepts are illustrated in image segmentation, leading to the conclusion that the proposed approach improves, on the tested images, the quality of watershed-based segmentations.