Above are papers related to the following paper: [Paper_ID] Paper #175548. 	[Title] Neural Networks with Quadratic VC Dimension [Abstract] This paper shows that neural networks which use continuous activation functions have VC dimension at least as large as the square of the number of weights w. This result settles a long-standing open question, namely whether the well-known O(w log w) bound, known for hard-threshold nets, also held for more general sigmoidal nets. Implications for the number of samples needed for valid generalization are discussed. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #289088. 	[Title] Critical Points for Least-Squares Problems Involving Certain Analytic Functions, with Applications to Sigmoidal Nets [Abstract] This paper deals with nonlinear least-squares problems involving the fitting to data of parameterized analytic functions. For generic regression data, a general result establishes the countability, and under stronger assumptions finiteness, of the set of functions giving rise to critical points of the quadratic loss function. In the special case of what are usually called "single-hidden layer neural networks," which are built upon the standard sigmoidal activation tanh(x) (or equivalently (1 + e x ) 1 ), a rough upper bound for this cardinality is provided as well. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #689152. 	[Title] Shattering all sets of k points in "general position" requires (k 1)=2 parameters [Abstract] For classes of concepts defined by certain classes of analytic functions depending on n parameters, there are nonempty open sets of samples of length 2n + 2 which cannot be shattered. A slighly weaker result is also proved for piecewise-analytic functions. The special case of neural networks is discussed. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #105856. 	[Title] Vapnik-Chervonenkis Dimension of Recurrent Neural Networks [Abstract] Most of the work on the Vapnik-Chervonenkis dimension of neural networks has been focused on feedforward networks. However, recurrent networks are also widely used in learning applications, in particular when time is a relevant parameter. This paper provides lower and upper bounds for the VC dimension of such networks. Several types of activation functions are discussed, including threshold, polynomial, piecewise-polynomial and sigmoidal functions. The bounds depend on two independent parameters: the number w of weights in the network, and the length k of the input sequence. In contrast, for feedforward networks, VC dimension bounds can be expressed as a function of w only. An important difference between recurrent and feedforward nets is that a fixed recurrent net can receive inputs of arbitrary length. Therefore we are particularly interested in the case k w. Ignoring multiplicative constants, the main results say roughly the following: * For architectures with activation = any fixed nonlinear polynomial, the VC dimension is wk. * For architectures with activation = any fixed piecewise polynomial, the VC dimension is between wk and w 2 k. * For architectures with activation = H (threshold nets), the VC dimension is between w log(k=w) and minfwk log wk; w 2 + w log wkg. * For the standard sigmoid (x) = 1=(1 + e x ), the VC dimension is between wk and w 4 k 2 . An earlier version of this paper has appeared in Proc. 3rd European Workshop on Computational Learning Theory, LNCS 1208, pages 223-237, Springer, 1997. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #289085. 	[Title] Networks of Spiking Neurons: The Third Generation of Neural Network Models [Abstract] The computational power of formal models for networks of spiking neurons is compared with that of other neural network models based on McCulloch Pitts neurons (i.e. threshold gates) respectively sigmoidal gates. In particular it is shown that networks of spiking neurons are computationally more powerful than these other neural network models. A concrete biologically relevant function is exhibited which can be computed by a single spiking neuron (for biologically reasonable values of its parameters), but which requires hundreds of hidden units on a sigmoidal neural net. This article does not assume prior knowledge about spiking neurons, and it contains an extensive list of references to the currently available literature on computations in networks of spiking neurons and relevant results from neuro biology. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #16485. 	[Title] POWER OF NEURAL NETS [Abstract] Report SYCON-91-11 ABSTRACT This paper deals with the simulation of Turing machines by neural networks. Such networks are made up of interconnections of synchronously evolving processors, each of which updates its state according to a "sigmoidal" linear combination of the previous states of all units. The main result states that one may simulate all Turing machines by nets, in linear time. In particular, it is possible to give a net made up of about 1,000 processors which computes a universal partial-recursive function. (This is an update of Report SYCON-91-08; new results include the simulation in linear time of binary-tape machines, as opposed to the unary alphabets used in the previous version.) Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #193931. 	[Title] What Size Neural Network Gives Optimal Generalization? Convergence Properties of Backpropagation [Abstract] Technical Report UMIACS-TR-96-22 and CS-TR-3617 Institute for Advanced Computer Studies University of Maryland College Park, MD 20742 Abstract One of the most important aspects of any machine learning paradigm is how it scales according to problem size and complexity. Using a task with known optimal training error, and a pre-specified maximum number of training updates, we investigate the convergence of the backpropagation algorithm with respect to a) the complexity of the required function approximation, b) the size of the network in relation to the size required for an optimal solution, and c) the degree of noise in the training data. In general, for a) the solution found is worse when the function to be approximated is more complex, for b) oversized networks can result in lower training and generalization error in certain cases, and for c) the use of committee or ensemble techniques can be more beneficial as the level of noise in the training data is increased. For the experiments we performed, we do not obtain the optimal solution in any case. We further support the observation that larger networks can produce better training and generalization error using a face recognition example where a network with many more parameters than training points generalizes better than smaller networks. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #753070. 	[Title] Similar Classifiers and VC Error Bounds [Abstract] We improve error bounds based on VC analysis for classes with sets of similar classifiers. We apply the new error bounds to separating planes and artificial neural networks. Key words machine learning, learning theory, generalization, Vapnik-Chervonenkis, separating planes, neural networks. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #753264. 	[Title] Improved Uniform Test Error Bounds [Abstract] We derive distribution-free uniform test error bounds that improve on VC-type bounds for validation. We show how to use knowledge of test inputs to improve the bounds. The bounds are sharp, but they require intense computation. We introduce a method to trade sharpness for speed of computation. Also, we compute the bounds for several test cases. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #1120049. 	[Title] Dimension of Recurrent Neural Networks [Abstract] DIMACS Technical Report 96-56 December 1996 Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #133553. 	[Title] Sample Complexity for Learning Recurrent Perceptron Mappings [Abstract] Recurrent perceptron classifiers generalize the classical perceptron model. They take into account those correlations and dependences among input coordinates which arise from linear digital filtering. This paper provides tight bounds on sample complexity associated to the fitting of such models to experimental data. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #767763. 	[Title] Partition-Based Uniform Error Bounds [Abstract] This paper develops probabilistic bounds on out-of-sample error rates for several classifiers using a single set of in-sample data. The bounds are based on probabilities over partitions of the union of in-sample and out-of-sample data into in-sample and out-of-sample data sets. The bounds apply when in-sample and out-of-sample data are drawn from the same distribution. Partition-based bounds are stronger than VC-type bounds, but they require more computation. Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #753047. 	[Title] The Central Classifier Bound ANew Error Bound for the Classifier Chosen by Early Stopping Key [Abstract]  Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #133563. 	[Title] NEURAL NETS AS SYSTEMS MODELS AND CONTROLLERS suitability of "neural nets" as models for dynamical [Abstract] This paper briefly surveys some recent results relevant Please summarise all the given information.

Above are papers related to the following paper: [Paper_ID] Paper #273949. 	[Title] On the Effect of Analog Noise in Discrete-Time Analog Computations [Abstract] We introduce a model for analog computation with discrete time in the presence of analog noise that is flexible enough to cover the most important concrete cases, such as noisy analog neural nets and networks of spiking neurons. This model subsumes the classical model for digital computation in the presence of noise. We show that the presence of arbitrarily small amounts of analog noise reduces the power of analog computational models to that of finite automata, and we also prove a new type of upper bound for the Please summarise all the given information.

Paper #175548 has the title `Neural Networks with Quadratic VC Dimension  
` and the abstract `This paper shows that neural networks which use continuous activation functions have VC dimension at least as large as the square of the number of weights w. This result settles a long-standing open question, namely whether the well-known O(w log w) bound, known for hard-threshold nets, also held for more general sigmoidal nets. Implications for the number of samples needed for valid generalization are discussed. 
`.
Question: Which category should Paper #175548 be classified as ?
You can select one from ['Neural_Networks', 'Case_Based', 'Theory', 'Reinforcement_Learning', 'Probabilistic_Methods', 'Rule_Learning', 'Genetic_Algorithms'].


Paper #175548 has the title `Neural Networks with Quadratic VC Dimension  
` and the abstract `This paper shows that neural networks which use continuous activation functions have VC dimension at least as large as the square of the number of weights w. This result settles a long-standing open question, namely whether the well-known O(w log w) bound, known for hard-threshold nets, also held for more general sigmoidal nets. Implications for the number of samples needed for valid generalization are discussed. 
`.
Question: Which category should Paper #175548 be classified as ?
You can select one from ['Neural_Networks', 'Case_Based', 'Theory', 'Reinforcement_Learning', 'Probabilistic_Methods', 'Rule_Learning', 'Genetic_Algorithms'].

This paper should be classified into: Neural_Networks