Analysis and Improvement of Fitness Exploitation in XCS: Bounding Models, Tournament Selection, and Bilateral Accuracy
The evolutionary learning mechanism in XCS strongly depends on its accuracy-based fitness approach. The approach is meant to result in an evolutionary drive from classifiers of low accuracy to those of high accuracy. Since, given inaccuracy, lower specificity often corresponds to lower accuracy, fitness pressure most often also results in a pressure towards higher specificity. Moreover, fitness pressure should cause the evolutionary process to be innovative in that it combines low-order building blocks of lower accurate classifiers, to higher-order building blocks with higher accuracy. This paper investigates how, when, and where accuracy-based fitness results in successful rule evolution in XCS. Along the way, a weakness in the current proportionate selection method in XCS is identified. Several problem bounds are derived that need to be obeyed to enable proper evolutionary pressure. Moreover, a fitness dilemma is identified that causes accuracy-based fitness to be misleading. Improvements are introduced to XCS to make fitness pressure more robust and overcome the fitness dilemma. Specifically, (1) tournament selection results in a much better fitness-bias exploitation, and (2) bilateral accuracy prevents the fitness dilemma. While the improvements stand for themselves, we believe they also contribute to the ultimate goal of an evolutionary learning system that is able to solve decomposable machine-learning problems quickly, accurately, and reliably. The paper also contributes to the further understanding of XCS in general and the fitness approach in XCS in particular.

title: Classifier Systems and Genetic Algorithms
abstract: Classifier systems are massively parallel, message-passing, rule-based systems that learn through credit assignment (the bucket brigade algorithm) and rule discovery (the genetic algorithm). They typically operate in environments that exhibit one or more of the following characteristics: (1) perpetually novel events accompanied by large amounts of noisy or irrelevant data; (2) continual, often real-time, requirements for action; (3) implicitly or inexactly defined goals; and (4) sparse payoff or reinforcement obtainable only through long action sequences. Classifier systems are designed to absorb new information continuously from such environments, devising sets of competing hypotheses (expressed as rules) without disturbing significantly capabilities already acquired. This paper reviews the definition, theory, and extant applications of classifier systems, comparing them with other machine learning techniques, and closing with a discussion of advantages, problems, and possible extensions of classifier systems.

title: SEARCH, Blackbox Optimization, And Sample Complexity
abstract: The SEARCH (Search Envisioned As Relation and Class Hierarchizing) framework developed elsewhere (Kargupta, 1995; Kargupta and Goldberg, 1995) offered an alternate perspective toward blackbox optimization -- optimization in presence of little domain knowledge. The SEARCH framework investigates the conditions essential for transcending the limits of random enumerative search using a framework developed in terms of relations, classes and partial ordering. This paper presents a summary of some of the main results of that work. A closed form bound on the sample complexity in terms of the cardinality of the relation space, class space, desired quality of the solution and the reliability is presented. This also leads to the identification of the class of order-k delineable problems that can be solved in polynomial sample complexity. These results are applicable to any blackbox search algorithms, including evolutionary optimization techniques.

title: Population sizing for entropy-based model building in discrete estimation of distribution algorithms
abstract: This paper proposes a population-sizing model for entropy-based model building in discrete estimation of distribution algorithms. Specifically, the population size required for building an accurate model is investigated. The effect of selection pressure on population sizing is also preliminarily incorporated. The proposed model indicates that the population size required for building an accurate model scales as Θ(m log m), where m is the number of substructures of the given problem and is proportional to the problem size. Experiments are conducted to verify the derivations, and the results agree with the proposed model.

title: Substructural Surrogates for Learning Decomposable Classification Problems
abstract: This paper presents a learning methodology based on a substructural classification model to solve decomposable classification problems. The proposed method consists of three important components: (1) a structural model, which represents salient interactions between attributes for a given data, (2) a surrogate model, which provides a functional approximation of the output as a function of attributes, and (3) a classification model, which predicts the class for new inputs. The structural model is used to infer the functional form of the surrogate. Its coefficients are estimated using linear regression methods. The classification model uses a maximally-accurate, least-complex surrogate to predict the output for given inputs. The structural model that yields an optimal classification model is searched using an iterative greedy search heuristic. Results show that the proposed method successfully detects the interacting variables in hierarchical problems, groups them in linkages groups, and builds maximally accurate classification models. The initial results on non-trivial hierarchical test problems indicate that the proposed method holds promise and also shed light on several improvements to enhance the capabilities of the proposed method.

title: Construction of high-order deceptive functions using low-order Walsh coefficients
abstract: This paper constructs deceptive functions over bit strings of any length using low-order Walsh coefficients. Specifically, a partially deceptive construct is achieved with coefficients no higher than second order, and a fully deceptive construct is achieved with coefficients no higher than third order. Previous work on deception tacitly assumed that the very highest order Walsh coefficient, the order-l coefficient in a length-l problem, must be non-zero to achieve full deception, that condition where all schemata of orderl−1 or less containing the complement of the global optimum are superior to their competitors. The constructions of this paper show such assumptions to be false and lead to a more general theory of functions whose value only depends on the number of ones (or zeros) in the function's argument, so-calledfunctions of unitation. These results also help shed some light on Tanese's puzzling results on functions that contained large numbers of Walsh terms of fixed order.

title: Teching PL/I using a microcomputer
abstract: Until the Fall 1983 semester, the introductory programming course at Brooklyn College had been taught (in the PL/C dialect of PL/I) using keypunch equipment in a batch environment. However, that term two experimental sections used IBM Personal Computer (PC's) instead of keypunches. The experiment was expanded in the Spring 1984 semester to include almost one third of all sections of the introductory course, and then expanded again in the Fall 1984 semester to all sections of the first PL/I course, plus three sections of second-level courses. Although the PC's were quite easy to use, the PL/I-86 PC-DOS compiler produced by Digital Research caused many problems. A number of advantages and disadvantages of the experiment are discussed. Other implications of the use of PC's are also noted, including the possible change of language and the extension to more advanced courses in the curriculum.