In this task, you are given a part of an article. Your task is to generate headline (title) for this text. Preferred headlines are under fifteen words.

Example Input: In many domains it is desirable to assess the pref erences of users in a qualitative rather than quan titative way. Such representations of qualitative preference orderings form an important compo nent of automated decision tools. We propose a graphical representation of preferences that re flects conditional dependence and independence of preference statements under a ceteris paribus (all else being equal) interpretation. Such a rep resentation is often compact and arguably natural. We describe several search algorithms for domi nance testing based on this representation; these algorithms are quite effective, especially in spe cific network topologies, such as chainand tree structured networks, as well as polytrees.
Example Output: Reasoning With Conditional Ceteris Paribus Preference Statements

Example Input: Many real-world decision-theoretic planning problems can be naturally modeled with discrete and continuous state Markov decision processes (DC-MDPs). While previous work has addressed automated decision-theoretic planning for DCMDPs, optimal solutions have only been defined so far for limited settings, e.g., DC-MDPs having hyper-rectangular piecewise linear value functions. In this work, we extend symbolic dynamic programming (SDP) techniques to provide optimal solutions for a vastly expanded class of DCMDPs. To address the inherent combinatorial aspects of SDP, we introduce the XADD a continuous variable extension of the algebraic decision diagram (ADD) that maintains compact representations of the exact value function. Empirically, we demonstrate an implementation of SDP with XADDs on various DC-MDPs, showing the first optimal automated solutions to DCMDPs with linear and nonlinear piecewise partitioned value functions and showing the advantages of constraint-based pruning for XADDs.
Example Output: Symbolic Dynamic Programming for Discrete and Continuous State MDPs

Example Input: In this paper, we present algorithms that perform gradient ascent of the average reward in a partially observable Markov decision process (POMDP). These algorithms are based on GPOMDP, an algorithm introduced in a companion paper (Baxter & Bartlett, 2001), which computes biased estimates of the performance gradient in POMDPs. The algorithm's chief advantages are that it uses only one free parameter 2 [0; 1), which has a natural interpretation in terms of bias-variance trade-off, it requires no knowledge of the underlying state, and it can be applied to infinite state, control and observation spaces. We show how the gradient estimates produced by GPOMDP can be used to perform gradient ascent, both with a traditional stochastic-gradient algorithm, and with an algorithm based on conjugate-gradients that utilizes gradient information to bracket maxima in line searches. Experimental results are presented illustrating both the theoretical results of Baxter and Bartlett (2001) on a toy problem, and practical aspects of the algorithms on a number of more realistic problems.
Example Output:
Experiments with Infinite-Horizon, Policy-Gradient Estimation