TASK DEFINITION: In this task, you are given a part of an article. Your task is to generate headline (title) for this text. Preferred headlines are under fifteen words.
PROBLEM: In many domains it is desirable to assess the pref erences of users in a qualitative rather than quan titative way. Such representations of qualitative preference orderings form an important compo nent of automated decision tools. We propose a graphical representation of preferences that re flects conditional dependence and independence of preference statements under a ceteris paribus (all else being equal) interpretation. Such a rep resentation is often compact and arguably natural. We describe several search algorithms for domi nance testing based on this representation; these algorithms are quite effective, especially in spe cific network topologies, such as chainand tree structured networks, as well as polytrees.

SOLUTION: Reasoning With Conditional Ceteris Paribus Preference Statements

PROBLEM: We define a logic of propositional formula schemata adding to the syntax of propositional logic indexed propositions (e.g., pi) and iterated connectives or ranging over intervals parameterized by arithmetic variables (e.g., n i=1 pi, where n is a parameter). The satisfiability problem is shown to be undecidable for this new logic, but we introduce a very general class of schemata, called bound-linear, for which this problem becomes decidable. This result is obtained by reduction to a particular class of schemata called regular, for which we provide a sound and complete terminating proof procedure. This schemata calculus (called stab) allows one to capture proof patterns corresponding to a large class of problems specified in propositional logic. We also show that the satisfiability problem becomes again undecidable for slight extensions of this class, thus demonstrating that bound-linear schemata represent a good compromise between expressivity and decidability.

SOLUTION: Decidability and Undecidability Results for Propositional Schemata

PROBLEM: Several approaches have recently been proposed for learning decentralized deep multiagent policies that coordinate via a differentiable communication channel. While these policies are effective for many tasks, interpretation of their induced communication strategies has remained a challenge. Here we propose to interpret agents' messages by translating them. Unlike in typical machine translation problems, we have no parallel data to learn from. Instead we develop a translation model based on the insight that agent messages and natural language strings mean the same thing if they induce the same belief about the world in a listener. We present theoretical guarantees and empirical evidence that our approach preserves both the semantics and pragmatics of messages by ensuring that players communicating through a translation layer do not suffer a substantial loss in reward relative to players with a common language.1

SOLUTION:
Translating Neuralese