Original: Why Can’t You Do That HAL? Explaining Unsolvability of Planning Tasks
Revised: Why Can’t You Do That HAL? Explaining Unsolvability of Planning Tasks

Original: Abstract
Revised: Abstract

Original: Explainable planning is widely accepted as a prerequisite for autonomous agents to successfully work with humans.
Revised: Explainable planning is widely accepted as a prerequisite for autonomous agents to successfully work with humans.

Original: While there has been a lot of research on generating explanations of solutions to planning problems, explaining the absence of solutions remains a largely open and under-studied problem, even though such situations can be the hardest to understand or debug.
Revised: While there has been a lot of research on generating explanations of solutions to planning problems, explaining the absence of solutions remains a largely open and under-studied problem, even though such situations can be the hardest to understand or debug.

Original: In this paper, we show that hierarchical abstractions can be used to efﬁciently generate reasons for unsolvability of planning problems.
Revised: In this paper, we show that hierarchical abstractions can be used to efﬁciently generate reasons for unsolvability of planning problems.

Original: In contrast to related work on computing certiﬁcates of unsolvability, we show that our methods can generate compact, humanunderstandable reasons for unsolvability.
Revised: In contrast to related work on computing certiﬁcates of unsolvability, we show that our methods can generate compact, humanunderstandable reasons for unsolvability.

Original: Empirical analysis and user studies show the validity of our methods as well as their computational efﬁcacy on a number of benchmark planning domains.
Revised: Empirical analysis and user studies show the validity of our methods as well as their computational efﬁcacy on a number of benchmark planning domains.

Original:  Introduction
Revised:  Introduction

Original: The ability to explain the rationale behind a decision is widely seen as one of the basic skills needed by an autonomous agent to truly collaborate with humans.
Revised: The ability to explain the rationale behind a decision is widely seen as one of the basic skills needed by an autonomous agent to truly collaborate with humans.

Original: At the very least we would want our autonomous assistants to be capable of explaining why a particular action/plan was chosen to achieve some objective and be able to explain why they consider some objectives to be unachievable.
Revised: At the very least we would want our autonomous assistants to be capable of explaining why a particular action/plan was chosen to achieve some objective and be able to explain why they consider some objectives to be unachievable.

Original: For example, consider an automated taxi scheduling system.
Revised: For example, consider an automated taxi scheduling system.

Original: A user asks for a taxi to pick up her and three of her friends and the service comes back by saying that it is not possible and recommends instead using two different taxis.
Revised: A user asks for a taxi to pick up her and three of her friends and the service comes back by saying that it is not possible and recommends instead using two different taxis.

Original: In this scenario, the user would want to know why a single taxi can’t pick up all four of them.
Revised: In this scenario, the user would want to know why a single taxi can’t pick up all four of them.

Original: Most earlier works in explanation generation for planning problems have focused on the problem of explaining why a given plan or action was chosen, but do not address the problem of explaining the unsolvability of a given planning problem.
Revised: Most earlier works in explanation generation for planning problems have focused on the problem of explaining why a given plan or action was chosen, but do not address the problem of explaining the unsolvability of a given planning problem.

Original: The few works that have tried to address unsolvability have mostly looked at generating certiﬁcates or proofs of unsolvability (cf.
Revised: The few works that have tried to address unsolvability have mostly looked at generating certiﬁcates or proofs of unsolvability (cf.

Original: [Eriksson, R¨oger, and Helmert, 2018; 2017 ] ) or identify some modiﬁcation of the planning problem that could make the problem solvable, i.e, an excuse for the unsolvability of the problem (c.f [G¨obelbecker et al., 2010]).
Revised: [Eriksson, R¨oger, and Helmert, 2018; 2017 ] ) or identify some modiﬁcation of the planning problem that could make the problem solvable, i.e, an excuse for the unsolvability of the problem (c.f [G¨obelbecker et al., 2010]).

Original: Unfortunately the certiﬁcates/proofs considered by these works are geared towards automatic veriﬁcation rather than human understandability and for complex domains excuses generated by such systems may not be enough to understand why a problem was unsolvable in the ﬁrst place.
Revised: Unfortunately the certiﬁcates/proofs considered by these works are geared towards automatic veriﬁcation rather than human understandability and for complex domains excuses generated by such systems may not be enough to understand why a problem was unsolvable in the ﬁrst place.

Original: In this paper, we present a new approach for explaining unsolvability of planning problems that builds on the well known psychological insight that humans tend to decompose sequential planning problems in terms of the subgoals they need to achieve [ Donnarumma, Maisto, and Pezzulo, 2016;
Revised: In this paper, we present a new approach for explaining unsolvability of planning problems that builds on the well known psychological insight that humans tend to decompose sequential planning problems in terms of the subgoals they need to achieve [ Donnarumma, Maisto, and Pezzulo, 2016;

Original: Cooper and Shallice, 2006; Simon and Newell, 1971 ] .
Revised: Cooper and Shallice, 2006; Simon and Newell, 1971 ] .

Original: We will thus help the user understand the infeasibility of a given planning problem by pointing out unreachable but necessary subgoals.
Revised: We will thus help the user understand the infeasibility of a given planning problem by pointing out unreachable but necessary subgoals.

Original: For example, in the earlier case, “Holding three passengers” is a subgoal that is required to reach the goal, but one that can no longer be achieved due to new city regulations.
Revised: For example, in the earlier case, “Holding three passengers” is a subgoal that is required to reach the goal, but one that can no longer be achieved due to new city regulations.

Original: Thus the system could explain that the taxi can’t hold more than two passengers at a time (and also notify the user about the new city ordinance).
Revised: Thus the system could explain that the taxi can’t hold more than two passengers at a time (and also notify the user about the new city ordinance).

Original: Unfortunately, this is not so straightforward, since by the very nature of the problem, there exist no solutions and hence its hard to extract meaningful non-trivial subgoals for the problem.
Revised: Unfortunately, this is not so straightforward, since by the very nature of the problem, there exist no solutions and hence its hard to extract meaningful non-trivial subgoals for the problem.

Original: We can ﬁnd a way around this issue by noting the fact that the user is asking for an explanation for unsolvability either due to a lack of understanding of the task or because of limitations in their inferential capabilities.
Revised: We can ﬁnd a way around this issue by noting the fact that the user is asking for an explanation for unsolvability either due to a lack of understanding of the task or because of limitations in their inferential capabilities.

Original: Therefore, we can try to capture the user’s expectations by considering abstractions of the given problem.
Revised: Therefore, we can try to capture the user’s expectations by considering abstractions of the given problem.

Original: In particular, we use state abstractions to generate potential solutions and subgoals at higher levels of abstractions.
Revised: In particular, we use state abstractions to generate potential solutions and subgoals at higher levels of abstractions.

Original: Such an approach was used by [ Sreedharan, Srivastava, and Kambhampati, 2018] to compute explanations for user queries attuned to the level of expertise of the user.
Revised: Such an approach was used by [ Sreedharan, Srivastava, and Kambhampati, 2018] to compute explanations for user queries attuned to the level of expertise of the user.

Original: In section 3, we present our basic framework and discuss how we can identify the appropriate level of abstraction and unachievable subgoals for an unsolvable classical planning problem.
Revised: In section 3, we present our basic framework and discuss how we can identify the appropriate level of abstraction and unachievable subgoals for an unsolvable classical planning problem.

Original: In the real world, a more challenging version of this problem arises when the user provides plan advice (which may include temporal preferences) on the type of solutions expected.
Revised: In the real world, a more challenging version of this problem arises when the user provides plan advice (which may include temporal preferences) on the type of solutions expected.

Original: In section 4, we will see how explaining unsolvability of planning problems with plan advice (c.f [Myers, 1996 ] ) could be seen as establishing unsolvability of planning problems with additional plan constraints.
Revised: In section 4, we will see how explaining unsolvability of planning problems with plan advice (c.f [Myers, 1996 ] ) could be seen as establishing unsolvability of planning problems with additional plan constraints.

Original: This is a capability that is necessary to capture the fact that these explanations are being provided within the context of a conversation.
Revised: This is a capability that is necessary to capture the fact that these explanations are being provided within the context of a conversation.

Original: The presence of this additional plan advice could either reﬂect cases (1) where the original problem was solvable, but the user’s requirements (i.e. expressed in the advice) renders it unsolvable and (2) where the original problem was unsolvable and the user presents an outline for a solution in the form of advice.
Revised: The presence of this additional plan advice could either reﬂect cases (1) where the original problem was solvable, but the user’s requirements (i.e. expressed in the advice) renders it unsolvable and (2) where the original problem was unsolvable and the user presents an outline for a solution in the form of advice.

Original: Even in the second case, by taking into account the human’s expected solution, we can provide a more targeted explanation.
Revised: Even in the second case, by taking into account the human’s expected solution, we can provide a more targeted explanation.

Original: Such additional advice are quite common within the context of contrastive explanations
Revised: Such additional advice are quite common within the context of contrastive explanations

Original: [ Miller, 2018 ] , where these advice specify alternative foils (in this case alternative plans) expected by the user.
Revised: [ Miller, 2018 ] , where these advice specify alternative foils (in this case alternative plans) expected by the user.

Original: By supporting refutation of such advice we also allow the possibility of leveraging our approach for contrastive explanations.
Revised: By supporting refutation of such advice we also allow the possibility of leveraging our approach for contrastive explanations.

Original: For evaluating our approach, we will present a user study we ran to validate the usefulness of such explanations for unsolvable problems (with plan advice) and also note the computational efﬁciency of our method for some standard planning benchmarks.
Revised: For evaluating our approach, we will present a user study we ran to validate the usefulness of such explanations for unsolvable problems (with plan advice) and also note the computational efﬁciency of our method for some standard planning benchmarks.

Original:  Background
Revised:  Background

Original: We will assume that the autonomous agent uses a STRIPS planning model [ Fikes and Nilsson, 1971 ] that can be represented as a tuple of the form M = (cid:104) F, A, I, G (cid:105) , where F is a set of propositional ﬂuents that deﬁne the state space S M for the model, A gives the set of actions the robot has access to, I deﬁnes the initial state and G the goal.
Revised: We will assume that the autonomous agent uses a STRIPS planning model [ Fikes and Nilsson, 1971 ] that can be represented as a tuple of the form M = (cid:104) F, A, I, G (cid:105) , where F is a set of propositional ﬂuents that deﬁne the state space S M for the model, A gives the set of actions the robot has access to, I deﬁnes the initial state and G the goal.

Original: A state S ∈ S M corresponds to a unique value assignment for each state ﬂuent and can be represented by the set of ﬂuents that are true in that state.
Revised: A state S ∈ S M corresponds to a unique value assignment for each state ﬂuent and can be represented by the set of ﬂuents that are true in that state.

Original: Each action a ∈ A is further deﬁned by a tuple a = (cid:104) prec a , adds a , dels a (cid:105) and a plan is deﬁned as an action sequence of the form
Revised: Each action a ∈ A is further deﬁned by a tuple a = (cid:104) prec a , adds a , dels a (cid:105) and a plan is deﬁned as an action sequence of the form

Original: π = (cid:104) a 1 , ..., a n (cid:105) .
Revised: π = (cid:104) a 1 , ..., a n (cid:105) .

Original: A plan is said to be valid for M , if the result of executing a plan from the initial state satisﬁes the goal (denoted as π ( I ) | =
Revised: A plan is said to be valid for M , if the result of executing a plan from the initial state satisﬁes the goal (denoted as π ( I ) | =

Original: M G ).
Revised: M G ).

Original: For the model M , we will represent the set of all valid plans as Π M .
Revised: For the model M , we will represent the set of all valid plans as Π M .

Original: Each planning model M also corresponds to a transition system T =
Revised: Each planning model M also corresponds to a transition system T =

Original: (cid:104) S M , I, S G , A, T (cid:105) , where S G is the subset of S M where the goal G is satisﬁed and T
Revised: (cid:104) S M , I, S G , A, T (cid:105) , where S G is the subset of S M where the goal G is satisﬁed and T

Original: ⊆ S M × A × S M , such that (cid:104) S, a, S (cid:48) (cid:105) ∈ T (denoted as S a −→ S (cid:48) )
Revised: ⊆ S M × A × S M , such that (cid:104) S, a, S (cid:48) (cid:105) ∈ T (denoted as S a −→ S (cid:48) )

Original: if S ⊆ prec a and a ( S ) =
Revised: if S ⊆ prec a and a ( S ) =

Original: S (cid:48) .
Revised: S (cid:48) .

Original: Each valid plan has a corresponding path in the transition system from I to some state in S G .
Revised: Each valid plan has a corresponding path in the transition system from I to some state in S G .

Original: In this work, we will be focusing on state and action abstractions induced by projecting out ﬂuents.
Revised: In this work, we will be focusing on state and action abstractions induced by projecting out ﬂuents.

Original: Thus a model
Revised: Thus a model

Original: M 2 is said to be an abstraction of M 1 (denoted by M 1 (cid:118)
Revised: M 2 is said to be an abstraction of M 1 (denoted by M 1 (cid:118)

Original: M 2 ) if model M 2 can be formed from M 1 by projecting out a set of ﬂuents.
Revised: M 2 ) if model M 2 can be formed from M 1 by projecting out a set of ﬂuents.

Original: Formally, M 1 (cid:118) M 2 if there exists some
Revised: Formally, M 1 (cid:118) M 2 if there exists some

Original: P ⊆ F , such that the transition system of M 2 is deﬁned as T 2 = (cid:104) S M 2 , I 2 , S G 2 , A, T 2 (cid:105) .
Revised: P ⊆ F , such that the transition system of M 2 is deﬁned as T 2 = (cid:104) S M 2 , I 2 , S G 2 , A, T 2 (cid:105) .

Original: Where, for every S ∈ S M 1 , there exist a state S \ P ∈ S M 2 , I 2 =
Revised: Where, for every S ∈ S M 1 , there exist a state S \ P ∈ S M 2 , I 2 =

Original: I \ P , S G 2 is the subset of S M 2 that satisfy G (cid:48) =
Revised: I \ P , S G 2 is the subset of S M 2 that satisfy G (cid:48) =

Original: G \ P and for every transition (cid:104) S, a, S (cid:48) (cid:105) ∈ T 1 , there exist (cid:104) S \ P, a, S (cid:48) \ P (cid:105)
Revised: G \ P and for every transition (cid:104) S, a, S (cid:48) (cid:105) ∈ T 1 , there exist (cid:104) S \ P, a, S (cid:48) \ P (cid:105)

Original: ∈
Revised: ∈

Original: T 2 .
Revised: T 2 .

Original: We will denote an abstraction formed by projecting out P from the model M as f P ( M ) .
Revised: We will denote an abstraction formed by projecting out P from the model M as f P ( M ) .

Original: An abstraction f P ( M ) is considered logically complete if for every π such that π ( I ) | =
Revised: An abstraction f P ( M ) is considered logically complete if for every π such that π ( I ) | =

Original: M G , we have π ( I f P ( M ) )
Revised: M G , we have π ( I f P ( M ) )

Original: |
Revised: |

Original: = f P ( M ) G f P ( M ) .
Revised: = f P ( M ) G f P ( M ) .

Original: In this work, we will only be looking at logically complete abstractions.
Revised: In this work, we will only be looking at logically complete abstractions.

Original: For classical planning models, logically complete abstractions can be formed by simply removing the abstracted out ﬂuents from the domain model and problem descriptions.
Revised: For classical planning models, logically complete abstractions can be formed by simply removing the abstracted out ﬂuents from the domain model and problem descriptions.

Original: Sreedharan, Srivastava, and Kambhampati (2018) note that given a model M and a set of propositions P we can deﬁne an abstraction lattice, denoted as L M ,P = (cid:104) M , E , (cid:96) (cid:105) , where each model in M is an abstraction of M formed by projecting out some subset of ﬂuents from P (where P ⊆ F ) and
Revised: Sreedharan, Srivastava, and Kambhampati (2018) note that given a model M and a set of propositions P we can deﬁne an abstraction lattice, denoted as L M ,P = (cid:104) M , E , (cid:96) (cid:105) , where each model in M is an abstraction of M formed by projecting out some subset of ﬂuents from P (where P ⊆ F ) and

Original: M ∈ M .
Revised: M ∈ M .

Original: There exist an edge (cid:104)M 1 , M 2 (cid:105) ∈ E with label (cid:96) ( M 1 , M 2 ) =
Revised: There exist an edge (cid:104)M 1 , M 2 (cid:105) ∈ E with label (cid:96) ( M 1 , M 2 ) =

Original: p , if f { p } ( M 1 ) =
Revised: p , if f { p } ( M 1 ) =

Original: M 2 , thus this structure provides a way of capturing the ordering induced by (cid:118) (where elements higher up in the lattice are more abstract than the ones at the bottom).
Revised: M 2 , thus this structure provides a way of capturing the ordering induced by (cid:118) (where elements higher up in the lattice are more abstract than the ones at the bottom).

Original: Note that in the most general case, the lattice need not be complete, that is | M | (cid:54) =
Revised: Note that in the most general case, the lattice need not be complete, that is | M | (cid:54) =

Original: 2 | P | .
Revised: 2 | P | .

Original: In fact we do not assume that there is a single most abstract supremum but rather the structure could have multiple maximal elements (thus making it a meet semi-lattice rather than a pure lattice).
Revised: In fact we do not assume that there is a single most abstract supremum but rather the structure could have multiple maximal elements (thus making it a meet semi-lattice rather than a pure lattice).

Original: For convenience, we will treat the abstraction function f for a given lattice as invertible and use f − 1 P ( M ) to represent the unique concrete node in the lattice that could have been abstracted (by projecting out P ) to generate M .
Revised: For convenience, we will treat the abstraction function f for a given lattice as invertible and use f − 1 P ( M ) to represent the unique concrete node in the lattice that could have been abstracted (by projecting out P ) to generate M .

Original: We will refer to f − 1 P ( M ) as the concretization of M for P .
Revised: We will refer to f − 1 P ( M ) as the concretization of M for P .

Original: Figure 1 presents a simple conceptualization of an abstraction lattice for the rover domain.
Revised: Figure 1 presents a simple conceptualization of an abstraction lattice for the rover domain.

Original: The edges in the lattice correspond to projecting out the presence of rocks or soil samples.
Revised: The edges in the lattice correspond to projecting out the presence of rocks or soil samples.

Original: Earlier works have used such abstraction lattices to estimate the user’s level of understanding of the given task, by searching for the level of abstraction where an incorrect alternative raised by the user (or foil) could be supported.
Revised: Earlier works have used such abstraction lattices to estimate the user’s level of understanding of the given task, by searching for the level of abstraction where an incorrect alternative raised by the user (or foil) could be supported.

Original:  Our Approach
Revised:  Our Approach

Original: Before we start discussing the technical details of our approach, let us look at a possible explanatory scenario.
Revised: Before we start discussing the technical details of our approach, let us look at a possible explanatory scenario.

Original: Example 1.
Revised: Example 1.

Original: Consider the following scenario where a rover is tasked with collecting a rock sample and a soil sample from the region illustrated in Figure 2.
Revised: Consider the following scenario where a rover is tasked with collecting a rock sample and a soil sample from the region illustrated in Figure 2.

Original: The rover can only traverse the region via the waypoints marked on the map and its maneuverability is affected by the conditions of the terrain.
Revised: The rover can only traverse the region via the waypoints marked on the map and its maneuverability is affected by the conditions of the terrain.

Original: The rover cannot easily traverse the region between P3 and
Revised: The rover cannot easily traverse the region between P3 and

Original: P4 without special precautions as the region is quite rocky.
Revised: P4 without special precautions as the region is quite rocky.

Original: Suppose a mission control operator is also keeping track of the rover’s plan but may not have access to a map with the same level of ﬁdelity or may have incomplete knowledge of the rover’s capabilities.
Revised: Suppose a mission control operator is also keeping track of the rover’s plan but may not have access to a map with the same level of ﬁdelity or may have incomplete knowledge of the rover’s capabilities.

Original: The rover reports to the mission controller that in fact the task can not be solved.
Revised: The rover reports to the mission controller that in fact the task can not be solved.

Original: The mission control operator is confused by the rover’s response and could even ask “Why don’t you collect the rock sample from P4 and Soil sample from P7?”
Revised: The mission control operator is confused by the rover’s response and could even ask “Why don’t you collect the rock sample from P4 and Soil sample from P7?”

Original: Here if the rover wants to explain the reason as to why it couldn’t achieve the goal a possible way would be to clarify that certain parts of the map are hard to traverse (particularly the region around the rock sample) and because of this issue it can never reach the location of the rock sample.
Revised: Here if the rover wants to explain the reason as to why it couldn’t achieve the goal a possible way would be to clarify that certain parts of the map are hard to traverse (particularly the region around the rock sample) and because of this issue it can never reach the location of the rock sample.

Original: Thus the explanation in this case consist of two distinct parts, information about the problem (i.e traversability of certain paths) and the required subgoal that can no longer be achieved in the light of this new information.
Revised: Thus the explanation in this case consist of two distinct parts, information about the problem (i.e traversability of certain paths) and the required subgoal that can no longer be achieved in the light of this new information.

Original: In the proceeding sections, we will layout our framework and discuss how we could leverage it to generate such explanations.
Revised: In the proceeding sections, we will layout our framework and discuss how we could leverage it to generate such explanations.

Original: The input to our approach thus includes an unsolvable problem M R = (cid:104) F R , A R ,
Revised: The input to our approach thus includes an unsolvable problem M R = (cid:104) F R , A R ,

Original: I R , G R (cid:105) (in the above example this would correspond to the complete rover model) and an abstraction lattice L M R ,P = (cid:104) M , E , (cid:96) (cid:105) , where M represents the space of possible models that could be used to capture the human’s understanding of the task (i.e by assuming the user may or may not be aware of the ﬂuents in the set P ⊆ F R ).
Revised: I R , G R (cid:105) (in the above example this would correspond to the complete rover model) and an abstraction lattice L M R ,P = (cid:104) M , E , (cid:96) (cid:105) , where M represents the space of possible models that could be used to capture the human’s understanding of the task (i.e by assuming the user may or may not be aware of the ﬂuents in the set P ⊆ F R ).

Original: In
Revised: In

Original: Example 1, P could include ﬂuents related traversability of various paths or ﬂuents related to various rover capabilities.
Revised: Example 1, P could include ﬂuents related traversability of various paths or ﬂuents related to various rover capabilities.

Original: Given this setting, our method for identifying explanations, includes the following steps
Revised: Given this setting, our method for identifying explanations, includes the following steps

Original: • Identify the level of abstraction at which the explanation should be provided (Section 3.1)
Revised: • Identify the level of abstraction at which the explanation should be provided (Section 3.1)

Original: • Identify a sequence of necessary subgoals for the given problem that can be reasoned about at the identiﬁed level of abstraction (Section 3.2) • Identify the ﬁrst unachievable subgoal in that sequence (Section 3.3)
Revised: • Identify a sequence of necessary subgoals for the given problem that can be reasoned about at the identiﬁed level of abstraction (Section 3.2) • Identify the ﬁrst unachievable subgoal in that sequence (Section 3.3)

Original: Intuitively, one could understand the three steps mentioned above as follows.
Revised: Intuitively, one could understand the three steps mentioned above as follows.

Original: First, identify the level of detail at which unsolvability of the problem needs to be discussed.
Revised: First, identify the level of detail at which unsolvability of the problem needs to be discussed.

Original: The higher the level of abstraction, the easier the user would ﬁnd it to understand and reason about the task, but the level of abstraction should be detailed enough that the problem is actually unsolvable there.
Revised: The higher the level of abstraction, the easier the user would ﬁnd it to understand and reason about the task, but the level of abstraction should be detailed enough that the problem is actually unsolvable there.

Original: In most cases, this would mean ﬁnding the highest level of abstraction where the problem is still unsolvable.
Revised: In most cases, this would mean ﬁnding the highest level of abstraction where the problem is still unsolvable.

Original: Now even if the system was to present the problem at this desired level of abstraction, the user may be unable to grasp the reason for unsolvability.
Revised: Now even if the system was to present the problem at this desired level of abstraction, the user may be unable to grasp the reason for unsolvability.

Original: Again, our method involves helping the human in this process by pointing out a necessary subgoal (i.e., any valid solution to that problem must achieve the subgoal) that can’t be achieved at the current abstraction level.
Revised: Again, our method involves helping the human in this process by pointing out a necessary subgoal (i.e., any valid solution to that problem must achieve the subgoal) that can’t be achieved at the current abstraction level.

Original: Thus the second point relates to the challenge of ﬁnding a sequence of subgoals (deﬁned by state ﬂuents present at the explanatory level) for a given problem.
Revised: Thus the second point relates to the challenge of ﬁnding a sequence of subgoals (deﬁned by state ﬂuents present at the explanatory level) for a given problem.

Original: In the third step, we try to identify the ﬁrst subgoal in the sequence that is actually unsolvable in the given level.
Revised: In the third step, we try to identify the ﬁrst subgoal in the sequence that is actually unsolvable in the given level.

Original: Given our approach, the ﬁnal explanatory message provided to the user would include model information that brings their understanding of the task to the required level and information on the speciﬁc subgoals (and previous ones that need to be achieved ﬁrst) that can no longer be achieved.
Revised: Given our approach, the ﬁnal explanatory message provided to the user would include model information that brings their understanding of the task to the required level and information on the speciﬁc subgoals (and previous ones that need to be achieved ﬁrst) that can no longer be achieved.

Original: In cases where the unachievable subgoals are hard to understand formulas or large disjunctions, we can also use these subgoals to produce exemplar plans in the more abstract models and illustrate their failures alongside the unachievable subgoals.
Revised: In cases where the unachievable subgoals are hard to understand formulas or large disjunctions, we can also use these subgoals to produce exemplar plans in the more abstract models and illustrate their failures alongside the unachievable subgoals.

Original: 3. Identifying the Minimal Level of Abstraction Required for Explanation
Revised: 3. Identifying the Minimal Level of Abstraction Required for Explanation

Original: Following [Sreedharan, Srivastava, and Kambhampati, 2018], we will assume that the human’s understanding of the task could be approximated by a model M H
Revised: Following [Sreedharan, Srivastava, and Kambhampati, 2018], we will assume that the human’s understanding of the task could be approximated by a model M H

Original: = (cid:104) F H , A H , I H , G H (cid:105) , such that, the model is part of the abstraction lattice ( M R (cid:64) M H and M H ∈ M ).
Revised: = (cid:104) F H , A H , I H , G H (cid:105) , such that, the model is part of the abstraction lattice ( M R (cid:64) M H and M H ∈ M ).

Original: While the earlier work is able to use alternative plan provided by the user to identify the human model, we instead use the fact that the user expected the problem to be solvable to identify M H , i.e., ∃ π, π
Revised: While the earlier work is able to use alternative plan provided by the user to identify the human model, we instead use the fact that the user expected the problem to be solvable to identify M H , i.e., ∃ π, π

Original: ( I M H )
Revised: ( I M H )

Original: | =
Revised: | =

Original: M H G M H .
Revised: M H G M H .

Original: We now need to abstract this human model to a level where the problem is unsolvable (i.e the explanation level) by providing information about a certain subset of ﬂuents previously missing from the human model (i.e information on their truth values in the initial and goal state, and how they affect various actions etc...).
Revised: We now need to abstract this human model to a level where the problem is unsolvable (i.e the explanation level) by providing information about a certain subset of ﬂuents previously missing from the human model (i.e information on their truth values in the initial and goal state, and how they affect various actions etc...).

Original: In the case of Example 1, this would include information on whether various paths are traversable and how the traversability of a path is a precondition for the robot to move across it.
Revised: In the case of Example 1, this would include information on whether various paths are traversable and how the traversability of a path is a precondition for the robot to move across it.

Original: We will refer to the set of ﬂuents that the human needs to be informed about as explanatory ﬂuents ( E ) and for Example 1, it will be E
Revised: We will refer to the set of ﬂuents that the human needs to be informed about as explanatory ﬂuents ( E ) and for Example 1, it will be E

Original: = { can traverse (? x, ?
Revised: = { can traverse (? x, ?

Original: y ) } .
Revised: y ) } .

Original: Deﬁnition 1.
Revised: Deﬁnition 1.

Original: Given a human model M H , we deﬁne a set of propositions E to be explanatory ﬂuents if f − 1 E ( M H ) is unsolvable, i.e, | Π f − 1 E ( M H ) | = 0 .
Revised: Given a human model M H , we deﬁne a set of propositions E to be explanatory ﬂuents if f − 1 E ( M H ) is unsolvable, i.e, | Π f − 1 E ( M H ) | = 0 .

Original: Unfortunately, this is not an operational deﬁnition as we do not have access to M H .
Revised: Unfortunately, this is not an operational deﬁnition as we do not have access to M H .

Original: Instead, we know that M H must be part of the lattice, and thus there exists a subset of the maximal elements of the lattice (denoted as M abs ) that is more abstract than M H .
Revised: Instead, we know that M H must be part of the lattice, and thus there exists a subset of the maximal elements of the lattice (denoted as M abs ) that is more abstract than M H .

Original: In this section, we will show how the explanatory ﬂuents for models in this subset of M abs would satisfy M H as well.
Revised: In this section, we will show how the explanatory ﬂuents for models in this subset of M abs would satisfy M H as well.

Original: The ﬁrst useful property to keep in mind is that if M 1 is more concrete than M 2 then the models obtained by concretizing each model with the same set of ﬂuents would maintain this relation (although they may get concretized to the same model), i.e.,
Revised: The ﬁrst useful property to keep in mind is that if M 1 is more concrete than M 2 then the models obtained by concretizing each model with the same set of ﬂuents would maintain this relation (although they may get concretized to the same model), i.e.,

Original: Proposition 1.
Revised: Proposition 1.

Original: Given models M 1 , M 2 and a set of ﬂuents (cid:15) (cid:48) , if M 1 (cid:118) M 2 , then f − 1 (cid:15) (cid:48)
Revised: Given models M 1 , M 2 and a set of ﬂuents (cid:15) (cid:48) , if M 1 (cid:118) M 2 , then f − 1 (cid:15) (cid:48)

Original: ( M 1 ) (cid:118)
Revised: ( M 1 ) (cid:118)

Original: f − 1 (cid:15) (cid:48)
Revised: f − 1 (cid:15) (cid:48)

Original: ( M 2 ) .
Revised: ( M 2 ) .

Original: Next, it can be shown that any given set of explanatory ﬂuents for an abstract model will be a valid explanatory ﬂuent set for a more concrete model
Revised: Next, it can be shown that any given set of explanatory ﬂuents for an abstract model will be a valid explanatory ﬂuent set for a more concrete model

Original: Proposition 2.
Revised: Proposition 2.

Original: Given models M 1 , M 2 , if M 1 (cid:118) M 2 , then any explanation E for M 2 must also be an explanation for
Revised: Given models M 1 , M 2 , if M 1 (cid:118) M 2 , then any explanation E for M 2 must also be an explanation for

Original: M 1 .
Revised: M 1 .

Original: To see why this proposition is true, let’s start from the fact that f − 1 E ( M 1 ) (cid:118) f − 1 E ( M 2 ) and therefore Π f − 1 E ( M 1 ) ⊆
Revised: To see why this proposition is true, let’s start from the fact that f − 1 E ( M 1 ) (cid:118) f − 1 E ( M 2 ) and therefore Π f − 1 E ( M 1 ) ⊆

Original: Π f − 1 E ( M 2 ) .
Revised: Π f − 1 E ( M 2 ) .

Original: From the deﬁnition of explanation we know that the concretization with respect to explanatory ﬂuents would render the problem unsolvable (i.e | Π f − 1 E ( M 2 ) | = 0 ) and thus | Π f − 1 E ( M 1 )) | must also be empty and hence E is an explanation for M 1 .
Revised: From the deﬁnition of explanation we know that the concretization with respect to explanatory ﬂuents would render the problem unsolvable (i.e | Π f − 1 E ( M 2 ) | = 0 ) and thus | Π f − 1 E ( M 1 )) | must also be empty and hence E is an explanation for M 1 .

Original: Deﬁnition 2.
Revised: Deﬁnition 2.

Original: Given an abstraction lattice L , let M abs be its maximal elements.
Revised: Given an abstraction lattice L , let M abs be its maximal elements.

Original: Then the minimum abstraction set is deﬁned as
Revised: Then the minimum abstraction set is deﬁned as

Original: [Equation]
Revised: [Equation]

Original: Note that for any model M 1 ∈ M min , M H (cid:118) M 1 , this means by Proposition 2, any explanation that is valid for models in M min , should lead M H to a node where the problem is unsolvable.
Revised: Note that for any model M 1 ∈ M min , M H (cid:118) M 1 , this means by Proposition 2, any explanation that is valid for models in M min , should lead M H to a node where the problem is unsolvable.

Original: Now we can generate the explanation (even the optimal one) by searching for a set of ﬂuents that when introduced to the models M ∈ M min will render the problem
Revised: Now we can generate the explanation (even the optimal one) by searching for a set of ﬂuents that when introduced to the models M ∈ M min will render the problem

Original: f − 1 E ( M ) unsolvable.
Revised: f − 1 E ( M ) unsolvable.

Original: In this work, we will mostly consider the use of uniform cost search to ﬁnd the least costly set of explanatory ﬂuent, where the cost of each ﬂuent reﬂects the cost of communicating information about a particular ﬂuent.
Revised: In this work, we will mostly consider the use of uniform cost search to ﬁnd the least costly set of explanatory ﬂuent, where the cost of each ﬂuent reﬂects the cost of communicating information about a particular ﬂuent.

Original: In this case, the search state consists of sets of models (with M min being the initial state), the actions consist of the various ﬂuent concretizations, the edges of the lattice deﬁne the successor functions and the goal test involves verifying whether the problem is solvable in each possible model in the current state.
Revised: In this case, the search state consists of sets of models (with M min being the initial state), the actions consist of the various ﬂuent concretizations, the edges of the lattice deﬁne the successor functions and the goal test involves verifying whether the problem is solvable in each possible model in the current state.

Original: 3. Generating Subgoals of a Given Problem
Revised: 3. Generating Subgoals of a Given Problem

Original: Note that it would be hard to identify non-trivial subgoals for the given problem in the node at which the problem was found to be unsolvable (i.e f − 1 E ( M min ) ) since there are no valid plans in that model.
Revised: Note that it would be hard to identify non-trivial subgoals for the given problem in the node at which the problem was found to be unsolvable (i.e f − 1 E ( M min ) ) since there are no valid plans in that model.

Original: Fortunately, we can use models more abstract than f − 1 E ( M min ) to generate such subgoals.
Revised: Fortunately, we can use models more abstract than f − 1 E ( M min ) to generate such subgoals.

Original: We will use planning landmarks [Hoffmann, Porteous, and Sebastia, 2004] extracted from M , where | Π M | > 0 , as subgoals.
Revised: We will use planning landmarks [Hoffmann, Porteous, and Sebastia, 2004] extracted from M , where | Π M | > 0 , as subgoals.

Original: Intuitively, state landmarks (denoted as Λ = (cid:104) Φ , ≺(cid:105) ) for a model
Revised: Intuitively, state landmarks (denoted as Λ = (cid:104) Φ , ≺(cid:105) ) for a model

Original: M can be thought of as a partially ordered set of formulas, where the formulas and the ordering need to be satisﬁed by every plan that is valid in M .
Revised: M can be thought of as a partially ordered set of formulas, where the formulas and the ordering need to be satisﬁed by every plan that is valid in M .

Original: We will only be considering sound orderings (c.f [ Richter, Helmert, and Westphal, 2008 ] ) between landmarks, namely, (1) natural orderings ( ≺ nat ) -
Revised: We will only be considering sound orderings (c.f [ Richter, Helmert, and Westphal, 2008 ] ) between landmarks, namely, (1) natural orderings ( ≺ nat ) -

Original: φ ≺ nat φ (cid:48) , then φ must be true before φ (cid:48) is made true in every plan, (2) necessary orderings ( ≺ nec ) - if φ ≺ nec φ (cid:48) then φ must be true in the step before φ (cid:48) is made true every time and (3) greedy necessary orderings ( ≺ gnec ) - if φ ≺ gnec φ (cid:48) then φ must be true in the step before φ (cid:48) is made true the ﬁrst time.
Revised: φ ≺ nat φ (cid:48) , then φ must be true before φ (cid:48) is made true in every plan, (2) necessary orderings ( ≺ nec ) - if φ ≺ nec φ (cid:48) then φ must be true in the step before φ (cid:48) is made true every time and (3) greedy necessary orderings ( ≺ gnec ) - if φ ≺ gnec φ (cid:48) then φ must be true in the step before φ (cid:48) is made true the ﬁrst time.

Original: The landmark formulas may be disjunctive, conjunctive or atomic landmarks.
Revised: The landmark formulas may be disjunctive, conjunctive or atomic landmarks.

Original: Our use of landmarks as the way to identify subgoals is further justiﬁed by the fact that logically complete abstractions conserve landmarks.
Revised: Our use of landmarks as the way to identify subgoals is further justiﬁed by the fact that logically complete abstractions conserve landmarks.

Original: Formally
Revised: Formally

Original: Proposition 3.
Revised: Proposition 3.

Original: Given two models M 1 and M 2 , such that
Revised: Given two models M 1 and M 2 , such that

Original: M 1 (cid:118) M 2 , let Λ 1 = (cid:104)
Revised: M 1 (cid:118) M 2 , let Λ 1 = (cid:104)

Original: Φ 1 , ≺ 1 (cid:105) and Λ 2 = (cid:104) Φ 2 , ≺ 2 (cid:105) be the landmarks of M 1 and M 2 respectively.
Revised: Φ 1 , ≺ 1 (cid:105) and Λ 2 = (cid:104) Φ 2 , ≺ 2 (cid:105) be the landmarks of M 1 and M 2 respectively.

Original: Then for all φ 1 i , φ 1 j ∈ Φ 1 , such that φ 1 i (cid:22) 1 φ 1 j (where ≺ 1 is some sound ordering), we have φ 2 i and φ 2 j in Φ 2 , where φ 1 i (cid:22) 2 φ 1 j , φ 1 i | = φ 2 i and φ 1 j | =
Revised: Then for all φ 1 i , φ 1 j ∈ Φ 1 , such that φ 1 i (cid:22) 1 φ 1 j (where ≺ 1 is some sound ordering), we have φ 2 i and φ 2 j in Φ 2 , where φ 1 i (cid:22) 2 φ 1 j , φ 1 i | = φ 2 i and φ 1 j | =

Original: φ 2 j .
Revised: φ 2 j .

Original: This is true because φ 2 i ≺ 1 φ 2 j holds over all the plans that are valid in M 2 , and therefore must also hold over all plans in M 1 .
Revised: This is true because φ 2 i ≺ 1 φ 2 j holds over all the plans that are valid in M 2 , and therefore must also hold over all plans in M 1 .

Original: Though in M 1 these landmark instances may be captured by more constrained formulas, and additionally Mmay also contain landmarks that were absent from M 2 .
Revised: Though in M 1 these landmark instances may be captured by more constrained formulas, and additionally Mmay also contain landmarks that were absent from M 2 .

Original: Now if we can show that in a particular model, a landmark generated from a more abstract model is unachievable (or the ordering from the previous level is unachievable) then φ 1 ∗ becomes ⊥ (thereby meeting the above requirement).
Revised: Now if we can show that in a particular model, a landmark generated from a more abstract model is unachievable (or the ordering from the previous level is unachievable) then φ 1 ∗ becomes ⊥ (thereby meeting the above requirement).

Original: Thereafter, for any model more concrete than M 2 , the formula corresponding to that landmark must be ⊥ .
Revised: Thereafter, for any model more concrete than M 2 , the formula corresponding to that landmark must be ⊥ .

Original: In other words, if for any model a landmark is unachievable, then that landmark can’t be achieved in any models more concrete than the current one.
Revised: In other words, if for any model a landmark is unachievable, then that landmark can’t be achieved in any models more concrete than the current one.

Original: So given the explanatory level, we can move one level up in the lattice and make use of any of the well established landmark extraction methods developed for classical planning problem to generate a sequence of potential subgoals for
Revised: So given the explanatory level, we can move one level up in the lattice and make use of any of the well established landmark extraction methods developed for classical planning problem to generate a sequence of potential subgoals for

Original: M R .
Revised: M R .

Original: 3. Identifying Unachievable Sub-Goals
Revised: 3. Identifying Unachievable Sub-Goals

Original: Now we need to ﬁnd the ﬁrst subgoal from the sequence that can no longer be achieved in the models obtained by applying the explanatory ﬂuents ( f − 1 E ( M min ) ) which will then be presented to the user.
Revised: Now we need to ﬁnd the ﬁrst subgoal from the sequence that can no longer be achieved in the models obtained by applying the explanatory ﬂuents ( f − 1 E ( M min ) ) which will then be presented to the user.

Original: For example, in the case of Figure 1, the unachievable subgoal would correspond to satisfying at rover (5 , 4) (marked in red in M 4 ).
Revised: For example, in the case of Figure 1, the unachievable subgoal would correspond to satisfying at rover (5 , 4) (marked in red in M 4 ).

Original: It is important to note that ﬁnding the ﬁrst unachievable subgoal is not as simple as testing the achievability of each subgoal at the abstraction level identiﬁed by methods discussed in section 3.1.
Revised: It is important to note that ﬁnding the ﬁrst unachievable subgoal is not as simple as testing the achievability of each subgoal at the abstraction level identiﬁed by methods discussed in section 3.1.

Original: Instead, we need to make sure that each subgoal is achievable while preserving the order of all the previous subgoals.
Revised: Instead, we need to make sure that each subgoal is achievable while preserving the order of all the previous subgoals.

Original: To test this we will introduce a new compilation that allows us to express the problem of testing achievement of a landmark formula as a planning problem.
Revised: To test this we will introduce a new compilation that allows us to express the problem of testing achievement of a landmark formula as a planning problem.

Original: Consider a planning model M and the landmarks Λ = (cid:104) Φ , ≺(cid:105) extracted from some model M (cid:48) , where M (cid:64) M (cid:48) .
Revised: Consider a planning model M and the landmarks Λ = (cid:104) Φ , ≺(cid:105) extracted from some model M (cid:48) , where M (cid:64) M (cid:48) .

Original: We will assume that the formulas in Φ are propositional logic formulas over the state ﬂuents and are expressed in DNF.
Revised: We will assume that the formulas in Φ are propositional logic formulas over the state ﬂuents and are expressed in DNF.

Original: Each φ ∈ Φ can be represented as a set of sets of ﬂuents (i.e, φ = { c 1 , ..., c k } and each c i set takes the form
Revised: Each φ ∈ Φ can be represented as a set of sets of ﬂuents (i.e, φ = { c 1 , ..., c k } and each c i set takes the form

Original: c i = { p 1 , ..p m } ), where each set of ﬂuents represent a conjunction over those ﬂuents.
Revised: c i = { p 1 , ..p m } ), where each set of ﬂuents represent a conjunction over those ﬂuents.

Original: For testing the achievability of any landmark φ ∈ Φ , we make an augmented model M φ = (cid:104) F φ , A φ , I φ , G φ (cid:105) , such that the landmark is achievable iff | Π M φ | > 0 .
Revised: For testing the achievability of any landmark φ ∈ Φ , we make an augmented model M φ = (cid:104) F φ , A φ , I φ , G φ (cid:105) , such that the landmark is achievable iff | Π M φ | > 0 .

Original: The model M φ can be deﬁned as follows:
Revised: The model M φ can be deﬁned as follows:

Original: F φ = F ∪ F meta , where F meta contains new meta ﬂuents for each possible landmark φ (cid:48) ∈
Revised: F φ = F ∪ F meta , where F meta contains new meta ﬂuents for each possible landmark φ (cid:48) ∈

Original: Φ of the form
Revised: Φ of the form

Original: • achieved ( φ (cid:48) )
Revised: • achieved ( φ (cid:48) )

Original: keeps track of a landmark being achieved and never gets removed • unset ( φ (cid:48) )
Revised: keeps track of a landmark being achieved and never gets removed • unset ( φ (cid:48) )

Original: Says that the landmark has not been achieved yet, usually set true in the initial state unless the landmark is true in the initial state • first time achieved ( φ (cid:48) )
Revised: Says that the landmark has not been achieved yet, usually set true in the initial state unless the landmark is true in the initial state • first time achieved ( φ (cid:48) )

Original: Says that the landmark has been achieved for the ﬁrst time.
Revised: Says that the landmark has been achieved for the ﬁrst time.

Original: This ﬂuent is set true in the initial state if the landmark is already true there
Revised: This ﬂuent is set true in the initial state if the landmark is already true there

Original: The
Revised: The

Original: new action set A
Revised: new action set A

Original: φ ,
Revised: φ ,

Original: will
Revised: will

Original: contain a copy
Revised: contain a copy

Original: of each
Revised: of each

Original: action in
Revised: action in

Original: A .
Revised: A .

Original: For
Revised: For

Original: each
Revised: each

Original: new action corresponding to a ∈ A ,
Revised: new action corresponding to a ∈ A ,

Original: we add the following new effects to track the achievement of each landmark
Revised: we add the following new effects to track the achievement of each landmark

Original: • for each φ (cid:48) ∈
Revised: • for each φ (cid:48) ∈

Original: Φ if the action has existing add effects for a subset of predicates ˆ c j for a c j ∈ φ (cid:48) , then we add the conditional effects cond 1 ( φ (cid:48) )
Revised: Φ if the action has existing add effects for a subset of predicates ˆ c j for a c j ∈ φ (cid:48) , then we add the conditional effects cond 1 ( φ (cid:48) )

Original: → { achieved ( φ (cid:48) ) } and cond 2 ( φ (cid:48) )
Revised: → { achieved ( φ (cid:48) ) } and cond 2 ( φ (cid:48) )

Original: → { first time achieved ( φ (cid:48) ) } , where cond 1 ( φ (cid:48) ) =
Revised: → { first time achieved ( φ (cid:48) ) } , where cond 1 ( φ (cid:48) ) =

Original: c j \ ˆ c j ∪ { ˆ φ | ˆ φ ∈ Φ ∧ (ˆ φ ≺ nec φ (cid:48) ) } ∪ { achieved (ˆ φ ) | ˆ φ ≺ nat φ (cid:48) } and cond 2 ( φ (cid:48) )
Revised: c j \ ˆ c j ∪ { ˆ φ | ˆ φ ∈ Φ ∧ (ˆ φ ≺ nec φ (cid:48) ) } ∪ { achieved (ˆ φ ) | ˆ φ ≺ nat φ (cid:48) } and cond 2 ( φ (cid:48) )

Original: = cond 1 ( φ (cid:48) )
Revised: = cond 1 ( φ (cid:48) )

Original: ∪{ ˆ φ | ˆ φ ≺ gnec φ (cid:48) }∪{ unset ( φ ) } •
Revised: ∪{ ˆ φ | ˆ φ ≺ gnec φ (cid:48) }∪{ unset ( φ ) } •

Original: We add a conditional delete effect to every action of the form first time achieved ( φ (cid:48) )
Revised: We add a conditional delete effect to every action of the form first time achieved ( φ (cid:48) )

Original: → ( not ( first time achieved ( φ (cid:48) )))
Revised: → ( not ( first time achieved ( φ (cid:48) )))

Original: The new goal would be deﬁned as G
Revised: The new goal would be deﬁned as G

Original: φ = {
Revised: φ = {

Original: first time achieved ( φ ) } .
Revised: first time achieved ( φ ) } .

Original: This formulation allows us to test each landmark in the given sequence and ﬁnd the ﬁrst one that can no longer be achieved.
Revised: This formulation allows us to test each landmark in the given sequence and ﬁnd the ﬁrst one that can no longer be achieved.

Original: To ensure completeness, we will return the ﬁnal goal if all the previously extracted landmarks are still achievable in f − 1 E ( M min ) .
Revised: To ensure completeness, we will return the ﬁnal goal if all the previously extracted landmarks are still achievable in f − 1 E ( M min ) .

Original: Now given an ordered set of landmarks, we can identify the ﬁrst unsolvable landmark by testing the solvability of the F φ for each landmark in the order they appear in the sequence.
Revised: Now given an ordered set of landmarks, we can identify the ﬁrst unsolvable landmark by testing the solvability of the F φ for each landmark in the order they appear in the sequence.

Original: Since the above formulation is designed for DNF, we can generate compilation for cases where the landmarks use either un-normalized formulas or CNF by converting them ﬁrst into DNF formulas.
Revised: Since the above formulation is designed for DNF, we can generate compilation for cases where the landmarks use either un-normalized formulas or CNF by converting them ﬁrst into DNF formulas.

Original:  Planning Problems with Plan Advice
Revised:  Planning Problems with Plan Advice

Original: Let us now discuss how we could extend the methods presented in earlier sections to cases where the user provides plan advice.
Revised: Let us now discuss how we could extend the methods presented in earlier sections to cases where the user provides plan advice.

Original: In such cases,the user imposes certain restrictions on the kind of solution they expect, either as an alternative to the solution the system may come up with on its own or as a guide to help the system come up with solutions when it claims unsolvability.
Revised: In such cases,the user imposes certain restrictions on the kind of solution they expect, either as an alternative to the solution the system may come up with on its own or as a guide to help the system come up with solutions when it claims unsolvability.

Original: As pointed out in [Myers, 1996], such advice can be compiled into plan constraints in the original problem.
Revised: As pointed out in [Myers, 1996], such advice can be compiled into plan constraints in the original problem.

Original: A number of approaches have been proposed to capture and represent plan constraints [Bacchus and Kabanza, 2000;
Revised: A number of approaches have been proposed to capture and represent plan constraints [Bacchus and Kabanza, 2000;

Original: Nau et al., 2001; Kambhampati, Knoblock, and Yang, 1995;
Revised: Nau et al., 2001; Kambhampati, Knoblock, and Yang, 1995;

Original: Baier and McIlraith, 2006], and each of these representational choices has its unique strengths and weaknesses.
Revised: Baier and McIlraith, 2006], and each of these representational choices has its unique strengths and weaknesses.

Original: In general, we can see that these plan constraints as specify a partitioning of the space of all valid plans to either acceptable (i.e it satisﬁes the constraints) or unacceptable.
Revised: In general, we can see that these plan constraints as specify a partitioning of the space of all valid plans to either acceptable (i.e it satisﬁes the constraints) or unacceptable.

Original: So we can deﬁne, constraints as follows
Revised: So we can deﬁne, constraints as follows

Original: Deﬁnition 3.
Revised: Deﬁnition 3.

Original: The partition speciﬁed by a constraint σ on a given set of plans that is speciﬁed by a membership function σ : Π → [0 , 1] , where Π is the set of all plans.
Revised: The partition speciﬁed by a constraint σ on a given set of plans that is speciﬁed by a membership function σ : Π → [0 , 1] , where Π is the set of all plans.

Original: We will slightly abuse notation and for a given set of plans ˆΠ we will use σ (Π (cid:48) ) to denote { π | π ∈ ˆΠ ∧ σ ( π ) = 1 } (i.e the subset of Π (cid:48) that satisﬁes the constraint).
Revised: We will slightly abuse notation and for a given set of plans ˆΠ we will use σ (Π (cid:48) ) to denote { π | π ∈ ˆΠ ∧ σ ( π ) = 1 } (i.e the subset of Π (cid:48) that satisﬁes the constraint).

Original: If we can assume some upper bound on the possible length of plans in σ (Π M ) (which is guaranteed when we restrict our attention to non-redundant plans for standard classical planning problems), then we can assert that there always exists a ﬁnite state machine that captures the space of acceptable plans
Revised: If we can assume some upper bound on the possible length of plans in σ (Π M ) (which is guaranteed when we restrict our attention to non-redundant plans for standard classical planning problems), then we can assert that there always exists a ﬁnite state machine that captures the space of acceptable plans

Original: Proposition 4.
Revised: Proposition 4.

Original: Given a constraint σ and a model M , there exists a ﬁnite state automaton F σ, M = (cid:104) Σ , S F σ, M , S 0 , δ, E (cid:105) , where Σ is the input alphabet, S F σ, M deﬁnes the FSA states,
Revised: Given a constraint σ and a model M , there exists a ﬁnite state automaton F σ, M = (cid:104) Σ , S F σ, M , S 0 , δ, E (cid:105) , where Σ is the input alphabet, S F σ, M deﬁnes the FSA states,

Original: S 0 is the initial state, δ is the transition function and E is the set of accepting states, such that σ (Π M )
Revised: S 0 is the initial state, δ is the transition function and E is the set of accepting states, such that σ (Π M )

Original: =
Revised: =

Original: L ( F σ, M ) ∩ Π M , where L ( F σ, M ) is the set of strings accepted by F σ, M .
Revised: L ( F σ, M ) ∩ Π M , where L ( F σ, M ) is the set of strings accepted by F σ, M .

Original: The existence of F σ, M can be trivially shown by considering an FSA that has a path for each unique plan in F σ, M .
Revised: The existence of F σ, M can be trivially shown by considering an FSA that has a path for each unique plan in F σ, M .

Original: We believe that this formulation is general enough to capture almost all of the plan constraint speciﬁcations discussed in the planning literature, including LTL based speciﬁcations, since for classical planning problems these formulas are better understood in terms of LTL f [De Giacomo and Vardi, 2015] which can be compiled into a ﬁnite state automaton.
Revised: We believe that this formulation is general enough to capture almost all of the plan constraint speciﬁcations discussed in the planning literature, including LTL based speciﬁcations, since for classical planning problems these formulas are better understood in terms of LTL f [De Giacomo and Vardi, 2015] which can be compiled into a ﬁnite state automaton.

Original: We can use F σ, M to build a new model σ ( M ) such that a plan is valid in σ ( M ) if and only if the plan is valid for M and satisﬁes the given speciﬁcation σ , i.e., ∀ π, π ∈ Π σ ( M ) iff π ∈ σ (Π M )
Revised: We can use F σ, M to build a new model σ ( M ) such that a plan is valid in σ ( M ) if and only if the plan is valid for M and satisﬁes the given speciﬁcation σ , i.e., ∀ π, π ∈ Π σ ( M ) iff π ∈ σ (Π M )

Original: For M = (cid:104) F, A, I, G (cid:105) , we can deﬁne the new model σ ( M ) =
Revised: For M = (cid:104) F, A, I, G (cid:105) , we can deﬁne the new model σ ( M ) =

Original: (cid:104) F σ , A σ , I σ , G σ (cid:105) as follows
Revised: (cid:104) F σ , A σ , I σ , G σ (cid:105) as follows

Original: • F σ = F ∪ { in-state- { S }| S ∈ S F σ, M } • A σ =
Revised: • F σ = F ∪ { in-state- { S }| S ∈ S F σ, M } • A σ =

Original: A ∪ A δ • I σ
Revised: A ∪ A δ • I σ

Original: =
Revised: =

Original: I ∪ { in-state- { S 0 }}
Revised: I ∪ { in-state- { S 0 }}

Original: [Figure]
Revised: [Figure]

Original: A δ are the new meta actions responsible for simulating the transitions deﬁned by δ : S F σ, M × Σ → pow ( S F σ, M ) .
Revised: A δ are the new meta actions responsible for simulating the transitions deﬁned by δ : S F σ, M × Σ → pow ( S F σ, M ) .

Original: For example, if δ ( S 1 , a ) = { S 1 , S 2 } , where a corresponds to an action in A , then we will have two new actions a 1 S 1 ,a = (cid:104) prec a ∪ { in-state- { S 1 }} , adds a ∪ { in-state- { S 2 }} , dels a ∪ { in-state- { S 1 }}(cid:105) and a 2 S 1 ,a = (cid:104) prec a ∪ { in-state- { S 1 }} , adds a , dels a }(cid:105) .
Revised: For example, if δ ( S 1 , a ) = { S 1 , S 2 } , where a corresponds to an action in A , then we will have two new actions a 1 S 1 ,a = (cid:104) prec a ∪ { in-state- { S 1 }} , adds a ∪ { in-state- { S 2 }} , dels a ∪ { in-state- { S 1 }}(cid:105) and a 2 S 1 ,a = (cid:104) prec a ∪ { in-state- { S 1 }} , adds a , dels a }(cid:105) .

Original: In cases like LTL, the FSA state transitions may be induced by the satisfaction of some formula, so the new meta action may have preconditions corresponding to that formula, with no other effects but changing the ﬂuent corresponding to the state transition.
Revised: In cases like LTL, the FSA state transitions may be induced by the satisfaction of some formula, so the new meta action may have preconditions corresponding to that formula, with no other effects but changing the ﬂuent corresponding to the state transition.

Original: The above formulation merely points out that there always exists a way of generating σ ( M ) from the given speciﬁcation σ and M .
Revised: The above formulation merely points out that there always exists a way of generating σ ( M ) from the given speciﬁcation σ and M .

Original: For many constraint types, there may exist more efﬁcient ways of generating models that satisfy the requirements of σ ( M ) .
Revised: For many constraint types, there may exist more efﬁcient ways of generating models that satisfy the requirements of σ ( M ) .

Original: Once we have access to σ ( M ) , we should be able to use the methods discussed in earlier sections to explain unsolvability of σ ( M ) and hence why the constraint isn’t feasible.
Revised: Once we have access to σ ( M ) , we should be able to use the methods discussed in earlier sections to explain unsolvability of σ ( M ) and hence why the constraint isn’t feasible.

Original: To facilitate such explanation, we will build an abstraction lattice for the constrained problems L σ M ,P such that P ∩ ( F σ \ F )
Revised: To facilitate such explanation, we will build an abstraction lattice for the constrained problems L σ M ,P such that P ∩ ( F σ \ F )

Original: =
Revised: =

Original: φ , i.e the abstraction lattice only affects the ﬂuents from the original problem and not the new ones introduced as part of the compilation.
Revised: φ , i.e the abstraction lattice only affects the ﬂuents from the original problem and not the new ones introduced as part of the compilation.

Original: In fact, we can induce such a lattice by considering the lattice generated for the original problem and then replacing each node in the lattice with the corresponding compiled problem, to see why this would induce a valid abstraction lattice, consider the following property
Revised: In fact, we can induce such a lattice by considering the lattice generated for the original problem and then replacing each node in the lattice with the corresponding compiled problem, to see why this would induce a valid abstraction lattice, consider the following property

Original: Proposition 5.
Revised: Proposition 5.

Original: Given models M 1 , M 2 and a constraint speciﬁcation σ , if M 1 (cid:118) M 2 , then σ ( M 1 ) (cid:118) σ ( M 2 ) .
Revised: Given models M 1 , M 2 and a constraint speciﬁcation σ , if M 1 (cid:118) M 2 , then σ ( M 1 ) (cid:118) σ ( M 2 ) .

Original: To see why this is true, just assume that the reverse was true, that σ ( M 2 ) is not a logically complete abstraction of σ ( M 1 ) .
Revised: To see why this is true, just assume that the reverse was true, that σ ( M 2 ) is not a logically complete abstraction of σ ( M 1 ) .

Original: This means that there are plans in Π σ ( M 1 ) that are not part of Π σ ( M 2 ) .
Revised: This means that there are plans in Π σ ( M 1 ) that are not part of Π σ ( M 2 ) .

Original: From the deﬁnition of σ ( M 2 ) , we know that Π σ ( M 2 ) =
Revised: From the deﬁnition of σ ( M 2 ) , we know that Π σ ( M 2 ) =

Original: Π M 2 ∩ L ( F σ ) .
Revised: Π M 2 ∩ L ( F σ ) .

Original: If there exist a π ∈ Π σ ( M 1 ) , such that π (cid:54)∈ Π σ ( M 2 ) , then π (cid:54)∈ Π M 2 .
Revised: If there exist a π ∈ Π σ ( M 1 ) , such that π (cid:54)∈ Π σ ( M 2 ) , then π (cid:54)∈ Π M 2 .

Original: Which means M 1 (cid:54)(cid:118) M 2 , hence contradicting our assumptions.
Revised: Which means M 1 (cid:54)(cid:118) M 2 , hence contradicting our assumptions.

Original: Revisiting Example 1, the question asked by the user could be seen as an advice, where the corresponding constraint covers all plans where the rover performs the actions collect rock sample P4 , collect soil sample P7 , irrespective of the exact position and order in which the actions appears in the plan.
Revised: Revisiting Example 1, the question asked by the user could be seen as an advice, where the corresponding constraint covers all plans where the rover performs the actions collect rock sample P4 , collect soil sample P7 , irrespective of the exact position and order in which the actions appears in the plan.

Original: More generally, we could think of this plan advice as being a special case of advice where the user wants to ensure presence of certain actions in the plan with some partial ordering among them (eg: “Why don’t you pickup block B and then C?”, “Make sure that you have cleared Room1 before you move on to Room2 and Room3” etc..).
Revised: More generally, we could think of this plan advice as being a special case of advice where the user wants to ensure presence of certain actions in the plan with some partial ordering among them (eg: “Why don’t you pickup block B and then C?”, “Make sure that you have cleared Room1 before you move on to Room2 and Room3” etc..).

Original: Such advice could be represented as partial plans [Kambhampati, Knoblock, and
Revised: Such advice could be represented as partial plans [Kambhampati, Knoblock, and

Original: Yang, 1995], which in general can be captured as a partially ordered multiset of the form 1 ˆ π = (cid:104) ˆ A, (cid:54) (cid:105) , where ˆ A is a multiset over grounded actions and (cid:54) deﬁnes ordering constraints over these grounded actions.
Revised: Yang, 1995], which in general can be captured as a partially ordered multiset of the form 1 ˆ π = (cid:104) ˆ A, (cid:54) (cid:105) , where ˆ A is a multiset over grounded actions and (cid:54) deﬁnes ordering constraints over these grounded actions.

Original: A plan π = (cid:104) a 1 , ..., a n (cid:105) is said to be a candidate plan for the given partial plan ˆ π , if there exists a mapping function µ : ˆ A → [1 , | π | ] that maps each action in a ∈ ˆ A to a position in the plan such that a = a µ ( a ) and if a < b for a, b ∈ ˆ A , then µ ( a ) < µ ( b ) .
Revised: A plan π = (cid:104) a 1 , ..., a n (cid:105) is said to be a candidate plan for the given partial plan ˆ π , if there exists a mapping function µ : ˆ A → [1 , | π | ] that maps each action in a ∈ ˆ A to a position in the plan such that a = a µ ( a ) and if a < b for a, b ∈ ˆ A , then µ ( a ) < µ ( b ) .

Original: Such partial plans can be fairly easily compiled into a classical planning model (such that it satisﬁes σ ( M ) ) by extending the compilation methods discussed in [Ramırez and Geffner, 2010], without relying on an intermediate ﬁnite state machine.
Revised: Such partial plans can be fairly easily compiled into a classical planning model (such that it satisﬁes σ ( M ) ) by extending the compilation methods discussed in [Ramırez and Geffner, 2010], without relying on an intermediate ﬁnite state machine.

Original: The corresponding partial plan for the question speciﬁed above would be
Revised: The corresponding partial plan for the question speciﬁed above would be

Original: [Equation]
Revised: [Equation]

Original: Let us assume that in this case the observer could be unaware of certain domain constraints such as the rover’s inability to traverse certain regions on the map the fact that not all rovers are capable of collecting rock and soil samples or that they are not always equipped to store these samples.
Revised: Let us assume that in this case the observer could be unaware of certain domain constraints such as the rover’s inability to traverse certain regions on the map the fact that not all rovers are capable of collecting rock and soil samples or that they are not always equipped to store these samples.

Original: In this case, possible user models can be captured by a lattice build using the following ﬂuents P = { (can traverse ?
Revised: In this case, possible user models can be captured by a lattice build using the following ﬂuents P = { (can traverse ?

Original: x ?y) , (equipped for soil sample ?
Revised: x ?y) , (equipped for soil sample ?

Original: r) , (equipped for rock sample ?
Revised: r) , (equipped for rock sample ?

Original: r) , (store of ?r) } .
Revised: r) , (store of ?r) } .

Original: Now our approach would identify the user need to be made aware of the fact that not all regions of the map are equally traversable (i.e inform the user about can traverse ?
Revised: Now our approach would identify the user need to be made aware of the fact that not all regions of the map are equally traversable (i.e inform the user about can traverse ?

Original: x ?y ) and how its a precondition for move action), furthermore given this property the robot can no longer reach the waypoint 4 which is required to complete this task (i.e the unreachable landmark is (at rover0 waypoint4) ).
Revised: x ?y ) and how its a precondition for move action), furthermore given this property the robot can no longer reach the waypoint 4 which is required to complete this task (i.e the unreachable landmark is (at rover0 waypoint4) ).

Original:  Evaluations 5. User Studies
Revised:  Evaluations 5. User Studies

Original: Our ﬁrst concern with evaluating explanations based on landmarks was to establish that they constitute meaningful explanations for naive users.
Revised: Our ﬁrst concern with evaluating explanations based on landmarks was to establish that they constitute meaningful explanations for naive users.

Original: As a simple alternative to our explanations, we consider providing to the user a set of potential solutions (generated from a higher level of abstraction) and their individual failures.
Revised: As a simple alternative to our explanations, we consider providing to the user a set of potential solutions (generated from a higher level of abstraction) and their individual failures.

Original: For the study, we recruited aroundmaster turkers from Amazon’s Mechanical Turk and tested the following hypotheses
Revised: For the study, we recruited aroundmaster turkers from Amazon’s Mechanical Turk and tested the following hypotheses

Original: • H1 - Users prefer concise explanations over ones that enumerate a set of possible candidates for a given piece
Revised: • H1 - Users prefer concise explanations over ones that enumerate a set of possible candidates for a given piece

Original: of plan advice
Revised: of plan advice

Original: [Table]
Revised: [Table]

Original: • H2 - Users prefer concise explanations that contain information about unachievable landmarks over ones that only show the failure of a single exemplary plan
Revised: • H2 - Users prefer concise explanations that contain information about unachievable landmarks over ones that only show the failure of a single exemplary plan

Original: For the hypotheses, we presented the study participants with a sample dialogue between two people over a logistics plan to move a package from one location to another.
Revised: For the hypotheses, we presented the study participants with a sample dialogue between two people over a logistics plan to move a package from one location to another.

Original: The dialogue included a person (named Bob) presenting a plan to another (named Alice), and Alice asks for an alternative possibility (i.e speciﬁes a constraint on the solution).
Revised: The dialogue included a person (named Bob) presenting a plan to another (named Alice), and Alice asks for an alternative possibility (i.e speciﬁes a constraint on the solution).

Original: Now the challenge for Bob is to explain why the constrained problem is unsolvable.
Revised: Now the challenge for Bob is to explain why the constrained problem is unsolvable.

Original: For example, in one example Bob presents a rather convoluted plan that involves the package being transferred through multiple trucks to a train and then to the ﬁnal destination.
Revised: For example, in one example Bob presents a rather convoluted plan that involves the package being transferred through multiple trucks to a train and then to the ﬁnal destination.

Original: This leads to Alice asking the package to be delivered via an airplane.
Revised: This leads to Alice asking the package to be delivered via an airplane.

Original: For H1, in addition to some model information that Bob was unaware of, the potential explanations included either (a) the information on the unachievable landmark, (b) landmark information with the failure details of a speciﬁc exemplary plan or (c) a set of plans that satisfy the constraints and their corresponding failures.
Revised: For H1, in addition to some model information that Bob was unaware of, the potential explanations included either (a) the information on the unachievable landmark, (b) landmark information with the failure details of a speciﬁc exemplary plan or (c) a set of plans that satisfy the constraints and their corresponding failures.

Original: For the earlier example this meant
Revised: For the earlier example this meant

Original: Bob explains to Alice the limited availability of Truck fuel and (a) the impossibility of getting the package to the airport or (b) the the impossibility of getting the package to the airport and a speciﬁc plan (eg: truck1 picks up package moves to location two then to three ... ) along with its point of failure (eg: truck1 runs out of fuel when it reaches location three ) or (c) three example plans involving various trucks trying to get the package to the airport and their speciﬁc points of failures (each of which fails at different steps but before reaching the airport).
Revised: Bob explains to Alice the limited availability of Truck fuel and (a) the impossibility of getting the package to the airport or (b) the the impossibility of getting the package to the airport and a speciﬁc plan (eg: truck1 picks up package moves to location two then to three ... ) along with its point of failure (eg: truck1 runs out of fuel when it reaches location three ) or (c) three example plans involving various trucks trying to get the package to the airport and their speciﬁc points of failures (each of which fails at different steps but before reaching the airport).

Original: Forthis study, we used 45 participants and each participant was assigned one of three possible maps for each hypothesis and was paid $1.25 for 10 mins.
Revised: Forthis study, we used 45 participants and each participant was assigned one of three possible maps for each hypothesis and was paid $1.25 for 10 mins.

Original: We used a control question to ﬁlter participant responses, so as to ensure their quality.
Revised: We used a control question to ﬁlter participant responses, so as to ensure their quality.

Original: Out of the 39 remaining responses, we found 94.8% of users chose to select the more concise explanation (i.e (a) or (b)), and 51.28% of the users chose explanations that involved just landmarks.
Revised: Out of the 39 remaining responses, we found 94.8% of users chose to select the more concise explanation (i.e (a) or (b)), and 51.28% of the users chose explanations that involved just landmarks.

Original: ForH2,we used 75 participants and presented each participant with explanations that include (a) just landmark information, (b) landmark information with failure details of an exemplary plan and (c) just the exemplary plan failure.
Revised: ForH2,we used 75 participants and presented each participant with explanations that include (a) just landmark information, (b) landmark information with failure details of an exemplary plan and (c) just the exemplary plan failure.

Original: Here participants were paid $1 for 10 mins for H2 as the explanatory options were much simpler.
Revised: Here participants were paid $1 for 10 mins for H2 as the explanatory options were much simpler.

Original: After ﬁltering using the control question, we found that out of 60 valid entries 75.4% of participants preferred explanations that included landmark information ((a) or (b)) and 44.2% wanted both landmarks and exemplary plan (i.e (b)).
Revised: After ﬁltering using the control question, we found that out of 60 valid entries 75.4% of participants preferred explanations that included landmark information ((a) or (b)) and 44.2% wanted both landmarks and exemplary plan (i.e (b)).

Original: The supplementary ﬁle at http://bit.ly/2HQ5sTv contains more details on the study setup.
Revised: The supplementary ﬁle at http://bit.ly/2HQ5sTv contains more details on the study setup.

Original: 5. Empirical Studies
Revised: 5. Empirical Studies

Original: In this section, we will present the results of an empirical evaluation of the computational characteristics of our approach.
Revised: In this section, we will present the results of an empirical evaluation of the computational characteristics of our approach.

Original: One big concern with the methods discussed in this work is the fact that they involve solving multiple planning problems.
Revised: One big concern with the methods discussed in this work is the fact that they involve solving multiple planning problems.

Original: Thus we were interested in identifying the runtime for generating explanations on a set of standard planning benchmarks.
Revised: Thus we were interested in identifying the runtime for generating explanations on a set of standard planning benchmarks.

Original: Toevaluate our methods, we considered eight planning domains and chose ﬁve problem instances for each of the domains.
Revised: Toevaluate our methods, we considered eight planning domains and chose ﬁve problem instances for each of the domains.

Original: For each domain, we used a subset of the domain predicates to generate the abstraction lattice (i.e we set the subset as the set of ﬂuents P used to deﬁne the lattice).
Revised: For each domain, we used a subset of the domain predicates to generate the abstraction lattice (i.e we set the subset as the set of ﬂuents P used to deﬁne the lattice).

Original: The ﬁrst ﬁve domains and their problem instances consisted of standard IPC domains and problem instances used in previous IPC competitions [ International Planning Competition, 2011 ] .
Revised: The ﬁrst ﬁve domains and their problem instances consisted of standard IPC domains and problem instances used in previous IPC competitions [ International Planning Competition, 2011 ] .

Original: Each problem instance was made unsolvable by including plan constraints that avoid a speciﬁc landmark of the original problem.
Revised: Each problem instance was made unsolvable by including plan constraints that avoid a speciﬁc landmark of the original problem.

Original: The constraints were coded using domain control programs [ Baier, Fritz, and McIlraith, 2007 ] of the form while ¬ φ ∧ ¬ (goal completed) do any done
Revised: The constraints were coded using domain control programs [ Baier, Fritz, and McIlraith, 2007 ] of the form while ¬ φ ∧ ¬ (goal completed) do any done

Original: Where φ is the landmark formula and (goal completed) is the goal ﬂuent (generated by a new goal action whose preconditions are the original goals of the problem).
Revised: Where φ is the landmark formula and (goal completed) is the goal ﬂuent (generated by a new goal action whose preconditions are the original goals of the problem).

Original: The constraints ensure that any valid plan must avoid the landmark φ and thereby rendering it unsolvable.
Revised: The constraints ensure that any valid plan must avoid the landmark φ and thereby rendering it unsolvable.

Original: The next three domains were selected from the set used for the 2016 unsolvability competition [Unsolvability International Planning Competition, 2016]
Revised: The next three domains were selected from the set used for the 2016 unsolvability competition [Unsolvability International Planning Competition, 2016]

Original: (these domains are marked with an asterix in the results table).
Revised: (these domains are marked with an asterix in the results table).

Original: All instances were run with a timeout ofminutes (all problems were solvable under this time limit) and all landmarks were generated using the fast-downward implementation of [Keyder, Richter, and Helmert, 2010]
Revised: All instances were run with a timeout ofminutes (all problems were solvable under this time limit) and all landmarks were generated using the fast-downward implementation of [Keyder, Richter, and Helmert, 2010]

Original: (where we set the subset sizes to one for the ﬁrst ﬁve domains and to two for the rest).
Revised: (where we set the subset sizes to one for the ﬁrst ﬁve domains and to two for the rest).

Original: Table 1 presents the results of our tests on these domains.
Revised: Table 1 presents the results of our tests on these domains.

Original: It shows the number of ﬂuents used to generate the lattice ( | P | ), the average runtime, the cost of the generated explanations and the cost of presenting the most concrete model to the user.
Revised: It shows the number of ﬂuents used to generate the lattice ( | P | ), the average runtime, the cost of the generated explanations and the cost of presenting the most concrete model to the user.

Original: For each scenario, we created a complete lattice for all the ﬂuents considered for abstraction (i.e | M | = 2 | P | ).
Revised: For each scenario, we created a complete lattice for all the ﬂuents considered for abstraction (i.e | M | = 2 | P | ).

Original: The cost of the explanation captures the amount of information to be provided to the user as part of the explanation.
Revised: The cost of the explanation captures the amount of information to be provided to the user as part of the explanation.

Original: This could include information regarding the various explanatory ﬂuents and is here captured roughly by the number of places within the domain deﬁnition where these ﬂuents appear.
Revised: This could include information regarding the various explanatory ﬂuents and is here captured roughly by the number of places within the domain deﬁnition where these ﬂuents appear.

Original: The cost also reﬂects the inferential overhead demanded from the user (since providing more information translates to the user needing to understand the domain at a much more concrete level).
Revised: The cost also reﬂects the inferential overhead demanded from the user (since providing more information translates to the user needing to understand the domain at a much more concrete level).

Original: For a sample explanation, consider the overconstrained rover domain, where the rovers’ actions are limited by their energy levels and the energy of the rover isn’t enough to ﬁnish the task.
Revised: For a sample explanation, consider the overconstrained rover domain, where the rovers’ actions are limited by their energy levels and the energy of the rover isn’t enough to ﬁnish the task.

Original: In one of the instances where the rover energy level is at 33 and the original problem had a goal consisting of eight propositions (each referring to the need for communicating a particular soil sample, rock sample or sending an image for different objectives), our approach was able to identify that the user needs to understand ﬂuents related to energy ( (energy ?
Revised: In one of the instances where the rover energy level is at 33 and the original problem had a goal consisting of eight propositions (each referring to the need for communicating a particular soil sample, rock sample or sending an image for different objectives), our approach was able to identify that the user needs to understand ﬂuents related to energy ( (energy ?

Original: x ?y) and (energycost ?x ?
Revised: x ?y) and (energycost ?x ?

Original: y ?
Revised: y ?

Original: z) ) and identiﬁed two subgoals out of the eight that it could not achieve.
Revised: z) ) and identiﬁed two subgoals out of the eight that it could not achieve.

Original: Figure 3 presents the variations in average runtime for three of the domains as the size of the lattice were increased (the Xaxis represents the number of ﬂuents that were used to build the lattice and Y the runtime in seconds).
Revised: Figure 3 presents the variations in average runtime for three of the domains as the size of the lattice were increased (the Xaxis represents the number of ﬂuents that were used to build the lattice and Y the runtime in seconds).

Original: Note that, in general, the runtime increases as the lattice size increase due to the increase in the search space, but in all three domains there are points where the runtime decrease when the lattice size increases.
Revised: Note that, in general, the runtime increases as the lattice size increase due to the increase in the search space, but in all three domains there are points where the runtime decrease when the lattice size increases.

Original: This is expected since with an increase in the size of lattice, the planning problems whose unsolvability are being tested becomes simpler.
Revised: This is expected since with an increase in the size of lattice, the planning problems whose unsolvability are being tested becomes simpler.

Original:  Related Work
Revised:  Related Work

Original: As discussed earlier, our methods for identifying the level of explanations are based on the expertise level modeling approaches introduced in [ Sreedharan, Srivastava, and Kambhampati, 2018 ] .
Revised: As discussed earlier, our methods for identifying the level of explanations are based on the expertise level modeling approaches introduced in [ Sreedharan, Srivastava, and Kambhampati, 2018 ] .

Original: These two works are quite closely connected and in fact, the contrastive explanations of the type studied in the earlier paper, where the user presents alternative plans (i.e the foils for the explanations) that are then refuted by the system, is a special case of our approach for handling problems with plan advice.
Revised: These two works are quite closely connected and in fact, the contrastive explanations of the type studied in the earlier paper, where the user presents alternative plans (i.e the foils for the explanations) that are then refuted by the system, is a special case of our approach for handling problems with plan advice.

Original: The problems studied in that earlier paper can be thought of as capturing cases where the advice only allows for a single plan.
Revised: The problems studied in that earlier paper can be thought of as capturing cases where the advice only allows for a single plan.

Original: Also, one could argue that people would be more comfortable giving advices as foils rather than full plans.
Revised: Also, one could argue that people would be more comfortable giving advices as foils rather than full plans.

Original: Part of our explanations also try to reveal to the user information about the current task that was previously unknown to them.
Revised: Part of our explanations also try to reveal to the user information about the current task that was previously unknown to them.

Original: Thus our methods could also be understood as an example of explanation as model-reconciliation [ Chakraborti et al., 2017 ] .
Revised: Thus our methods could also be understood as an example of explanation as model-reconciliation [ Chakraborti et al., 2017 ] .

Original: Since our methods use abstractions, our approach doesn’t make too many demands on the inferential capabilities of the user and hence can be applied to much larger and more complex domains.
Revised: Since our methods use abstractions, our approach doesn’t make too many demands on the inferential capabilities of the user and hence can be applied to much larger and more complex domains.

Original: Another closely related direction has been the work done on explaining unsynthesizability of hybrid controllers for a given set of high-level task speciﬁcations
Revised: Another closely related direction has been the work done on explaining unsynthesizability of hybrid controllers for a given set of high-level task speciﬁcations

Original: [Raman and KressGazit, 2013].
Revised: [Raman and KressGazit, 2013].

Original: The work tries to identify the subformulas of the given speciﬁcation that lead to the unsynthesizability.
Revised: The work tries to identify the subformulas of the given speciﬁcation that lead to the unsynthesizability.

Original: This particular approach is speciﬁc to the planning framework detailed in [Finucane, Jing, and Kress-Gazit, 2010] and the objective of the work parallels the goals of work like [G¨obelbecker et al., 2010].
Revised: This particular approach is speciﬁc to the planning framework detailed in [Finucane, Jing, and Kress-Gazit, 2010] and the objective of the work parallels the goals of work like [G¨obelbecker et al., 2010].

Original: Outside of explanation generation, the work done in the model checking community is closely related to our current problem [Grumberg and Veith, 2008].
Revised: Outside of explanation generation, the work done in the model checking community is closely related to our current problem [Grumberg and Veith, 2008].

Original: In fact, the hierarchical approach to identifying a model that can invalidate the given foil speciﬁcation, can be seen as a special case of the CEGAR based methods studied in the model-checking community [Clarke et al., 2000].
Revised: In fact, the hierarchical approach to identifying a model that can invalidate the given foil speciﬁcation, can be seen as a special case of the CEGAR based methods studied in the model-checking community [Clarke et al., 2000].

Original: Most work in this ﬁeld focuses on developing methods for identifying whether a given program meets some speciﬁcations and failures to meet speciﬁcation are generally communicated via counterexamples.
Revised: Most work in this ﬁeld focuses on developing methods for identifying whether a given program meets some speciﬁcations and failures to meet speciﬁcation are generally communicated via counterexamples.

Original: Another related problem is that of identifying whether a given problem is unsolvable.
Revised: Another related problem is that of identifying whether a given problem is unsolvable.

Original: In our setting, we assume that the system is capable of correctly identifying whether a given problem is unsolvable or not and in general this can be a time consuming process.
Revised: In our setting, we assume that the system is capable of correctly identifying whether a given problem is unsolvable or not and in general this can be a time consuming process.

Original: Thankfully the problem of efﬁciently identifying whether a given planning problem is unsolvable is an active research area (cf.
Revised: Thankfully the problem of efﬁciently identifying whether a given planning problem is unsolvable is an active research area (cf.

Original: [ Steinmetz and Hoffmann, 2017;
Revised: [ Steinmetz and Hoffmann, 2017;

Original: Kolobov, Weld, and others, 2010 ] ) and solutions to this problem can be easily leveraged by our approach to improve the overall efﬁciency of the system.
Revised: Kolobov, Weld, and others, 2010 ] ) and solutions to this problem can be easily leveraged by our approach to improve the overall efﬁciency of the system.

Original:  Conclusion and Future Directions
Revised:  Conclusion and Future Directions

Original: The work presented in this paper investigates the problem of generating explanations for unsolvability of a given planning problem.
Revised: The work presented in this paper investigates the problem of generating explanations for unsolvability of a given planning problem.

Original: We also saw how the same methods apply when dealing with problems with plan constraints.
Revised: We also saw how the same methods apply when dealing with problems with plan constraints.

Original: In addition to extending these methods to more expressive domains, an interesting extension would be to try tackling cases where the current problem is solvable but all the solutions are too expensive.
Revised: In addition to extending these methods to more expressive domains, an interesting extension would be to try tackling cases where the current problem is solvable but all the solutions are too expensive.

Original: While this additional cost threshold could be seen as a constraint, the setting becomes a lot more interesting when the action costs are affected by the abstractions (c.f state dependent costs [ Geißer, Keller, and Mattm¨uller, 2016 ] ).
Revised: While this additional cost threshold could be seen as a constraint, the setting becomes a lot more interesting when the action costs are affected by the abstractions (c.f state dependent costs [ Geißer, Keller, and Mattm¨uller, 2016 ] ).

Original: With respect to contrastive explanations, this would correspond to cases where the alternative posed by the user is more expensive than the plan proposed by the robot.
Revised: With respect to contrastive explanations, this would correspond to cases where the alternative posed by the user is more expensive than the plan proposed by the robot.

Original: Finally, an obvious challenge to fully realize this method in practical scenarios is to develop methods to convert user questions to plan constraints.
Revised: Finally, an obvious challenge to fully realize this method in practical scenarios is to develop methods to convert user questions to plan constraints.

Original: Methods like [Tenorth et al., 2010] can be used to convert natural language statements to constraints like partial plans.
Revised: Methods like [Tenorth et al., 2010] can be used to convert natural language statements to constraints like partial plans.

Original: Expert users can also directly write LTL and procedural programs as a way of interrogating the system.
Revised: Expert users can also directly write LTL and procedural programs as a way of interrogating the system.

Original: Acknowledgments
Revised: Acknowledgments

Original: This research is supported in part by the ONR grants
Revised: This research is supported in part by the ONR grants

Original: N00014-16-1-2892, N00014-18-1-2442, N00014-18-1-2840, the AFOSR grant FA9550-18-1-0067, the NASA grant
Revised: N00014-16-1-2892, N00014-18-1-2442, N00014-18-1-2840, the AFOSR grant FA9550-18-1-0067, the NASA grant

Original: NNX17AD06G and NSF grant 1844325. We also thank the
Revised: NNX17AD06G, NSF grant 1844325 and a JP Morgan AI

Original: IJCAI reviewers for their comments and feedback.
Revised: Faculty Research grant.