Module Import alias identifier ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias Assign NameStore Dict Str Str Str Str ListLoad Str ListLoad Str Str Str Str ListLoad Str Str Str Str ListLoad Str Str Str Str Str Str Str Str ClassDef bases NameLoad NameLoad body Expr Str FunctionDef arguments args NameParam NameParam defaults Str body Expr Call AttributeLoad NameLoad attr NameLoad Call NameLoad If Call NameLoad NameLoad NameLoad body Assign NameStore SubscriptLoad NameLoad Index NameLoad Assign AttributeStore NameLoad attr NameStore Call AttributeLoad NameLoad attr Call NameLoad NameLoad NameLoad Assign TupleStore AttributeStore NameLoad attr AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign TupleStore TupleStore NameStore TupleStore NameStore Call AttributeLoad NameLoad attr CompareEq NameLoad Str Assign AttributeStore NameLoad attr BinOpAdd BinOpMult NameLoad AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Return AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Str Return SubscriptLoad Call NameLoad keyword Num keyword Num keyword Num keyword Num Index NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore ListComp SubscriptLoad NameLoad Index Num comprehension NameStore NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call NameLoad NameLoad keyword NameLoad Assign NameStore SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index Num Assign NameStore BinOpDiv NameLoad AttributeLoad NameLoad attr Assign NameStore BinOpMod NameLoad AttributeLoad NameLoad attr Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index TupleLoad NameLoad NameLoad If CompareEq NameLoad Str body Assign NameStore NameLoad Assign NameStore Num orelse If CompareIn NameLoad ListLoad Str Str body Assign NameStore NameLoad Assign NameStore Num orelse If CompareEq NameLoad Str body Assign NameStore NameLoad Assign NameStore Num orelse Raise NameLoad Assign AttributeStore NameLoad attr NameLoad Return Call NameLoad keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str Assert Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assert Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore BinOpDiv NameLoad AttributeLoad NameLoad attr Assign NameStore BinOpMod NameLoad AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr ListLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListLoad ListLoad Num Num ListLoad Num Num ListLoad Num Num ListLoad Num Num Assign NameStore Call AttributeLoad NameLoad attr BinOpAdd NameLoad SubscriptLoad NameLoad Index NameLoad ListLoad Num Num ListLoad BinOpSub AttributeLoad NameLoad attr Num BinOpSub AttributeLoad NameLoad attr Num Assign NameStore BinOpAdd BinOpMult SubscriptLoad NameLoad Index Num AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index TupleLoad NameLoad NameLoad Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index TupleLoad SubscriptLoad NameLoad Index Num SubscriptLoad NameLoad Index Num If BoolOpOr CompareEq NameLoad Str CompareEq NameLoad Str CompareEq NameLoad Str body Return ListLoad TupleLoad NameLoad Num orelse Return ListLoad TupleLoad NameLoad Num decorator_list FunctionDef arguments args NameParam defaults body Return Call NameLoad Num decorator_list NameLoad FunctionDef arguments args NameParam defaults body Return Call NameLoad BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list NameLoad decorator_list
N/A N/A numpy np base Env rllab.spaces Discrete rllab.envs.base Step rllab.core.serializable Serializable N/A MAPS N/A chain 4x4_safe 4x4 8x8 N/A GFFFFFFFFFFFFFSFFFFFFFFFFFFFG N/A SFFF FWFW FFFW WFFG N/A SFFF FHFH FFFH HFFG N/A SFFFFFFF FFFFFFFF FFFHFFFF FFFFFHFF FFFHFFFF FHHFFFHF FHFFHFHF FFFHFFFG GridWorldEnv N/A Env Serializable N/A N/A 
    S : starting point
    F : free space
    W : wall
    H : hole (terminates episode)
    G : goal


     __init__ N/A N/A self desc N/A 4x4 N/A N/A N/A N/A Serializable quick_init self N/A locals N/A N/A isinstance desc basestring N/A N/A desc N/A MAPS N/A desc N/A N/A self desc desc N/A N/A np array N/A map list desc N/A N/A N/A self n_row N/A self n_col N/A desc shape N/A N/A N/A start_x N/A start_y N/A N/A np nonzero N/A desc S N/A N/A self start_state N/A N/A start_x N/A self n_col start_y N/A N/A self state None N/A N/A self domain_fig None N/A reset N/A N/A self N/A N/A N/A N/A self state N/A self start_state N/A N/A self state N/A action_from_direction N/A N/A d N/A N/A N/A 
        Return the action corresponding to the given direction. This is a helper method for debugging and testing
        purposes.
        :return: the action index corresponding to the given direction
         N/A N/A N/A dict left 0 down 1 right 2 up 3 N/A d N/A staticmethod step N/A N/A self action N/A N/A N/A 
        action map:
        0: left
        1: down
        2: right
        3: up
        :param action: should be a one-hot vector encoding the action
        :return:
         N/A possible_next_states N/A N/A self get_possible_next_states N/A self state action N/A probs N/A N/A x N/A 1 N/A x possible_next_states N/A next_state_idx N/A N/A N/A np random choice N/A len probs p probs N/A next_state N/A N/A possible_next_states N/A next_state_idx N/A 0 N/A next_x N/A next_state N/A self n_col N/A next_y N/A next_state N/A self n_col N/A next_state_type N/A N/A self desc N/A N/A next_x next_y N/A N/A next_state_type H N/A N/A done True N/A reward 0 N/A N/A N/A next_state_type N/A F S N/A N/A done False N/A reward 0 N/A N/A N/A next_state_type G N/A N/A done True N/A reward 1 N/A N/A NotImplementedError N/A N/A self state next_state N/A N/A Step observation N/A self state reward reward done done N/A get_possible_next_states N/A N/A self state action N/A N/A N/A 
        Given the state and action, return a list of possible next states and their probabilities. Only next states
        with nonzero probabilities will be returned
        :param state: start state
        :param action: action
        :return: a list of pairs (s', p(s'|s,a))
         N/A N/A N/A N/A self observation_space contains state N/A N/A N/A N/A self action_space contains action N/A x N/A state N/A self n_col N/A y N/A state N/A self n_col N/A coords N/A N/A np array N/A x y N/A increments N/A N/A np array N/A N/A 0 -1 N/A 1 0 N/A 0 1 N/A -1 0 N/A next_coords N/A N/A np clip N/A coords N/A increments N/A action N/A 0 0 N/A N/A N/A self n_row 1 N/A N/A self n_col 1 N/A next_state N/A N/A N/A next_coords N/A 0 N/A self n_col N/A next_coords N/A 1 N/A state_type N/A N/A self desc N/A N/A x y N/A next_state_type N/A N/A self desc N/A N/A N/A next_coords N/A 0 N/A next_coords N/A 1 N/A N/A N/A next_state_type W N/A state_type H N/A state_type G N/A N/A N/A N/A state 1.0 N/A N/A N/A N/A next_state 1.0 N/A action_space N/A N/A self N/A N/A N/A N/A Discrete 4 N/A property observation_space N/A N/A self N/A N/A N/A N/A Discrete N/A N/A self n_row N/A self n_col N/A property N/A