Module Expr Str Import alias identifier ImportFrom alias identifier ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Assign AttributeStore NameLoad attr BinOpPow Num Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr BinOpMult Num AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Str Assign AttributeStore NameLoad attr Str Print Str AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr BinOpAdd AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr TupleLoad AttributeLoad NameLoad attr Num Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad Call AttributeLoad NameLoad attr attr AugAssignAdd AttributeStore NameLoad attr Num Assign NameStore BinOpSub SubscriptLoad AttributeLoad NameLoad attr Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num Assign NameStore BinOpAdd SubscriptLoad AttributeLoad NameLoad attr Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num Assign AttributeStore NameLoad attr BinOpAdd AttributeLoad NameLoad attr NameLoad If CompareLt Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr BinOpMult AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr AugAssignSub AttributeStore NameLoad attr BinOpMult AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign SubscriptStore NameLoad Index AttributeLoad NameLoad attr Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr TupleLoad NameLoad NameLoad Assign NameStore UnaryOpUSub AttributeLoad NameLoad attr If CompareEq AttributeLoad NameLoad attr Num body Assign NameStore AttributeLoad NameLoad attr AugAssignSub NameStore BinOpMult NameLoad AttributeLoad NameLoad attr Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Pass decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str If AttributeLoad NameLoad attr body Assign NameStore BinOpMult ListLoad Str BinOpAdd BinOpAdd AttributeLoad NameLoad attr AttributeLoad NameLoad attr Num Assign SubscriptStore NameLoad Index AttributeLoad NameLoad attr Str Assign SubscriptStore NameLoad Slice AttributeLoad NameLoad attr BinOpAdd AttributeLoad NameLoad attr Num Str Assign NameStore SubscriptLoad Call AttributeLoad NameLoad attr CompareGt AttributeLoad NameLoad attr Num Index Num If CompareGt AttributeLoad NameLoad attr Num body Assign SubscriptStore NameLoad Index BinOpAdd BinOpAdd AttributeLoad NameLoad attr Num SubscriptLoad NameLoad Index Num Str Print Call AttributeLoad Str attr NameLoad If CompareEq BinOpMod AttributeLoad NameLoad attr AttributeLoad NameLoad attr Num body Print BinOpMod Str AttributeLoad NameLoad attr decorator_list decorator_list
N/A N/A 
One-dimensional grid task with noise

In this task, the agent has the challenge of discriminating between
actual informative state sensors, and a comparatively large number
of sensors that are pure noise distractors. Many learning methods
make the implicit assumption that all sensors are informative.
This task is intended to break them.
 N/A numpy np base_world World BaseWorld World N/A BaseWorld N/A N/A  
    One-dimensional grid world with noise
    
    In this world, the agent steps forward and backward 
    along three positions on a line. The second position is rewarded 
    and the first and third positions are punished. Also, any actions 
    are penalized somewhat. It also includes some inputs that are pure noise. 
    Optimal performance is a reward of between 90 per time step.
     __init__ N/A N/A self lifespan N/A None N/A N/A  Set up the world  N/A N/A N/A BaseWorld __init__ self lifespan N/A N/A self VISUALIZE_PERIOD N/A 10 4 N/A N/A self REWARD_MAGNITUDE 100.0 N/A N/A self ENERGY_COST N/A 0.01 N/A self REWARD_MAGNITUDE N/A N/A self JUMP_FRACTION 0.1 N/A N/A self display_state True N/A N/A self name grid_1D_noise N/A N/A self name_long noisy one dimensional grid world N/A Entering N/A self name_long N/A N/A self num_real_sensors 3 N/A N/A self num_noise_sensors 15 N/A N/A self num_sensors N/A N/A self num_noise_sensors N/A self num_real_sensors N/A N/A self num_actions 3 N/A N/A self action N/A N/A np zeros N/A N/A self num_actions 1 N/A N/A self world_state 0 N/A N/A self simple_state 0 N/A step N/A N/A self action N/A N/A N/A  Take one time step through the world  N/A N/A self action N/A N/A N/A N/A action copy ravel N/A N/A self timestep 1 N/A step_size N/A N/A N/A self action N/A 0 N/A N/A self action N/A 1 N/A energy N/A N/A N/A self action N/A 0 N/A N/A self action N/A 1 N/A N/A self world_state N/A N/A self world_state step_size N/A N/A N/A N/A N/A np random random_sample N/A self JUMP_FRACTION N/A N/A N/A self world_state N/A N/A self num_real_sensors N/A N/A N/A np random random_sample N/A N/A self world_state N/A N/A self num_real_sensors N/A N/A np floor_divide N/A self world_state N/A self num_real_sensors N/A N/A self simple_state N/A int N/A N/A np floor N/A self world_state N/A real_sensors N/A N/A np zeros N/A self num_real_sensors N/A N/A real_sensors N/A N/A self simple_state 1 N/A noise_sensors N/A N/A np round N/A N/A N/A np random random_sample N/A self num_noise_sensors N/A sensors N/A N/A np hstack N/A real_sensors noise_sensors N/A reward N/A N/A self REWARD_MAGNITUDE N/A N/A N/A self simple_state 1 N/A N/A reward N/A self REWARD_MAGNITUDE N/A reward N/A energy N/A self ENERGY_COST N/A N/A sensors reward N/A set_agent_parameters N/A N/A self agent N/A N/A N/A  Make some adjustements, as necessary, to the agent  N/A N/A visualize N/A N/A self agent N/A N/A N/A  Show what's going on in the world  N/A N/A self display_state N/A N/A state_image N/A N/A . N/A N/A N/A self num_real_sensors N/A self num_actions 2 N/A N/A state_image N/A N/A self simple_state O N/A N/A state_image N/A N/A self num_real_sensors N/A N/A self num_real_sensors 2 || N/A action_index N/A N/A N/A np where N/A N/A self action 0.1 N/A 0 N/A N/A N/A action_index size 0 N/A N/A N/A state_image N/A N/A N/A N/A self num_real_sensors 2 N/A action_index N/A 0 x N/A N/A N/A join state_image N/A N/A N/A N/A self timestep N/A self VISUALIZE_PERIOD 0 N/A N/A N/A world age is %s timesteps  N/A self timestep N/A N/A