Module Import alias identifier Import alias Import alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias Import alias identifier ImportFrom alias ClassDef bases NameLoad NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Num Num Num AttributeLoad AttributeLoad NameLoad attr attr kwarg body Expr Str Expr Call AttributeLoad NameLoad attr NameLoad Call NameLoad Expr Call AttributeLoad Call NameLoad NameLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd BinOpMult AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Num Num Assign NameStore Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Str keyword BinOpAdd Num NameLoad Assign NameStore Call AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Str keyword BinOpAdd Num NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str keyword BinOpAdd Num NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad NameLoad attr Str keyword BinOpAdd Num NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore DictComp NameLoad Call AttributeLoad NameLoad attr NameLoad keyword BinOpAdd Num NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr comprehension NameStore AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore ListComp SubscriptLoad NameLoad Index NameLoad comprehension NameStore AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign NameStore AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore BinOpAdd NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad If NameLoad body Assign NameStore BinOpDiv UnaryOpUSub Call AttributeLoad NameLoad attr BinOpMult BinOpMult NameLoad Call AttributeLoad NameLoad attr BinOpSub BinOpDiv NameLoad NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad orelse Assign NameStore UnaryOpUSub Call AttributeLoad NameLoad attr BinOpMult NameLoad Call AttributeLoad NameLoad attr BinOpSub BinOpDiv NameLoad NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad AugAssignAdd NameStore BinOpDiv BinOpMult AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr ListComp Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad comprehension NameStore NameLoad Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad If NameLoad body Assign NameStore ListLoad NameLoad orelse Assign NameStore ListLoad Assign NameStore BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad ListLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Assign NameStore DictComp NameLoad Call AttributeLoad NameLoad attr BinOpMod Str NameLoad keyword BinOpAdd Num NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr comprehension NameStore AttributeLoad NameLoad attr Assign NameStore ListComp SubscriptLoad NameLoad Index NameLoad comprehension NameStore AttributeLoad NameLoad attr If NameLoad body Assign NameStore BinOpDiv Call AttributeLoad NameLoad attr BinOpMult Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad orelse Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad NameLoad keyword NameLoad If NameLoad body Assign NameStore BinOpAdd BinOpAdd BinOpMult NameLoad AttributeLoad NameLoad attr BinOpMult NameLoad Call AttributeLoad NameLoad attr BinOpDiv Call AttributeLoad NameLoad attr BinOpMult Call AttributeLoad NameLoad attr BinOpSub BinOpDiv NameLoad NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad BinOpMult NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad NameLoad orelse Assign NameStore BinOpAdd BinOpAdd BinOpMult NameLoad AttributeLoad NameLoad attr BinOpMult NameLoad Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr BinOpSub BinOpDiv NameLoad NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad NameLoad BinOpMult NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad NameLoad AugAssignAdd NameStore BinOpMult AttributeLoad NameLoad attr BinOpAdd Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr BinOpDiv Num NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword ListLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad ListLoad NameLoad NameLoad keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad ListLoad NameLoad NameLoad keyword NameLoad Assign AttributeStore NameLoad attr Call NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam defaults body Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Str Num Num Assign NameStore Call NameLoad SubscriptLoad NameLoad Index Str Assign NameStore BinOpDiv Call AttributeLoad Call AttributeLoad NameLoad attr NameLoad attr Num Num Num Return Call AttributeLoad NameLoad attr ListLoad NameLoad BinOpPow NameLoad Num NameLoad BinOpPow NameLoad Num BinOpPow NameLoad Num Call AttributeLoad NameLoad attr TupleLoad NameLoad Num keyword Num decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore ListComp SubscriptLoad NameLoad Index NameLoad comprehension NameStore AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore ListComp SubscriptLoad NameLoad Index NameLoad comprehension NameStore AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr If AttributeLoad AttributeLoad NameLoad attr attr body Assign NameStore ListLoad SubscriptLoad NameLoad Index Str orelse Assign NameStore ListLoad Assign NameStore ListLoad For NameStore SubscriptLoad NameLoad Index Str body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListLoad NameLoad Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index Num Expr Call AttributeLoad NameLoad attr BinOpSub SubscriptLoad NameLoad Slice Num SubscriptLoad NameLoad Slice Num If AttributeLoad AttributeLoad NameLoad attr attr body Assign NameStore Call NameLoad ListComp Call NameLoad SubscriptLoad NameLoad Index Str comprehension NameStore SubscriptLoad NameLoad Index Str Assign NameStore Call AttributeLoad NameLoad attr ListComp Call AttributeLoad NameLoad attr NameLoad NameLoad comprehension NameStore NameLoad orelse Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str FunctionDef arguments args NameParam defaults body Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore SubscriptLoad NameLoad Slice Num Assign NameStore Call NameLoad BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad ListLoad NameLoad NameLoad Return Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore SubscriptLoad NameLoad Slice Num Assign NameStore Call NameLoad BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad ListLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num Assign NameStore SubscriptLoad NameLoad Index Num Return Call AttributeLoad NameLoad attr ListLoad NameLoad NameLoad decorator_list Assign NameStore Call AttributeLoad NameLoad attr ListLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore ListComp TupleLoad UnaryOpUSub AttributeLoad NameLoad attr AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign SubscriptStore NameLoad Index Num TupleLoad Num AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore Call NameLoad NameLoad Assign TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword AttributeLoad NameLoad attr keyword Num Assign NameStore Call NameLoad NameLoad Assign AttributeStore NameLoad attr SubscriptLoad NameLoad Index Num Assign AttributeStore NameLoad attr SubscriptLoad NameLoad Slice Num Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr keyword NameLoad Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str Assign NameStore BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad ListLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad keyword NameLoad Assign NameStore Call NameLoad NameLoad Return Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam defaults body Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad keyword NameLoad Assign NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call NameLoad AttributeLoad NameLoad attr NameLoad Return Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list Assign NameStore Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr Str Assign TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad keyword NameLoad keyword Num keyword AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index Str Assign NameStore Call AttributeLoad Call NameLoad BinOpAdd BinOpAdd BinOpAdd ListLoad NameLoad NameLoad NameLoad NameLoad NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str NameLoad Expr Call AttributeLoad NameLoad attr Str NameLoad Expr Call AttributeLoad NameLoad attr Str NameLoad Expr Call AttributeLoad NameLoad attr Str NameLoad Expr Call AttributeLoad NameLoad attr Str NameLoad decorator_list NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Return Call NameLoad keyword NameLoad keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr decorator_list NameLoad decorator_list
N/A N/A theano.tensor TT N/A theano N/A scipy.optimize rllab.misc logger rllab.misc.overrides overrides rllab.misc ext rllab.algos.batch_polopt BatchPolopt rllab.core.serializable Serializable N/A numpy np rllab.misc tensor_utils REPS N/A BatchPolopt Serializable N/A N/A 
    Relative Entropy Policy Search (REPS)

    References
    ----------
    [1] J. Peters, K. Mulling, and Y. Altun, "Relative Entropy Policy Search," Artif. Intell., pp. 1607-1612, 2008.

     __init__ N/A N/A self epsilon L2_reg_dual L2_reg_loss max_opt_itr optimizer N/A 0.5 0.0 0.0 50 N/A N/A scipy optimize fmin_l_bfgs_b kwargs N/A N/A 

        :param epsilon: Max KL divergence between new policy and old policy.
        :param L2_reg_dual: Dual regularization
        :param L2_reg_loss: Loss regularization
        :param max_opt_itr: Maximum number of batch optimization iterations.
        :param optimizer: Module path to the optimizer. It must support the same interface as
        scipy.optimize.fmin_l_bfgs_b.
        :return:
         N/A N/A N/A Serializable quick_init self N/A locals N/A N/A N/A N/A super REPS self __init__ kwargs N/A N/A self epsilon epsilon N/A N/A self L2_reg_dual L2_reg_dual N/A N/A self L2_reg_loss L2_reg_loss N/A N/A self max_opt_itr max_opt_itr N/A N/A self optimizer optimizer N/A N/A self opt_info None N/A init_opt N/A N/A self N/A N/A N/A is_recurrent N/A int N/A N/A self policy recurrent N/A N/A self param_eta 15.0 N/A N/A self param_v N/A N/A N/A np random rand N/A N/A N/A N/A N/A self env observation_space flat_dim 2 4 N/A obs_var N/A N/A N/A N/A self env observation_space new_tensor_variable obs extra_dims N/A 1 is_recurrent N/A action_var N/A N/A N/A N/A self env action_space new_tensor_variable action extra_dims N/A 1 is_recurrent N/A rewards N/A N/A ext new_tensor rewards ndim N/A 1 is_recurrent dtype N/A N/A theano config floatX N/A feat_diff N/A N/A ext new_tensor feat_diff ndim N/A 2 is_recurrent dtype N/A N/A theano config floatX N/A param_v N/A N/A TT vector param_v N/A param_eta N/A N/A TT scalar eta N/A valid_var N/A N/A TT matrix valid N/A state_info_vars N/A k N/A N/A ext new_tensor k ndim N/A 2 is_recurrent dtype N/A N/A theano config floatX N/A k N/A N/A self policy state_info_keys N/A state_info_vars_list N/A N/A state_info_vars N/A k N/A k N/A N/A self policy state_info_keys N/A dist_info_vars N/A N/A N/A self policy dist_info_sym obs_var state_info_vars N/A dist N/A N/A self policy distribution N/A logli N/A N/A dist log_likelihood_sym action_var dist_info_vars N/A delta_v N/A rewards N/A N/A TT dot feat_diff param_v N/A is_recurrent N/A N/A loss N/A N/A N/A N/A TT sum N/A N/A logli N/A N/A TT exp N/A N/A delta_v param_eta N/A N/A TT max N/A delta_v param_eta valid_var N/A N/A TT sum valid_var N/A N/A loss N/A N/A N/A TT mean N/A logli N/A N/A TT exp N/A N/A delta_v param_eta N/A N/A TT max N/A delta_v param_eta N/A reg_params N/A N/A N/A self policy get_params regularizable True N/A loss N/A N/A N/A self L2_reg_loss N/A N/A TT sum N/A N/A N/A TT mean N/A N/A TT square param N/A param reg_params N/A len reg_params N/A loss_grad N/A N/A TT grad loss N/A N/A N/A self policy get_params trainable True N/A is_recurrent N/A N/A recurrent_vars N/A valid_var N/A N/A recurrent_vars N/A N/A input N/A N/A N/A N/A rewards obs_var feat_diff action_var state_info_vars_list recurrent_vars N/A param_eta param_v N/A f_loss N/A N/A ext compile_function inputs input outputs loss N/A f_loss_grad N/A N/A ext compile_function inputs input outputs loss_grad N/A old_dist_info_vars N/A k N/A N/A ext new_tensor N/A old_%s k ndim N/A 2 is_recurrent dtype N/A N/A theano config floatX N/A k N/A dist dist_info_keys N/A old_dist_info_vars_list N/A N/A old_dist_info_vars N/A k N/A k N/A dist dist_info_keys N/A is_recurrent N/A N/A mean_kl N/A N/A N/A TT sum N/A N/A N/A dist kl_sym old_dist_info_vars dist_info_vars valid_var N/A N/A TT sum valid_var N/A N/A mean_kl N/A N/A TT mean N/A N/A dist kl_sym old_dist_info_vars dist_info_vars N/A f_kl N/A N/A ext compile_function inputs N/A N/A N/A N/A obs_var action_var state_info_vars_list old_dist_info_vars_list recurrent_vars outputs mean_kl N/A is_recurrent N/A N/A dual N/A N/A N/A param_eta N/A self epsilon N/A param_eta N/A N/A TT log N/A N/A N/A TT sum N/A N/A N/A TT exp N/A N/A delta_v param_eta N/A N/A TT max N/A delta_v param_eta valid_var N/A N/A TT sum valid_var N/A param_eta N/A N/A TT max N/A delta_v param_eta N/A N/A dual N/A N/A N/A param_eta N/A self epsilon N/A param_eta N/A N/A TT log N/A N/A TT mean N/A N/A TT exp N/A N/A delta_v param_eta N/A N/A TT max N/A delta_v param_eta N/A param_eta N/A N/A TT max N/A delta_v param_eta N/A dual N/A N/A self L2_reg_dual N/A N/A N/A TT square param_eta N/A N/A TT square N/A 1 param_eta N/A dual_grad N/A N/A TT grad cost dual wrt N/A param_eta param_v N/A f_dual N/A N/A ext compile_function inputs N/A N/A N/A N/A rewards feat_diff state_info_vars_list recurrent_vars N/A param_eta param_v outputs dual N/A f_dual_grad N/A N/A ext compile_function inputs N/A N/A N/A N/A rewards feat_diff state_info_vars_list recurrent_vars N/A param_eta param_v outputs dual_grad N/A N/A self opt_info N/A dict f_loss_grad f_loss_grad f_loss f_loss f_dual f_dual f_dual_grad f_dual_grad f_kl f_kl N/A overrides _features N/A N/A self path N/A N/A N/A o N/A N/A np clip N/A path N/A observations -10 10 N/A l N/A len N/A path N/A rewards N/A al N/A N/A N/A N/A N/A np arange l reshape -1 1 100.0 N/A N/A N/A np concatenate N/A o N/A o 2 al N/A al 2 N/A al 3 N/A N/A np ones N/A l 1 axis 1 N/A optimize_policy N/A N/A self itr samples_data N/A N/A N/A rewards N/A samples_data N/A rewards N/A actions N/A samples_data N/A actions N/A observations N/A samples_data N/A observations N/A agent_infos N/A samples_data N/A agent_infos N/A state_info_list N/A N/A agent_infos N/A k N/A k N/A N/A self policy state_info_keys N/A dist_info_list N/A N/A agent_infos N/A k N/A k N/A N/A N/A self policy distribution dist_info_keys N/A N/A N/A self policy recurrent N/A N/A recurrent_vals N/A N/A samples_data N/A valids N/A N/A recurrent_vals N/A N/A feat_diff N/A N/A path N/A samples_data N/A paths N/A N/A feats N/A N/A self _features path N/A feats N/A N/A np vstack N/A feats N/A N/A np zeros N/A N/A feats shape N/A 1 N/A N/A N/A feat_diff append N/A N/A feats N/A 1 N/A feats N/A -1 N/A N/A N/A self policy recurrent N/A N/A max_path_length N/A max N/A N/A len N/A path N/A advantages N/A path N/A samples_data N/A paths N/A feat_diff N/A N/A np array N/A N/A N/A tensor_utils pad_tensor fd max_path_length N/A fd feat_diff N/A N/A feat_diff N/A N/A np vstack feat_diff N/A f_dual N/A N/A self opt_info N/A f_dual N/A f_dual_grad N/A N/A self opt_info N/A f_dual_grad eval_dual N/A N/A input N/A N/A N/A param_eta N/A input N/A 0 N/A param_v N/A input N/A 1 N/A val N/A f_dual N/A N/A N/A N/A rewards feat_diff state_info_list recurrent_vals N/A param_eta param_v N/A N/A N/A val astype N/A np float64 N/A eval_dual_grad N/A N/A input N/A N/A N/A param_eta N/A input N/A 0 N/A param_v N/A input N/A 1 N/A grad N/A f_dual_grad N/A N/A N/A N/A rewards feat_diff state_info_list recurrent_vals N/A param_eta param_v N/A eta_grad N/A N/A np float N/A grad N/A 0 N/A v_grad N/A grad N/A 1 N/A N/A N/A np hstack N/A eta_grad v_grad N/A N/A x0 N/A N/A np hstack N/A N/A self param_eta N/A self param_v N/A bounds N/A N/A N/A N/A np inf N/A np inf N/A _ x0 N/A N/A bounds N/A 0 N/A 0.0 N/A np inf N/A N/A N/A logger log optimizing dual N/A eta_before N/A x0 N/A 0 N/A dual_before N/A eval_dual x0 N/A N/A params_ast _ _ N/A N/A self optimizer func eval_dual x0 x0 fprime eval_dual_grad bounds bounds maxiter N/A self max_opt_itr disp 0 N/A dual_after N/A eval_dual params_ast N/A N/A self param_eta N/A params_ast N/A 0 N/A N/A self param_v N/A params_ast N/A 1 N/A cur_params N/A N/A N/A self policy get_param_values trainable True N/A f_loss N/A N/A self opt_info N/A f_loss N/A f_loss_grad N/A N/A self opt_info N/A f_loss_grad N/A input N/A N/A N/A N/A rewards observations feat_diff actions state_info_list recurrent_vals N/A N/A self param_eta N/A self param_v eval_loss N/A N/A params N/A N/A N/A N/A N/A N/A self policy set_param_values params trainable True N/A val N/A f_loss input N/A N/A N/A val astype N/A np float64 N/A eval_loss_grad N/A N/A params N/A N/A N/A N/A N/A N/A self policy set_param_values params trainable True N/A grad N/A f_loss_grad input N/A flattened_grad N/A N/A tensor_utils flatten_tensors N/A map N/A np asarray grad N/A N/A N/A flattened_grad astype N/A np float64 N/A N/A loss_before N/A eval_loss cur_params N/A N/A N/A logger log optimizing policy N/A N/A params_ast _ _ N/A N/A self optimizer func eval_loss x0 cur_params fprime eval_loss_grad disp 0 maxiter N/A self max_opt_itr N/A loss_after N/A eval_loss params_ast N/A f_kl N/A N/A self opt_info N/A f_kl N/A mean_kl N/A N/A N/A f_kl N/A N/A N/A N/A observations actions state_info_list dist_info_list recurrent_vals astype N/A np float64 N/A N/A N/A logger log N/A eta %f -> %f N/A eta_before N/A self param_eta N/A N/A N/A logger record_tabular LossBefore loss_before N/A N/A N/A logger record_tabular LossAfter loss_after N/A N/A N/A logger record_tabular DualBefore dual_before N/A N/A N/A logger record_tabular DualAfter dual_after N/A N/A N/A logger record_tabular MeanKL mean_kl N/A overrides get_itr_snapshot N/A N/A self itr samples_data N/A N/A N/A N/A dict itr itr policy N/A self policy baseline N/A self baseline env N/A self env N/A overrides N/A