Module Expr Str ImportFrom alias ImportFrom alias alias ImportFrom alias ImportFrom alias ImportFrom alias Import alias identifier ImportFrom alias Assign NameStore Dict Str Str Str Str Str Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num Num Call AttributeLoad NameLoad attr Str Num Num Num Call AttributeLoad NameLoad attr Str Num Num Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Str Num Num Num Num Num body Assign NameStore Dict Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Num Assign SubscriptStore NameLoad Index Str Num Assign SubscriptStore NameLoad Index Str Num Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign NameStore Call NameLoad NameLoad keyword Call NameLoad NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad Assign NameStore Call NameLoad NameLoad keyword Num Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad NameLoad keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad keyword Str keyword NameLoad Assign NameStore Call NameLoad NameLoad Return NameLoad decorator_list If CompareEq NameLoad Str body ImportFrom alias Assign NameStore Call NameLoad Num Expr Call AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad NameLoad attr
N/A N/A 
Cart-pole balancing with independent discretization
 rlpy.Domains HIVTreatment rlpy.Agents SARSA Q_LEARNING rlpy.Representations * rlpy.Policies eGreedy rlpy.Experiments Experiment N/A numpy np hyperopt hp N/A param_space N/A num_rbfs resolution lambda_ boyan_N0 initial_learn_rate N/A N/A hp qloguniform num_rbfs N/A N/A np log 10.0 N/A N/A np log 10000.0 1 N/A N/A hp quniform resolution 3 30 1 N/A N/A hp uniform lambda_ 0.0 1.0 N/A N/A hp loguniform boyan_N0 N/A N/A np log 10.0 N/A N/A np log 100000.0 N/A N/A hp loguniform initial_learn_rate N/A N/A np log 0.05 N/A N/A np log 1 make_experiment N/A N/A exp_id path boyan_N0 lambda_ initial_learn_rate resolution num_rbfs N/A 1 ./Results/Temp/{domain}/{agent}/{representation}/ 136 0.0985 0.090564 13.0 9019 N/A N/A opt N/A N/A N/A opt N/A path path N/A N/A opt N/A exp_id exp_id N/A N/A opt N/A max_steps 150000 N/A N/A opt N/A num_policy_checks 30 N/A N/A opt N/A checks_per_policy 1 N/A domain N/A HIVTreatment N/A N/A opt N/A domain domain N/A representation N/A RBF domain num_rbfs N/A int num_rbfs resolution_max resolution resolution_min resolution const_feature False normalize True seed exp_id N/A policy N/A eGreedy representation epsilon 0.1 N/A N/A opt N/A agent N/A Q_LEARNING policy representation discount_factor N/A domain discount_factor lambda_ lambda_ initial_learn_rate initial_learn_rate learn_rate_decay_mode boyan boyan_N0 boyan_N0 N/A experiment N/A Experiment opt N/A experiment N/A N/A N/A __name__ __main__ N/A rlpy.Tools.run run_profiled N/A experiment N/A make_experiment 1 N/A N/A N/A experiment run visualize_learning True N/A N/A N/A experiment plot