Module Expr Str Import alias Import alias ImportFrom alias ImportFrom alias alias alias ImportFrom alias ImportFrom alias ImportFrom alias Import alias identifier ImportFrom alias Assign NameStore Dict Str Str Str Str Call AttributeLoad NameLoad attr Str Num Num Num Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Str Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Str Num Num Num Num Num body Assign NameStore Dict Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign SubscriptStore NameLoad Index Str Num Assign SubscriptStore NameLoad Index Str Num Assign SubscriptStore NameLoad Index Str Num Assign NameStore NameLoad Assign NameStore Num Assign NameStore Call NameLoad Assign SubscriptStore NameLoad Index Str NameLoad Assign NameStore Call NameLoad NameLoad keyword NameLoad Assign NameStore Call NameLoad NameLoad NameLoad NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword BinOpSub Num NameLoad Assign NameStore Call NameLoad NameLoad keyword Num Assign SubscriptStore NameLoad Index Str Call NameLoad NameLoad NameLoad keyword NameLoad keyword AttributeLoad NameLoad attr keyword NameLoad keyword Str keyword NameLoad Assign NameStore Call NameLoad NameLoad Return NameLoad decorator_list If CompareEq NameLoad Str body Assign NameStore Call NameLoad Num Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr
N/A N/A 
Cart-pole balancing with iFDD+
 N/A sys N/A os rlpy.Domains InfCartPoleBalance rlpy.Agents Greedy_GQ SARSA Q_Learning rlpy.Representations * rlpy.Policies eGreedy rlpy.Experiments Experiment N/A numpy np hyperopt hp N/A param_space N/A discretization discover_threshold boyan_N0 initial_learn_rate N/A N/A hp quniform discretization 5 40 1 N/A N/A hp loguniform discover_threshold N/A N/A np log 0.01 N/A N/A np log 10.0 N/A N/A hp loguniform boyan_N0 N/A N/A np log 10.0 N/A N/A np log 100000.0 N/A N/A hp loguniform initial_learn_rate N/A N/A np log 0.001 N/A N/A np log 1 make_experiment N/A N/A exp_id path discover_threshold lambda_ boyan_N0 initial_learn_rate discretization N/A 1 ./Results/Temp/{domain}/{agent}/{representation}/ 0.03613232738 0.0 12335.665 0.037282 6.0 N/A N/A opt N/A N/A N/A opt N/A path path N/A N/A opt N/A exp_id exp_id N/A N/A opt N/A max_steps 50000 N/A N/A opt N/A num_policy_checks 20 N/A N/A opt N/A checks_per_policy 10 N/A sparsify True N/A kappa 1e-07 N/A domain N/A InfCartPoleBalance N/A N/A opt N/A domain domain N/A initial_rep N/A IndependentDiscretization domain discretization discretization N/A representation N/A iFDD domain discover_threshold initial_rep sparsify sparsify discretization discretization useCache True iFDDPlus N/A 1 kappa N/A policy N/A eGreedy representation epsilon 0.1 N/A N/A opt N/A agent N/A SARSA policy representation lambda_ lambda_ discount_factor N/A domain discount_factor initial_learn_rate initial_learn_rate learn_rate_decay_mode boyan boyan_N0 boyan_N0 N/A experiment N/A Experiment opt N/A experiment N/A N/A N/A __name__ __main__ N/A N/A experiment N/A make_experiment 1 N/A N/A N/A experiment run N/A N/A N/A experiment save