Module Expr Str Import alias Import alias Import alias identifier ImportFrom alias alias alias Import alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias identifier Import alias identifier ClassDef bases body Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Str Assign NameStore Str Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Str Assign NameStore Num Assign NameStore NameLoad decorator_list If CompareEq NameLoad Str body Expr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Assign NameStore Call NameLoad SubscriptLoad AttributeLoad NameLoad attr Slice Num NameLoad If AttributeLoad NameLoad attr body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Num orelse Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call NameLoad NameLoad keyword AttributeLoad NameLoad attr keyword ListLoad Dict Str Str Str Call AttributeLoad NameLoad attr Num Dict Str Str Str NameLoad Dict Str Str Str Num Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Call NameLoad GeneratorExp SubscriptLoad SubscriptLoad Call AttributeLoad NameLoad attr Index NameLoad Index Num comprehension NameStore Call NameLoad Call NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad Call NameLoad NameLoad keyword Str Assign NameStore BinOpAdd Str NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword Str keyword Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword Str keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword Str keyword Num keyword Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword ListLoad Num Num Num Num Num keyword Num keyword NameLoad keyword Num TryExcept body Expr Call AttributeLoad NameLoad attr Str handlers ExceptHandler type NameLoad body Pass Expr Call NameLoad Call NameLoad NameLoad BinOpAdd BinOpAdd Str NameLoad Str Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore BinOpAdd Str NameLoad Assign NameStore Call NameLoad BinOpAdd NameLoad Str Expr Call AttributeLoad NameLoad attr Call NameLoad Num BinOpAdd Call NameLoad SubscriptLoad NameLoad Index Str Num SubscriptLoad NameLoad Index Str keyword Str keyword Str Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr BinOpAdd NameLoad Str Expr Call AttributeLoad NameLoad attr
N/A N/A ALE launcher. See Wiki for more details about this experiment.

Authors: Vincent Francois-Lavet, David Taralla
 N/A sys N/A logging N/A numpy np joblib hash dump load N/A os deer.default_parser process_args deer.agent_ale ALEAgent deer.q_networks.q_net_theano MyQNetwork ALE_env MyEnv ALE_env N/A deer.experiment.base_controllers bc Defaults N/A N/A N/A STEPS_PER_EPOCH 250000 N/A EPOCHS 40 N/A STEPS_PER_TEST 125000 N/A PERIOD_BTW_SUMMARY_PERFS 1 N/A FRAME_SKIP 4 N/A UPDATE_RULE deepmind_rmsprop N/A BATCH_ACCUMULATOR sum N/A LEARNING_RATE 0.0005 N/A LEARNING_RATE_DECAY 0.99 N/A DISCOUNT 0.95 N/A DISCOUNT_INC 0.99 N/A DISCOUNT_MAX 0.99 N/A RMS_DECAY 0.9 N/A RMS_EPSILON 0.0001 N/A MOMENTUM 0 N/A CLIP_DELTA 1.0 N/A EPSILON_START 1.0 N/A EPSILON_MIN 0.1 N/A EPSILON_DECAY 100000 N/A UPDATE_FREQUENCY 1 N/A REPLAY_MEMORY_SIZE 1000000 N/A BATCH_SIZE 32 N/A NETWORK_TYPE General_DQN_0 N/A FREEZE_INTERVAL 10000 N/A DETERMINISTIC True N/A N/A N/A __name__ __main__ N/A N/A N/A N/A logging basicConfig level N/A logging INFO N/A parameters N/A process_args N/A N/A sys argv N/A 1 Defaults N/A N/A parameters deterministic N/A N/A rng N/A N/A N/A np random RandomState 123456 N/A N/A rng N/A N/A N/A np random RandomState N/A env N/A ALE_env rng frame_skip N/A parameters frame_skip ale_options N/A N/A key value random_seed N/A N/A rng randint 9999 N/A key value color_averaging True N/A key value repeat_action_probability 0.0 N/A qnetwork N/A MyQNetwork env N/A parameters rms_decay N/A parameters rms_epsilon N/A parameters momentum N/A parameters clip_delta N/A parameters freeze_interval N/A parameters batch_size N/A parameters network_type N/A parameters update_rule N/A parameters batch_accumulator rng N/A agent N/A ALEAgent env qnetwork N/A parameters replay_memory_size N/A max N/A N/A N/A N/A N/A env inputDimensions N/A i N/A 0 N/A i N/A range N/A len N/A N/A env inputDimensions N/A parameters batch_size rng N/A h N/A hash N/A vars parameters hash_name sha1 N/A fname N/A ALE_ h N/A N/A N/A The parameters hash is: {} format h N/A N/A N/A The parameters are: {} format parameters N/A N/A N/A agent attach N/A N/A bc VerboseController evaluateOn epoch periodicity 1 N/A N/A N/A agent attach N/A N/A bc TrainerController evaluateOn action periodicity N/A parameters update_frequency showEpisodeAvgVValue True showAvgBellmanResidual True N/A N/A N/A agent attach N/A N/A bc LearningRateController initialLearningRate N/A parameters learning_rate learningRateDecay N/A parameters learning_rate_decay periodicity 1 N/A N/A N/A agent attach N/A N/A bc DiscountFactorController initialDiscountFactor N/A parameters discount discountFactorGrowth N/A parameters discount_inc discountFactorMax N/A parameters discount_max periodicity 1 N/A N/A N/A agent attach N/A N/A bc EpsilonController initialE N/A parameters epsilon_start eDecays N/A parameters epsilon_decay eMin N/A parameters epsilon_min evaluateOn action periodicity 1 resetEvery none N/A N/A N/A agent attach N/A N/A bc FindBestController validationID N/A ALE_env VALIDATION_MODE testID None unique_fname fname N/A N/A N/A agent attach N/A N/A bc InterleavedTestEpochController id N/A ALE_env VALIDATION_MODE epochLength N/A parameters steps_per_test controllersToDisable N/A 0 1 2 3 4 periodicity 2 showScore True summarizeEvery 1 N/A N/A N/A N/A N/A os mkdir params N/A N/A N/A Exception N/A N/A N/A N/A dump N/A vars parameters N/A N/A params/ fname .jldump N/A N/A N/A agent run N/A parameters epochs N/A parameters steps_per_epoch N/A basename N/A scores/ fname N/A scores N/A load N/A basename _scores.jldump N/A N/A N/A plt plot N/A range 1 N/A N/A len N/A scores N/A vs 1 N/A scores N/A vs label VS color b N/A N/A N/A plt legend N/A N/A N/A plt xlabel Number of epochs N/A N/A N/A plt ylabel Score N/A N/A N/A plt savefig N/A basename _scores.pdf N/A N/A N/A plt show