Module Expr Str Import alias Import alias Import alias identifier ImportFrom alias alias alias Import alias Import alias identifier ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias identifier Import alias identifier ClassDef bases body Assign NameStore BinOpSub BinOpMult Num Num Num Assign NameStore Num Assign NameStore BinOpSub BinOpMult Num Num Num Assign NameStore Num Assign NameStore Num Assign NameStore Str Assign NameStore Str Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Str Assign NameStore Num Assign NameStore NameLoad decorator_list If CompareEq NameLoad Str body Expr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Assign NameStore Call NameLoad SubscriptLoad AttributeLoad NameLoad attr Slice Num NameLoad If AttributeLoad NameLoad attr body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Num orelse Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call NameLoad NameLoad Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad NameLoad NameLoad AttributeLoad NameLoad attr Call NameLoad GeneratorExp SubscriptLoad SubscriptLoad Call AttributeLoad NameLoad attr Index NameLoad Index Num comprehension NameStore Call NameLoad Call NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad Call NameLoad NameLoad keyword Str Assign NameStore BinOpAdd Str NameLoad Print Call AttributeLoad Str attr NameLoad Print Call AttributeLoad Str attr NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword Str keyword Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword Str keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword Str keyword Num keyword Str Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword ListLoad Num Num Num Num Num Num keyword Num keyword NameLoad keyword Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword ListLoad Num Num Num Num Num Num keyword Num keyword NameLoad keyword AttributeLoad NameLoad attr TryExcept body Expr Call AttributeLoad NameLoad attr Str handlers ExceptHandler type NameLoad body Pass Expr Call NameLoad Call NameLoad NameLoad BinOpAdd BinOpAdd Str NameLoad Str Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore BinOpAdd Str NameLoad Assign NameStore Call NameLoad BinOpAdd NameLoad Str Expr Call AttributeLoad NameLoad attr Call NameLoad Num BinOpAdd Call NameLoad SubscriptLoad NameLoad Index Str Num SubscriptLoad NameLoad Index Str keyword Str keyword Str Expr Call AttributeLoad NameLoad attr Call NameLoad Num BinOpAdd Call NameLoad SubscriptLoad NameLoad Index Str Num SubscriptLoad NameLoad Index Str keyword Str keyword Str Expr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr BinOpAdd NameLoad Str Expr Call AttributeLoad NameLoad attr
N/A N/A 2-Storage Microgrid launcher. See Wiki for more details about this experiment.

Authors: Vincent Francois-Lavet, David Taralla
 N/A sys N/A logging N/A numpy np joblib hash dump load N/A os N/A matplotlib.pyplot plt deer.default_parser process_args deer.agent NeuralAgent deer.q_networks.q_net_theano MyQNetwork MG_two_storages_env MyEnv MG_two_storages_env N/A deer.experiment.base_controllers bc Defaults N/A N/A N/A STEPS_PER_EPOCH N/A N/A 365 24 1 N/A EPOCHS 200 N/A STEPS_PER_TEST N/A N/A 365 24 1 N/A PERIOD_BTW_SUMMARY_PERFS -1 N/A FRAME_SKIP 1 N/A UPDATE_RULE deepmind_rmsprop N/A BATCH_ACCUMULATOR sum N/A LEARNING_RATE 0.0002 N/A LEARNING_RATE_DECAY 0.99 N/A DISCOUNT 0.9 N/A DISCOUNT_INC 0.99 N/A DISCOUNT_MAX 0.98 N/A RMS_DECAY 0.9 N/A RMS_EPSILON 0.0001 N/A MOMENTUM 0 N/A CLIP_DELTA 1.0 N/A EPSILON_START 1.0 N/A EPSILON_MIN 0.3 N/A EPSILON_DECAY 500000 N/A UPDATE_FREQUENCY 1 N/A REPLAY_MEMORY_SIZE 1000000 N/A BATCH_SIZE 32 N/A NETWORK_TYPE General_DQN_0 N/A FREEZE_INTERVAL 1000 N/A DETERMINISTIC True N/A N/A N/A __name__ __main__ N/A N/A N/A N/A logging basicConfig level N/A logging INFO N/A parameters N/A process_args N/A N/A sys argv N/A 1 Defaults N/A N/A parameters deterministic N/A N/A rng N/A N/A N/A np random RandomState 123456 N/A N/A rng N/A N/A N/A np random RandomState N/A env N/A MG_two_storages_env rng N/A qnetwork N/A MyQNetwork env N/A parameters rms_decay N/A parameters rms_epsilon N/A parameters momentum N/A parameters clip_delta N/A parameters freeze_interval N/A parameters batch_size N/A parameters network_type N/A parameters update_rule N/A parameters batch_accumulator rng N/A agent N/A NeuralAgent env qnetwork N/A parameters replay_memory_size N/A max N/A N/A N/A N/A N/A env inputDimensions N/A i N/A 0 N/A i N/A range N/A len N/A N/A env inputDimensions N/A parameters batch_size rng N/A h N/A hash N/A vars parameters hash_name sha1 N/A fname N/A MG2S_ h N/A N/A N/A The parameters hash is: {} format h N/A N/A N/A The parameters are: {} format parameters N/A N/A N/A agent attach N/A N/A bc VerboseController evaluateOn epoch periodicity 1 N/A N/A N/A agent attach N/A N/A bc TrainerController evaluateOn action periodicity N/A parameters update_frequency showEpisodeAvgVValue True showAvgBellmanResidual True N/A N/A N/A agent attach N/A N/A bc LearningRateController initialLearningRate N/A parameters learning_rate learningRateDecay N/A parameters learning_rate_decay periodicity 1 N/A N/A N/A agent attach N/A N/A bc DiscountFactorController initialDiscountFactor N/A parameters discount discountFactorGrowth N/A parameters discount_inc discountFactorMax N/A parameters discount_max periodicity 1 N/A N/A N/A agent attach N/A N/A bc EpsilonController initialE N/A parameters epsilon_start eDecays N/A parameters epsilon_decay eMin N/A parameters epsilon_min evaluateOn action periodicity 1 resetEvery none N/A N/A N/A agent attach N/A N/A bc FindBestController validationID N/A MG_two_storages_env VALIDATION_MODE testID N/A MG_two_storages_env TEST_MODE unique_fname fname N/A N/A N/A agent attach N/A N/A bc InterleavedTestEpochController id N/A MG_two_storages_env VALIDATION_MODE epochLength N/A parameters steps_per_test controllersToDisable N/A 0 1 2 3 4 7 periodicity 2 showScore True summarizeEvery -1 N/A N/A N/A agent attach N/A N/A bc InterleavedTestEpochController id N/A MG_two_storages_env TEST_MODE epochLength N/A parameters steps_per_test controllersToDisable N/A 0 1 2 3 4 6 periodicity 2 showScore True summarizeEvery N/A parameters period_btw_summary_perfs N/A N/A N/A N/A N/A os mkdir params N/A N/A N/A Exception N/A N/A N/A N/A dump N/A vars parameters N/A N/A params/ fname .jldump N/A N/A N/A agent run N/A parameters epochs N/A parameters steps_per_epoch N/A basename N/A scores/ fname N/A scores N/A load N/A basename _scores.jldump N/A N/A N/A plt plot N/A range 1 N/A N/A len N/A scores N/A vs 1 N/A scores N/A vs label VS color b N/A N/A N/A plt plot N/A range 1 N/A N/A len N/A scores N/A ts 1 N/A scores N/A ts label TS color r N/A N/A N/A plt legend N/A N/A N/A plt xlabel Number of epochs N/A N/A N/A plt ylabel Score N/A N/A N/A plt savefig N/A basename _scores.pdf N/A N/A N/A plt show