Module ImportFrom alias Import alias identifier Import alias identifier Import alias identifier Import alias Import alias Import alias FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Import alias Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore SubscriptLoad AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr Index Num Assign NameStore SubscriptLoad AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr attr Index Num Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr ListLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr ListLoad NameLoad NameLoad Assign NameStore NameLoad Assign NameStore Num Assign NameStore NameLoad Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore NameLoad Assign NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr ListLoad NameLoad NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr ListLoad NameLoad NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr ListLoad NameLoad NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Num Call AttributeLoad NameLoad attr NameLoad Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr Print Str Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Num Assign NameStore ListLoad Assign NameStore ListLoad For NameStore Call NameLoad NameLoad body Assign NameStore Call NameLoad BinOpDiv Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad For NameStore Call NameLoad NameLoad body Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad keyword Dict NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad AugAssignAdd NameStore BinOpDiv Call AttributeLoad NameLoad attr NameLoad keyword Dict NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Dict NameLoad NameLoad NameLoad NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr Num Num Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Dict NameLoad NameLoad NameLoad NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr Call AttributeLoad AttributeLoad NameLoad attr attr Num Num Expr Call AttributeLoad NameLoad attr NameLoad Print Call AttributeLoad Str attr NameLoad NameLoad NameLoad Return Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr NameLoad decorator_list If CompareEq NameLoad Str body Assign NameStore ListLoad Assign NameStore ListLoad Num Num Num Num Num Num Num Assign NameStore ListLoad Num Num Num Num Assign NameStore ListLoad Num Num Num Num Assign NameStore ListLoad Num Num Num Num Assign NameStore Call NameLoad Num Num Num Num Print NameLoad Expr Call NameLoad Assign NameStore Num For NameStore NameLoad body For NameStore NameLoad body For NameStore NameLoad body For NameStore NameLoad body AugAssignAdd NameStore Num Assign NameStore Call NameLoad NameLoad NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Print Call AttributeLoad Str attr NameLoad NameLoad NameLoad NameLoad Print TupleLoad NameLoad NameLoad Print Str Print NameLoad
N/A __future__ division N/A matplotlib.pyplot plt N/A tensorflow tf N/A numpy np N/A heapq N/A pylab N/A time testNetwork N/A N/A num_hidden_units decay retain_input retain_hidden N/A N/A N/A input_data N/A datasets N/A N/A input_data read_data_sets N/A NUM_PIXELS N/A N/A N/A N/A N/A datasets train_set inputs shape N/A 1 N/A NUM_CLASSES N/A N/A N/A N/A N/A datasets train_set targets shape N/A 1 N/A x N/A N/A tf placeholder N/A tf float32 N/A None NUM_PIXELS N/A y N/A N/A tf placeholder N/A tf float32 N/A None NUM_CLASSES N/A NUM_HIDDEN_UNITS num_hidden_units N/A LEARNING_RATE 0.005 N/A DECAY decay N/A MOMENTUM 0.1 N/A EPOCHS 3000 N/A BATCH_SIZE 100 N/A RETAIN_INPUT retain_input N/A RETAIN_HIDDEN retain_hidden N/A hidden_layer_1_weights N/A N/A tf Variable N/A N/A tf random_normal N/A NUM_PIXELS NUM_HIDDEN_UNITS stddev 0.01 N/A hidden_layer_2_weights N/A N/A tf Variable N/A N/A tf random_normal N/A NUM_HIDDEN_UNITS NUM_HIDDEN_UNITS stddev 0.01 N/A output_layer_weights N/A N/A tf Variable N/A N/A tf random_normal N/A NUM_HIDDEN_UNITS NUM_CLASSES stddev 0.01 N/A p_retain_input N/A N/A tf placeholder N/A tf float32 N/A p_retain_hidden N/A N/A tf placeholder N/A tf float32 N/A x N/A N/A N/A tf nn dropout x p_retain_input N/A hidden_layer_1 N/A N/A N/A tf nn relu N/A N/A tf matmul x hidden_layer_1_weights N/A hidden_layer_1 N/A N/A N/A tf nn dropout hidden_layer_1 p_retain_hidden N/A hidden_layer_2 N/A N/A N/A tf nn softmax N/A N/A tf matmul hidden_layer_1 hidden_layer_2_weights N/A hidden_layer_2 N/A N/A N/A tf nn dropout hidden_layer_2 p_retain_hidden N/A model N/A N/A tf matmul hidden_layer_2 output_layer_weights N/A cost N/A N/A tf reduce_mean N/A N/A N/A tf nn softmax_cross_entropy_with_logits model y N/A optimizer N/A N/A N/A N/A N/A tf train RMSPropOptimizer LEARNING_RATE DECAY minimize cost N/A correct_prediction N/A N/A tf equal N/A N/A tf argmax model 1 N/A N/A tf argmax y 1 N/A accuracy N/A N/A tf reduce_mean N/A N/A tf cast correct_prediction N/A tf float32 N/A Starting session N/A sess N/A N/A tf Session N/A init N/A N/A tf initialize_all_variables N/A N/A N/A sess run init N/A avg_cost 0.0 N/A train_accuracies N/A N/A validation_accuracies N/A N/A epoch N/A range EPOCHS N/A N/A num_batches N/A int N/A N/A N/A N/A datasets train_set num_examples BATCH_SIZE N/A batch N/A range num_batches N/A N/A N/A batch_xs batch_ys N/A N/A N/A datasets train_set next_batch BATCH_SIZE N/A N/A N/A sess run optimizer feed_dict N/A x y p_retain_input p_retain_hidden batch_xs batch_ys RETAIN_INPUT RETAIN_HIDDEN N/A avg_cost N/A N/A N/A sess run cost feed_dict N/A x y p_retain_input p_retain_hidden batch_xs batch_ys RETAIN_INPUT RETAIN_HIDDEN num_batches N/A train_accuracy N/A N/A sess run accuracy feed_dict N/A x y p_retain_input p_retain_hidden N/A N/A N/A datasets train_set inputs N/A N/A N/A datasets train_set targets 1 1 N/A N/A N/A train_accuracies append train_accuracy N/A validation_accuracy N/A N/A sess run accuracy feed_dict N/A x y p_retain_input p_retain_hidden N/A N/A N/A datasets validation_set inputs N/A N/A N/A datasets validation_set targets 1 1 N/A N/A N/A validation_accuracies append validation_accuracy N/A N/A N/A Epoch: {} 	 Train accuracy: {} 	 Validation accuracy: {} format epoch train_accuracy validation_accuracy N/A N/A N/A heapq nlargest 3 N/A N/A np array validation_accuracies N/A N/A N/A __name__ __main__ N/A N/A top_3_validation_accuracies N/A N/A num_hidden_units_intervals N/A 5 10 25 50 100 200 400 N/A decay_intervals N/A 0.9 0.6 0.3 0.1 N/A retain_input_intervals N/A 0.9 0.6 0.3 0.1 N/A retain_hidden_intervals N/A 0.9 0.6 0.3 0.1 N/A accuracies N/A testNetwork 100 0.4 0.3 0.3 N/A accuracies N/A N/A exit N/A iteration 0 N/A num_hidden_units num_hidden_units_intervals N/A N/A decay decay_intervals N/A N/A retain_input retain_input_intervals N/A N/A retain_hidden retain_hidden_intervals N/A N/A iteration 1 N/A accuracies N/A testNetwork num_hidden_units decay retain_input retain_hidden N/A N/A N/A top_3_validation_accuracies append accuracies N/A N/A N/A hidden units: {} 	 decay: {} 	 retain input: {} 	 retain hidden: {} format num_hidden_units decay retain_input retain_hidden N/A N/A iteration accuracies N/A THESE ARE THE FINAL ACCURACIES N/A accuracies