Module Expr Str ImportFrom alias alias Import alias Import alias Import alias identifier Import alias identifier Assign NameStore Num Assign NameStore Num Print Str Assign TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr Assign NameStore ListComp TupleLoad NameLoad NameLoad comprehension TupleStore NameStore NameStore SubscriptLoad NameLoad Slice Num NameLoad Assign NameStore ListComp TupleLoad NameLoad NameLoad comprehension TupleStore NameStore NameStore SubscriptLoad NameLoad Slice Num BinOpAdd Num NameLoad Assign NameStore ListComp NameLoad comprehension TupleStore NameStore NameStore SubscriptLoad NameLoad Slice Num BinOpAdd Num NameLoad Assign NameStore ListComp NameLoad comprehension TupleStore NameStore NameStore SubscriptLoad NameLoad Slice Num BinOpAdd Num NameLoad Print Str Assign NameStore Call NameLoad ListLoad Num NameLoad Num Expr Call AttributeLoad NameLoad attr NameLoad Num Num Num Num Print Str Assign NameStore Call NameLoad ListLoad Num NameLoad Num Expr Call AttributeLoad NameLoad attr NameLoad Num Num Num Num Print Str Assign NameStore ListComp Call NameLoad BinOpAdd Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index Num NameLoad SubscriptLoad AttributeLoad NameLoad attr Index Num comprehension NameStore NameLoad Assign NameStore ListComp Call NameLoad BinOpAdd Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index Num NameLoad SubscriptLoad AttributeLoad NameLoad attr Index Num comprehension NameStore NameLoad Assign NameStore Call NameLoad NameLoad NameLoad Print Str Assign NameStore Call NameLoad ListLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Num Num Num Num Print Str Print Str Assign NameStore ListComp Call NameLoad BinOpAdd Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index Num NameLoad SubscriptLoad AttributeLoad NameLoad attr Index Num comprehension NameStore NameLoad Assign NameStore ListComp Call NameLoad BinOpAdd Call AttributeLoad NameLoad attr SubscriptLoad AttributeLoad NameLoad attr Index Num NameLoad SubscriptLoad AttributeLoad NameLoad attr Index Num comprehension NameStore NameLoad Assign NameStore Call NameLoad NameLoad NameLoad Assign NameStore Call NameLoad ListLoad NameLoad Num NameLoad Assign SubscriptStore AttributeLoad NameLoad attr Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num Assign SubscriptStore AttributeLoad NameLoad attr Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num Assign SubscriptStore AttributeLoad NameLoad attr Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num Assign SubscriptStore AttributeLoad NameLoad attr Index Num SubscriptLoad AttributeLoad NameLoad attr Index Num Assign NameStore Call NameLoad GeneratorExp Call AttributeLoad AttributeLoad NameLoad attr attr BinOpSub Call AttributeLoad NameLoad attr NameLoad NameLoad Num comprehension TupleStore NameStore NameStore NameLoad Print BinOpMod Str TupleLoad BinOpDiv NameLoad NameLoad Print Str Print BinOpMod Str TupleLoad BinOpDiv Call NameLoad GeneratorExp Call AttributeLoad NameLoad attr comprehension TupleStore NameStore NameStore NameLoad NameLoad Assign NameStore Call NameLoad GeneratorExp Call AttributeLoad AttributeLoad NameLoad attr attr BinOpSub Call AttributeLoad NameLoad attr NameLoad NameLoad Num comprehension TupleStore NameStore NameStore NameLoad Print BinOpMod Str TupleLoad BinOpDiv NameLoad NameLoad Print Str Assign NameStore ListComp BinOpDiv Call AttributeLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num ExtSlice Index NameLoad Slice attr Num Num Call AttributeLoad AttributeLoad NameLoad attr attr SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num ExtSlice Index NameLoad Slice comprehension NameStore Call NameLoad NameLoad Assign NameStore ListComp BinOpDiv Call AttributeLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num ExtSlice Index NameLoad Slice attr Num Num Call AttributeLoad AttributeLoad NameLoad attr attr SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num ExtSlice Index NameLoad Slice comprehension NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListLoad Call AttributeLoad NameLoad attr NameLoad keyword Num Call AttributeLoad NameLoad attr NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Num Expr Call AttributeLoad NameLoad attr NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr ListLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr ListLoad Expr Call AttributeLoad NameLoad attr
N/A N/A 
common_knowledge
~~~~~~~~~~~~~~~~

Try to determine whether or not it's possible to relate the
descriptions given by two different autoencoders.

 backprop2 Network sigmoid_vec N/A mnist_loader N/A matplotlib N/A matplotlib.pyplot plt N/A numpy np N/A SIZE 5000 N/A HIDDEN 30 N/A 
Generating training data N/A N/A training_data _ _ N/A N/A mnist_loader load_data_nn N/A td_1 N/A N/A x x N/A N/A x _ N/A training_data N/A 0 SIZE N/A td_2 N/A N/A x x N/A N/A x _ N/A training_data N/A 12500 N/A 12500 SIZE N/A td_3 N/A x N/A N/A x _ N/A training_data N/A 25000 N/A 25000 SIZE N/A test N/A x N/A N/A x _ N/A training_data N/A 37500 N/A 37500 SIZE N/A 
Finding first autoencoder N/A ae_1 N/A Network N/A 784 HIDDEN 784 N/A N/A N/A ae_1 SGD td_1 4 10 0.01 0.05 N/A 
Finding second autoencoder N/A ae_2 N/A Network N/A 784 HIDDEN 784 N/A N/A N/A ae_2 SGD td_1 4 10 0.01 0.05 N/A 
Generating encoded training data N/A encoded_td_1 N/A N/A sigmoid_vec N/A N/A N/A np dot N/A N/A ae_1 weights N/A 0 x N/A N/A ae_1 biases N/A 0 N/A x td_3 N/A encoded_td_2 N/A N/A sigmoid_vec N/A N/A N/A np dot N/A N/A ae_2 weights N/A 0 x N/A N/A ae_2 biases N/A 0 N/A x td_3 N/A encoded_training_data N/A zip encoded_td_1 encoded_td_2 N/A 
Finding mapping between theories N/A net N/A Network N/A HIDDEN HIDDEN N/A N/A N/A net SGD encoded_training_data 6 10 0.01 0.05 N/A 
Baseline for comparison: decompress with the first autoencoder N/A and compress with the second autoencoder N/A encoded_test_1 N/A N/A sigmoid_vec N/A N/A N/A np dot N/A N/A ae_1 weights N/A 0 x N/A N/A ae_1 biases N/A 0 N/A x test N/A encoded_test_2 N/A N/A sigmoid_vec N/A N/A N/A np dot N/A N/A ae_2 weights N/A 0 x N/A N/A ae_2 biases N/A 0 N/A x test N/A test_data N/A zip encoded_test_1 encoded_test_2 N/A net_baseline N/A Network N/A HIDDEN 784 HIDDEN N/A N/A N/A net_baseline biases N/A 0 N/A N/A ae_1 biases N/A 1 N/A N/A N/A net_baseline weights N/A 0 N/A N/A ae_1 weights N/A 1 N/A N/A N/A net_baseline biases N/A 1 N/A N/A ae_2 biases N/A 0 N/A N/A N/A net_baseline weights N/A 1 N/A N/A ae_2 weights N/A 0 N/A error_baseline N/A sum N/A N/A N/A N/A np linalg norm N/A N/A N/A net_baseline feedforward x y 1 N/A N/A x y test_data N/A N/A Baseline average l1 error per training image: %s N/A N/A error_baseline SIZE N/A 
Comparing theories with a simple interconversion N/A N/A Mean desired output activation: %s N/A N/A N/A sum N/A N/A N/A y mean N/A N/A _ y test_data SIZE N/A error N/A sum N/A N/A N/A N/A np linalg norm N/A N/A N/A net feedforward x y 1 N/A N/A x y test_data N/A N/A Average l1 error per training image: %s N/A N/A error SIZE N/A 
Computing fiducial image inputs N/A fiducial_images_1 N/A N/A N/A N/A N/A N/A N/A ae_1 weights N/A 0 N/A N/A j N/A reshape 28 28 N/A N/A N/A np linalg norm N/A N/A N/A net weights N/A 0 N/A N/A j N/A N/A j N/A range HIDDEN N/A fiducial_images_2 N/A N/A N/A N/A N/A N/A N/A ae_2 weights N/A 0 N/A N/A j N/A reshape 28 28 N/A N/A N/A np linalg norm N/A N/A N/A net weights N/A 0 N/A N/A j N/A N/A j N/A range HIDDEN N/A image N/A N/A np concatenate N/A N/A N/A np concatenate fiducial_images_1 axis 1 N/A N/A np concatenate fiducial_images_2 axis 1 N/A fig N/A N/A plt figure N/A ax N/A N/A fig add_subplot 111 N/A N/A N/A ax matshow image cmap N/A N/A matplotlib cm binary N/A N/A N/A plt xticks N/A N/A np array N/A N/A N/A N/A plt yticks N/A N/A np array N/A N/A N/A N/A plt show