Module Expr Str Import alias identifier Import alias Import alias identifier Import alias Import alias Import alias Import alias Import alias identifier Import alias Import alias Import alias Import alias identifier Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Str Assign NameStore NameLoad Assign NameStore NameLoad Assign NameStore Call AttributeLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad attr Str Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Str NameLoad Print Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore ListLoad TupleLoad Num Num TupleLoad Num Num Assign NameStore ListLoad Call AttributeLoad NameLoad attr Num keyword SubscriptLoad NameLoad Index Num BinOpAdd Call AttributeLoad NameLoad attr Num keyword SubscriptLoad NameLoad Index Num Call AttributeLoad NameLoad attr keyword Num Assign NameStore Call NameLoad NameLoad Assign NameStore AttributeLoad NameLoad attr Assign NameStore BinOpFloorDiv NameLoad Num AugAssignSub NameStore NameLoad Assign NameStore AttributeLoad NameLoad attr Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Slice NameLoad Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Slice NameLoad Assign NameStore AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad BinOpAdd NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore SubscriptLoad Call AttributeLoad NameLoad attr Str Slice NameLoad Print Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad SubscriptLoad SubscriptLoad NameLoad Index Num Index Num SubscriptLoad SubscriptLoad NameLoad Index Num Index Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad SubscriptLoad SubscriptLoad NameLoad Index Num Index Num SubscriptLoad SubscriptLoad NameLoad Index Num Index Num Assign NameStore Call AttributeLoad NameLoad attr ListLoad NameLoad NameLoad keyword Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num keyword Num keyword Num keyword Num keyword Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num keyword Num keyword Num keyword Num keyword Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num keyword Num keyword Num keyword Num keyword Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num keyword Num keyword Num keyword Num keyword Num keyword Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num keyword Num keyword Num keyword AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num keyword Str Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num keyword Num keyword Num keyword Num keyword AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore ListComp Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr TupleLoad Num Num Num Num keyword AttributeLoad AttributeLoad NameLoad attr attr comprehension NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Dict AttributeLoad NameLoad attr AttributeLoad NameLoad attr SubscriptLoad SubscriptLoad NameLoad Index Num Slice BinOpMult NameLoad NameLoad BinOpMult BinOpAdd NameLoad Num NameLoad SubscriptLoad SubscriptLoad NameLoad Index Num Slice BinOpMult NameLoad NameLoad BinOpMult BinOpAdd NameLoad Num NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListLoad NameLoad Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Print Str Expr Call AttributeLoad NameLoad attr NameLoad SubscriptLoad NameLoad Index Str Print Str Assign NameStore ListLoad For NameStore ListLoad BinOpDiv Num Num Num Num body For NameStore Call AttributeLoad NameLoad attr Num Num Num keyword NameLoad body Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr keyword BinOpAdd NameLoad Num keyword NameLoad keyword Num Print BinOpMod Str Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Str keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad Str keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword Num Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr BinOpDiv BinOpMult NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr BinOpDiv BinOpMult NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Print BinOpMod Str NameLoad Print BinOpMod Str NameLoad If NameLoad body Print Print Str Print Str Assign NameStore ListLoad Assign NameStore Call AttributeLoad NameLoad attr For TupleStore NameStore TupleStore NameStore NameStore Call NameLoad NameLoad body Print BinOpMod Str BinOpAdd NameLoad Num Assign NameStore NameLoad Assign NameStore ListComp Call AttributeLoad NameLoad attr Num Num Num Num comprehension NameStore NameLoad Print Str For TupleStore NameStore NameStore Call NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad Call NameLoad NameLoad Assign NameStore ListLoad For NameStore Call NameLoad NameLoad body If CompareEq BinOpMod NameLoad Num Num body Print BinOpMod Str TupleLoad BinOpAdd NameLoad Num NameLoad Assign NameStore Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore SubscriptLoad NameLoad Slice NameLoad Print Str Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr Num Call NameLoad NameLoad Num attr Num Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpSub Call AttributeLoad NameLoad attr NameLoad Print BinOpMod Str Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Print BinOpMod Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Print Str Assign NameStore SubscriptLoad SubscriptLoad NameLoad Index Str Index Num Assign NameStore Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr BinOpPow BinOpSub NameLoad NameLoad Num Print BinOpMod Str NameLoad Print BinOpMod Str NameLoad If NameLoad body Print Print Str Print Str Assign NameStore ListLoad Assign NameStore Call AttributeLoad NameLoad attr For TupleStore NameStore TupleStore NameStore NameStore Call NameLoad NameLoad body Print BinOpMod Str BinOpAdd NameLoad Num Assign NameStore NameLoad Assign NameStore ListComp Call AttributeLoad NameLoad attr Num Num Num Num comprehension NameStore NameLoad Print Str For TupleStore NameStore NameStore Call NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr BinOpDiv NameLoad Call NameLoad NameLoad Assign NameStore ListLoad For NameStore Call NameLoad NameLoad body If CompareEq BinOpMod NameLoad Num Num body Print BinOpMod Str TupleLoad BinOpAdd NameLoad Num NameLoad Assign NameStore Call NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore SubscriptLoad NameLoad Slice NameLoad Print Str Assign NameStore Call AttributeLoad Call AttributeLoad NameLoad attr Num Call NameLoad NameLoad Num attr Num Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpSub Call AttributeLoad NameLoad attr NameLoad Print BinOpMod Str Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Print BinOpMod Str NameLoad Expr Call AttributeLoad NameLoad attr NameLoad NameLoad Print Str
N/A N/A 
Load an analysis file and redo the predictions on the validation set / test set,
this time with augmented data and averaging. Store them as numpy files.
 N/A numpy np N/A theano N/A theano.tensor T N/A layers N/A cc_layers N/A custom N/A load_data N/A realtime_augmentation ra N/A time N/A csv N/A os N/A cPickle pickle N/A BATCH_SIZE 32 N/A NUM_INPUT_FEATURES 3 N/A CHUNK_SIZE 8000 N/A ANALYSIS_PATH analysis/final/try_convnet_cc_multirotflip_3x69r45_8433n_maxout2048_pysex.pkl N/A DO_VALID True N/A DO_TEST True N/A target_filename N/A N/A N/A N/A N/A os path basename ANALYSIS_PATH replace .pkl .npy.gz N/A target_path_valid N/A N/A N/A os path join predictions/final/augmented/valid target_filename N/A target_path_test N/A N/A N/A os path join predictions/final/augmented/test target_filename N/A Loading model data etc. N/A analysis N/A N/A np load ANALYSIS_PATH N/A input_sizes N/A N/A 69 69 N/A 69 69 N/A ds_transforms N/A N/A N/A ra build_ds_transform 3.0 target_size N/A input_sizes N/A 0 N/A N/A N/A ra build_ds_transform 3.0 target_size N/A input_sizes N/A 1 N/A N/A ra build_augmentation_transform rotation 45 N/A num_input_representations N/A len ds_transforms N/A num_train N/A load_data num_train N/A num_valid N/A num_train 10 N/A num_train num_valid N/A num_test N/A load_data num_test N/A valid_ids N/A N/A load_data train_ids N/A num_train N/A train_ids N/A N/A load_data train_ids N/A num_train N/A test_ids N/A load_data test_ids N/A train_indices N/A N/A np arange num_train N/A valid_indices N/A N/A np arange num_train N/A num_train num_valid N/A test_indices N/A N/A np arange num_test N/A y_valid N/A N/A N/A np load data/solutions_train.npy N/A num_train N/A Build model N/A l0 N/A N/A layers Input2DLayer BATCH_SIZE NUM_INPUT_FEATURES N/A N/A input_sizes N/A 0 N/A 0 N/A N/A input_sizes N/A 0 N/A 1 N/A l0_45 N/A N/A layers Input2DLayer BATCH_SIZE NUM_INPUT_FEATURES N/A N/A input_sizes N/A 1 N/A 0 N/A N/A input_sizes N/A 1 N/A 1 N/A l0r N/A N/A layers MultiRotSliceLayer N/A l0 l0_45 part_size 45 include_flip True N/A l0s N/A N/A cc_layers ShuffleBC01ToC01BLayer l0r N/A l1a N/A N/A cc_layers CudaConvnetConv2DLayer l0s n_filters 32 filter_size 8 weights_std 0.01 init_bias_value 0.1 dropout 0.0 partial_sum 1 untie_biases True N/A l1 N/A N/A cc_layers CudaConvnetPooling2DLayer l1a pool_size 2 N/A l2a N/A N/A cc_layers CudaConvnetConv2DLayer l1 n_filters 64 filter_size 4 weights_std 0.01 init_bias_value 0.1 dropout 0.0 partial_sum 1 untie_biases True N/A l2 N/A N/A cc_layers CudaConvnetPooling2DLayer l2a pool_size 2 N/A l3a N/A N/A cc_layers CudaConvnetConv2DLayer l2 n_filters 128 filter_size 3 weights_std 0.01 init_bias_value 0.1 dropout 0.0 partial_sum 1 untie_biases True N/A l3b N/A N/A cc_layers CudaConvnetConv2DLayer l3a n_filters 128 filter_size 3 pad 0 weights_std 0.1 init_bias_value 0.1 dropout 0.0 partial_sum 1 untie_biases True N/A l3 N/A N/A cc_layers CudaConvnetPooling2DLayer l3b pool_size 2 N/A l3s N/A N/A cc_layers ShuffleC01BToBC01Layer l3 N/A j3 N/A N/A layers MultiRotMergeLayer l3s num_views 4 N/A l4a N/A N/A layers DenseLayer j3 n_outputs 4096 weights_std 0.001 init_bias_value 0.01 dropout 0.5 nonlinearity N/A layers identity N/A l4 N/A N/A layers FeatureMaxPoolingLayer l4a pool_size 2 feature_dim 1 implementation reshape N/A l5 N/A N/A layers DenseLayer l4 n_outputs 37 weights_std 0.01 init_bias_value 0.1 dropout 0.5 nonlinearity N/A layers identity N/A l6 N/A N/A custom OptimisedDivGalaxyOutputLayer l5 N/A xs_shared N/A N/A N/A theano shared N/A N/A np zeros N/A 1 1 1 1 dtype N/A N/A theano config floatX N/A _ N/A xrange num_input_representations N/A idx N/A N/A T lscalar idx N/A givens N/A N/A l0 input_var N/A l0_45 input_var N/A N/A xs_shared N/A 0 N/A N/A idx BATCH_SIZE N/A N/A idx 1 BATCH_SIZE N/A N/A xs_shared N/A 1 N/A N/A idx BATCH_SIZE N/A N/A idx 1 BATCH_SIZE N/A compute_output N/A N/A theano function N/A idx N/A N/A l6 predictions dropout_active False givens givens N/A Load model parameters N/A N/A N/A layers set_param_values l6 N/A analysis N/A param_values N/A Create generators N/A augmentation_transforms N/A N/A zoom N/A N/A 1 1.2 1.0 1.2 N/A N/A angle N/A N/A np linspace 0 360 10 endpoint False N/A N/A N/A N/A augmentation_transforms append N/A N/A ra build_augmentation_transform rotation angle zoom zoom N/A N/A N/A augmentation_transforms append N/A N/A ra build_augmentation_transform rotation N/A angle 180 zoom zoom shear 180 N/A N/A   %d augmentation transforms. N/A len augmentation_transforms N/A augmented_data_gen_valid N/A N/A ra realtime_fixed_augmented_data_gen valid_indices train augmentation_transforms augmentation_transforms chunk_size CHUNK_SIZE target_sizes input_sizes ds_transforms ds_transforms processor_class N/A ra LoadAndProcessFixedPysexCenteringRescaling N/A valid_gen N/A N/A load_data buffered_gen_mp augmented_data_gen_valid buffer_size 1 N/A augmented_data_gen_test N/A N/A ra realtime_fixed_augmented_data_gen test_indices test augmentation_transforms augmentation_transforms chunk_size CHUNK_SIZE target_sizes input_sizes ds_transforms ds_transforms processor_class N/A ra LoadAndProcessFixedPysexCenteringRescaling N/A test_gen N/A N/A load_data buffered_gen_mp augmented_data_gen_test buffer_size 1 N/A approx_num_chunks_valid N/A int N/A N/A np ceil N/A N/A num_valid N/A len augmentation_transforms N/A float CHUNK_SIZE N/A approx_num_chunks_test N/A int N/A N/A np ceil N/A N/A num_test N/A len augmentation_transforms N/A float CHUNK_SIZE N/A N/A Approximately %d chunks for the validation set approx_num_chunks_valid N/A N/A Approximately %d chunks for the test set approx_num_chunks_test N/A DO_VALID N/A N/A N/A VALIDATION SET N/A Compute predictions N/A predictions_list N/A N/A start_time N/A N/A time time N/A N/A e N/A chunk_data chunk_length N/A enumerate valid_gen N/A N/A N/A Chunk %d N/A e 1 N/A xs_chunk chunk_data N/A xs_chunk N/A N/A N/A x_chunk transpose 0 3 1 2 N/A x_chunk xs_chunk N/A   load data onto GPU N/A N/A x_shared x_chunk N/A zip xs_shared xs_chunk N/A N/A N/A N/A x_shared set_value x_chunk N/A num_batches_chunk N/A int N/A N/A np ceil N/A chunk_length N/A float BATCH_SIZE N/A predictions_chunk_list N/A N/A b N/A xrange num_batches_chunk N/A N/A N/A N/A b 1000 0 N/A N/A N/A   batch %d/%d N/A N/A b 1 num_batches_chunk N/A predictions N/A compute_output b N/A N/A N/A predictions_chunk_list append predictions N/A predictions_chunk N/A N/A np vstack predictions_chunk_list N/A predictions_chunk N/A predictions_chunk N/A chunk_length N/A   compute average over transforms N/A predictions_chunk_avg N/A N/A N/A N/A predictions_chunk reshape -1 N/A len augmentation_transforms 37 mean 1 N/A N/A N/A predictions_list append predictions_chunk_avg N/A time_since_start N/A N/A N/A time time start_time N/A N/A   %s since start N/A N/A load_data hms time_since_start N/A all_predictions N/A N/A np vstack predictions_list N/A N/A Write predictions to %s target_path_valid N/A N/A N/A load_data save_gz target_path_valid all_predictions N/A Evaluate N/A rmse_valid N/A N/A analysis N/A losses_valid N/A -1 N/A rmse_augmented N/A N/A np sqrt N/A N/A np mean N/A N/A y_valid all_predictions 2 N/A N/A   MSE (last iteration):	%.6f rmse_valid N/A N/A   MSE (augmented):	%.6f rmse_augmented N/A DO_TEST N/A N/A N/A TEST SET N/A Compute predictions N/A predictions_list N/A N/A start_time N/A N/A time time N/A N/A e N/A chunk_data chunk_length N/A enumerate test_gen N/A N/A N/A Chunk %d N/A e 1 N/A xs_chunk chunk_data N/A xs_chunk N/A N/A N/A x_chunk transpose 0 3 1 2 N/A x_chunk xs_chunk N/A   load data onto GPU N/A N/A x_shared x_chunk N/A zip xs_shared xs_chunk N/A N/A N/A N/A x_shared set_value x_chunk N/A num_batches_chunk N/A int N/A N/A np ceil N/A chunk_length N/A float BATCH_SIZE N/A predictions_chunk_list N/A N/A b N/A xrange num_batches_chunk N/A N/A N/A N/A b 1000 0 N/A N/A N/A   batch %d/%d N/A N/A b 1 num_batches_chunk N/A predictions N/A compute_output b N/A N/A N/A predictions_chunk_list append predictions N/A predictions_chunk N/A N/A np vstack predictions_chunk_list N/A predictions_chunk N/A predictions_chunk N/A chunk_length N/A   compute average over transforms N/A predictions_chunk_avg N/A N/A N/A N/A predictions_chunk reshape -1 N/A len augmentation_transforms 37 mean 1 N/A N/A N/A predictions_list append predictions_chunk_avg N/A time_since_start N/A N/A N/A time time start_time N/A N/A   %s since start N/A N/A load_data hms time_since_start N/A all_predictions N/A N/A np vstack predictions_list N/A N/A Write predictions to %s target_path_test N/A N/A N/A load_data save_gz target_path_test all_predictions N/A Done!