Module Import alias Import alias Import alias Import alias Import alias Import alias Import alias Import alias identifier ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias alias alias alias ImportFrom alias alias alias If CompareEq NameLoad Str body Assign NameStore ListComp SubscriptLoad AttributeLoad NameLoad attr Index NameLoad comprehension NameStore Call NameLoad Num Call NameLoad AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad Assign NameStore ListLoad Str Str Str For NameStore NameLoad body If CompareEq Call AttributeLoad NameLoad attr NameLoad NameLoad body Print BinOpMod Str NameLoad Expr Call NameLoad Num Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore SubscriptLoad NameLoad Index Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr Num Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr BinOpPow Num Num Expr Call NameLoad Str Assign NameStore Call NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad keyword NameLoad Assign NameStore Call NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad Expr Call NameLoad Str Assign NameStore Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword Num keyword Num Assign NameStore Num Assign NameStore Num If BoolOpAnd Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd NameLoad Str Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd NameLoad Str body Assign TupleStore NameStore NameStore Call NameLoad BinOpAdd NameLoad Str Expr Call NameLoad BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad NameLoad Str Call NameLoad NameLoad Expr Call NameLoad AttributeLoad NameLoad attr keyword BinOpAdd NameLoad Str Expr Call NameLoad Str Expr Call NameLoad Str For NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr body If Call AttributeLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad attr body Assign NameStore AttributeLoad NameLoad attr orelse Assign NameStore AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr For NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr body If CompareEq NameLoad AttributeLoad NameLoad attr body Assign NameStore AttributeLoad NameLoad attr Assign TupleStore NameStore NameStore TupleLoad ListLoad ListLoad While UnaryOpNot Call AttributeLoad AttributeLoad NameLoad attr attr body Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr For NameStore Call NameLoad BinOpDiv AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr body Assign ListStore NameStore NameStore Call SubscriptLoad NameLoad Index NameLoad keyword NameLoad keyword NameLoad keyword NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Expr Call NameLoad BinOpMod Str TupleLoad NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr NameLoad Expr Call NameLoad AttributeLoad NameLoad attr keyword BinOpAdd NameLoad Str Expr Call NameLoad TupleLoad NameLoad BinOpAdd NameLoad Num BinOpAdd NameLoad Str Assign NameStore Num Expr Call NameLoad TupleLoad BinOpAdd NameLoad Num Num BinOpAdd NameLoad Str If CompareNotEq AttributeLoad NameLoad attr Str body Expr Call NameLoad AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Expr Call NameLoad BinOpAdd Str AttributeLoad NameLoad attr If CompareNotEq AttributeLoad NameLoad attr Str body Expr Call NameLoad AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Expr Call NameLoad BinOpAdd Str AttributeLoad NameLoad attr If CompareNotEq AttributeLoad NameLoad attr Str body Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr Expr Call NameLoad BinOpAdd Str AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr BinOpAdd NameLoad Str Expr Call AttributeLoad NameLoad attr BinOpAdd NameLoad Str
N/A N/A cPickle N/A gzip N/A os N/A sys N/A time N/A numpy N/A theano N/A theano.tensor T theano.tensor.shared_randomstreams RandomStreams models.srbm SRBM models.dnn DNN utils.network_config NetworkConfig utils.rbm_config RBMConfig io_func.model_io _nnet2file _cfg2file _file2nnet log utils.utils parse_arguments save_two_integers read_two_integers N/A N/A __name__ __main__ N/A N/A arg_elements N/A N/A N/A sys argv N/A i N/A i N/A range 1 N/A len N/A sys argv N/A arguments N/A parse_arguments arg_elements N/A required_arguments N/A train_data nnet_spec wdir N/A arg required_arguments N/A N/A N/A N/A N/A arguments has_key arg False N/A N/A N/A Error: the argument %s has to be specified arg N/A N/A exit 1 N/A train_data_spec N/A arguments N/A train_data N/A nnet_spec N/A arguments N/A nnet_spec N/A wdir N/A arguments N/A wdir N/A numpy_rng N/A N/A N/A numpy random RandomState 89677 N/A theano_rng N/A RandomStreams N/A N/A numpy_rng randint N/A 2 30 N/A N/A log > ... initializing the model N/A cfg N/A RBMConfig N/A N/A N/A cfg parse_config_common arguments N/A N/A N/A cfg init_data_reading train_data_spec N/A cfg_dnn N/A NetworkConfig N/A N/A cfg_dnn n_ins N/A cfg n_ins N/A N/A cfg_dnn hidden_layers_sizes N/A cfg hidden_layers_sizes N/A N/A cfg_dnn n_outs N/A cfg n_outs N/A dnn N/A DNN numpy_rng numpy_rng theano_rng theano_rng cfg cfg_dnn N/A srbm N/A SRBM numpy_rng numpy_rng theano_rng theano_rng cfg cfg dnn dnn N/A N/A log > ... getting the pre-training functions N/A pretraining_fns N/A N/A srbm pretraining_functions train_set_x N/A cfg train_x batch_size N/A cfg batch_size k 1 weight_cost 0.0002 N/A start_layer_index 0 N/A start_epoch_index 0 N/A N/A N/A N/A N/A os path exists N/A wdir /nnet.tmp N/A N/A N/A os path exists N/A wdir /training_state.tmp N/A N/A N/A start_layer_index start_epoch_index N/A read_two_integers N/A wdir /training_state.tmp N/A N/A log N/A N/A N/A > ... found nnet.tmp and training_state.tmp, now resume training from layer # N/A str start_layer_index  epoch # N/A str start_epoch_index N/A N/A _file2nnet N/A dnn layers filename N/A wdir /nnet.tmp N/A N/A log > ... training the model N/A N/A log > r_cost = reconstruction cost, fe_cost = (approximate) value of free energy function N/A i N/A xrange start_layer_index N/A cfg ptr_layer_number N/A N/A N/A N/A N/A N/A srbm rbm_layers N/A i is_gbrbm N/A N/A pretrain_lr N/A cfg gbrbm_learning_rate N/A N/A pretrain_lr N/A cfg learning_rate N/A momentum N/A cfg initial_momentum N/A epoch N/A range start_epoch_index N/A cfg epochs N/A N/A N/A epoch N/A cfg initial_momentum_epoch N/A N/A momentum N/A cfg final_momentum N/A N/A r_c fe_c N/A N/A N/A N/A N/A N/A N/A N/A cfg train_sets is_finish N/A N/A N/A N/A N/A cfg train_sets load_next_partition N/A cfg train_xy N/A batch_index N/A xrange N/A N/A N/A cfg train_sets cur_frame_num N/A cfg batch_size N/A N/A N/A reconstruction_cost free_energy_cost N/A N/A pretraining_fns N/A i index batch_index lr pretrain_lr momentum momentum N/A N/A N/A r_c append reconstruction_cost N/A N/A N/A fe_c append free_energy_cost N/A N/A N/A N/A cfg train_sets initialize_read N/A N/A log N/A > pre-training layer %i, epoch %d, r_cost %f, fe_cost %f N/A i epoch N/A N/A numpy mean r_c N/A N/A numpy mean fe_c N/A N/A _nnet2file N/A dnn layers filename N/A wdir /nnet.tmp N/A N/A save_two_integers N/A i N/A epoch 1 N/A wdir /training_state.tmp N/A start_epoch_index 0 N/A N/A save_two_integers N/A N/A i 1 0 N/A wdir /training_state.tmp N/A N/A N/A cfg param_output_file N/A N/A N/A _nnet2file N/A dnn layers filename N/A cfg param_output_file N/A N/A log N/A > ... the final PDNN model parameter is  N/A cfg param_output_file N/A N/A N/A cfg cfg_output_file N/A N/A N/A _cfg2file N/A dnn cfg filename N/A cfg cfg_output_file N/A N/A log N/A > ... the final PDNN model config is  N/A cfg cfg_output_file N/A N/A N/A cfg kaldi_output_file N/A N/A N/A N/A dnn write_model_to_kaldi N/A cfg kaldi_output_file N/A N/A log N/A > ... the final Kaldi model is  N/A cfg kaldi_output_file N/A N/A N/A os remove N/A wdir /nnet.tmp N/A N/A N/A os remove N/A wdir /training_state.tmp