Module ImportFrom alias ImportFrom alias alias alias ImportFrom alias Import alias identifier Import alias ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults Call NameLoad Num body Expr Str Assert CompareIn NameLoad ListLoad Str Str Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore TupleLoad Num NameLoad Assign AttributeStore NameLoad attr TupleLoad NameLoad NameLoad orelse If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore TupleLoad Num NameLoad Num Num Assign AttributeStore NameLoad attr TupleLoad NameLoad NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr Call NameLoad NameLoad keyword Str Assign AttributeStore NameLoad attr Call NameLoad NameLoad keyword Str Assign AttributeStore NameLoad attr ListLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Num Assign AttributeStore NameLoad attr Num decorator_list FunctionDef arguments args NameParam NameParam defaults body If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore Call AttributeLoad NameLoad attr keyword Num Assign NameStore Call AttributeLoad NameLoad attr BinOpPow BinOpSub NameLoad NameLoad Num keyword Num orelse If CompareEq AttributeLoad NameLoad attr Str body Assign NameStore Call AttributeLoad NameLoad attr keyword TupleLoad Num Num Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr BinOpPow BinOpSub NameLoad NameLoad Num keyword TupleLoad Num Num Num keyword NameLoad Assign AttributeStore NameLoad attr BinOpAdd BinOpMult AttributeLoad NameLoad attr NameLoad BinOpMult BinOpSub Num AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr BinOpAdd BinOpMult AttributeLoad NameLoad attr NameLoad BinOpMult BinOpSub Num AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore BinOpDiv BinOpSub NameLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr BinOpAdd AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Return BinOpAdd BinOpMult NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Assign NameStore BinOpDiv BinOpSub NameLoad AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr BinOpAdd AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Return BinOpAdd BinOpMult NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Return ListLoad TupleLoad Str Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad Str Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad Str Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad Str Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr TupleLoad Str Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list decorator_list
N/A mozi.layers.template Template mozi.utils.theano_utils shared_zeros sharedX shared_ones mozi.weight_init UniformWeight N/A theano.tensor T N/A theano BatchNormalization N/A Template N/A __init__ N/A N/A self dim layer_type gamma_init short_memory N/A N/A UniformWeight 0.9 N/A N/A 
        REFERENCE:
            Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
        PARAMS:
            short_memory: short term memory
                y_t is the latest value, the moving average x_tp1 is calculated as
                x_tp1 = memory * y_t + (1-memory) * x_t, the larger the short term
                memory, the more weight is put on contempory.
            layer_type: fc or conv
            epsilon:
                denominator min value for preventing division by zero in computing std
            dim: for fc layers, shape is the layer dimension, for conv layers,
                shape is the number of feature maps
         N/A N/A layer_type N/A fc conv N/A N/A self layer_type layer_type N/A N/A self epsilon 1e-06 N/A N/A self dim dim N/A N/A self mem short_memory N/A N/A N/A self layer_type fc N/A N/A input_shape N/A 1 dim N/A N/A self broadcastable N/A True False N/A N/A N/A N/A self layer_type conv N/A N/A input_shape N/A 1 dim 1 1 N/A N/A self broadcastable N/A True False True True N/A N/A self gamma N/A gamma_init input_shape name gamma N/A N/A self beta N/A shared_zeros input_shape name beta N/A N/A self params N/A N/A self gamma N/A self beta N/A N/A self moving_mean 0 N/A N/A self moving_var 1 N/A _train_fprop N/A N/A self state_below N/A N/A N/A N/A N/A self layer_type fc N/A N/A miu N/A N/A state_below mean axis 0 N/A var N/A N/A T mean N/A N/A state_below miu 2 axis 0 N/A N/A N/A N/A self layer_type conv N/A N/A miu N/A N/A state_below mean axis N/A 0 2 3 keepdims True N/A var N/A N/A T mean N/A N/A state_below miu 2 axis N/A 0 2 3 keepdims True N/A N/A self moving_mean N/A N/A N/A self mem miu N/A N/A 1 N/A self mem N/A self moving_mean N/A N/A self moving_var N/A N/A N/A self mem var N/A N/A 1 N/A self mem N/A self moving_var N/A Z N/A N/A state_below N/A self moving_mean N/A N/A T sqrt N/A N/A self moving_var N/A self epsilon N/A gamma N/A N/A T patternbroadcast N/A self gamma N/A self broadcastable N/A beta N/A N/A T patternbroadcast N/A self beta N/A self broadcastable N/A N/A N/A gamma Z beta N/A _test_fprop N/A N/A self state_below N/A N/A N/A Z N/A N/A state_below N/A self moving_mean N/A N/A T sqrt N/A N/A self moving_var N/A self epsilon N/A gamma N/A N/A T patternbroadcast N/A self gamma N/A self broadcastable N/A beta N/A N/A T patternbroadcast N/A self beta N/A self broadcastable N/A N/A N/A gamma Z beta N/A _layer_stats N/A N/A self state_below layer_output N/A N/A N/A N/A N/A moving_mean N/A N/A T mean N/A self moving_mean N/A moving_std N/A N/A T mean N/A self moving_var N/A gamma_mean N/A N/A T mean N/A self gamma N/A beta_mean N/A N/A T mean N/A self beta N/A gamma_max N/A N/A T max N/A self gamma N/A N/A