Module ImportFrom alias Import alias Import alias identifier ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Num Num NameLoad body Assert Call NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr NameLoad Assert CompareGt NameLoad Num Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr IfExp NameLoad Num Num Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults body Expr Str Assert Call NameLoad GeneratorExp CompareEq NameLoad AttributeLoad NameLoad attr comprehension NameStore TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assert Call NameLoad GeneratorExp CompareEq NameLoad AttributeLoad NameLoad attr comprehension NameStore TupleLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assert CompareIn AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assert CompareIn AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assert CompareIn AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assert CompareIn AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assert CompareIn AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assert CompareIn AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assert CompareIn AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr If CompareGt AttributeLoad NameLoad attr Num body Assert Call NameLoad GeneratorExp CompareEq NameLoad Call NameLoad NameLoad comprehension NameStore ListLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Call NameLoad NameLoad Assign NameStore BinOpDiv BinOpSub Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Call NameLoad Call NameLoad NameLoad Assign NameStore BinOpAdd BinOpSub BinOpMult BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad BinOpMult AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr BinOpSub NameLoad NameLoad keyword Num Assign NameStore BinOpAdd BinOpSub BinOpMult BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad BinOpMult AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr BinOpSub NameLoad NameLoad keyword Num Assign NameStore BinOpAdd BinOpSub BinOpMult BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad BinOpMult AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Return TupleLoad NameLoad NameLoad NameLoad decorator_list decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Num Num NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad NameLoad attr attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad NameLoad attr attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults body Assert CompareEq SubscriptLoad AttributeLoad NameLoad attr Slice Num TupleLoad AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad AttributeLoad NameLoad attr attr Assert CompareEq Call NameLoad NameLoad Call NameLoad NameLoad Assert CompareEq Call NameLoad NameLoad Call NameLoad NameLoad Assert CompareEq Call NameLoad NameLoad Call NameLoad NameLoad Assign NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad NameLoad attr attr Assign NameStore Call AttributeLoad NameLoad attr keyword AttributeLoad AttributeLoad NameLoad attr attr For NameStore Call NameLoad AttributeLoad AttributeLoad NameLoad attr attr body Assign SubscriptStore NameLoad ExtSlice Slice Slice Index NameLoad BinOpMult BinOpDiv Num NameLoad Call AttributeLoad NameLoad attr AttributeLoad BinOpSub NameLoad NameLoad attr SubscriptLoad NameLoad ExtSlice Slice Slice Index NameLoad For NameStore Call NameLoad AttributeLoad AttributeLoad NameLoad attr attr body Assign SubscriptStore NameLoad ExtSlice Slice Slice Index NameLoad BinOpMult BinOpDiv Num NameLoad Call AttributeLoad NameLoad attr AttributeLoad SubscriptLoad NameLoad ExtSlice Slice Slice Index NameLoad attr NameLoad Assign NameStore BinOpAdd BinOpSub BinOpMult BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad BinOpMult AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign NameStore BinOpAdd BinOpSub BinOpMult BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad BinOpMult AttributeLoad NameLoad attr AttributeLoad AttributeLoad NameLoad attr attr BinOpMult AttributeLoad NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Assign TupleStore NameStore NameStore NameStore Call AttributeLoad Call NameLoad NameLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad Return TupleLoad NameLoad NameLoad NameLoad NameLoad NameLoad decorator_list decorator_list
N/A distribution Distribution N/A ipdb N/A numpy np SGD N/A object N/A N/A 
    Implements a version of stochastic gradient descent with the option to also use the stochastic gradient ascent,
    if the normal max. log-likelihood procedure is applied (in case of the negative log-likelihood, it would be
    the other way around).
     __init__ N/A N/A self model_distribution learning_rate weight_decay momentum is_ascent N/A 0.01 0.0002 0.9 True N/A N/A N/A isinstance model_distribution Distribution N/A N/A self model_distribution model_distribution N/A N/A learning_rate 0 N/A N/A self learning_rate learning_rate N/A N/A self weigth_decay weight_decay N/A N/A self momentum momentum N/A N/A self ascent_factor N/A is_ascent 1 -1 N/A N/A self d_weights N/A N/A np zeros shape N/A N/A N/A self model_distribution weights shape N/A N/A self d_bias_visible N/A N/A np zeros shape N/A N/A N/A self model_distribution bias_visible shape N/A N/A self d_bias_hidden N/A N/A np zeros shape N/A N/A N/A self model_distribution bias_hidden shape N/A optimize N/A N/A self visible_0_states hidden_0_states hidden_0_probs hidden_k_probs hidden_k_states visible_k_probs visible_k_states N/A N/A N/A 
        Optimizies the given paramters of the probability distribution through stochastic gradient descent given sampled
        data. It will update automatically the values of the model distribution

        @param visible_0_states: states of the visible units that were fed into the syste
        @param hidden_0_states: states of the hidden units after the initial sampling pass
        @param hidden_0_probs: probabilites (e.g. mean field activation) of the hidden units after a inital sampling pass
        @param hidden_k_probs: probabilities (e.g. mean field activation) of the hidden units after k sampling steps
        @param hidden_k_states: states of the hidden units after k sampling steps
        @param visible_k_probs: probabilites (e.g. mean field activation) of visible units after k sampling steps
        @param visible_k_states: states of the visible units after k sampling steps
        @return: delta values for parameter update
         N/A N/A all N/A N/A dim N/A visible_0_states ndim N/A dim N/A N/A visible_k_probs ndim N/A visible_k_states ndim N/A N/A all N/A N/A dim N/A hidden_0_states ndim N/A dim N/A N/A hidden_0_probs ndim N/A hidden_k_probs ndim N/A hidden_k_states ndim N/A N/A N/A N/A self model_distribution size_visible N/A visible_0_states shape N/A N/A N/A N/A self model_distribution size_visible N/A visible_k_states shape N/A N/A N/A N/A self model_distribution size_visible N/A visible_k_probs shape N/A N/A N/A N/A self model_distribution size_hidden N/A hidden_0_states shape N/A N/A N/A N/A self model_distribution size_hidden N/A hidden_0_probs shape N/A N/A N/A N/A self model_distribution size_hidden N/A hidden_k_probs shape N/A N/A N/A N/A self model_distribution size_hidden N/A hidden_k_states shape N/A N/A N/A visible_k_probs ndim 1 N/A N/A N/A all N/A N/A batch N/A len visible_0_states N/A batch N/A N/A len hidden_0_states N/A len hidden_0_probs N/A len hidden_k_probs N/A len hidden_k_states N/A len visible_k_probs N/A len visible_k_states N/A d_weight_update N/A N/A N/A N/A np dot N/A visible_0_states T hidden_0_probs N/A N/A np dot N/A visible_k_states T hidden_k_probs N/A float N/A len visible_0_states N/A d_weight_update N/A N/A N/A N/A N/A self ascent_factor N/A self learning_rate d_weight_update N/A N/A self weigth_decay N/A N/A self model_distribution weights N/A N/A self momentum N/A self d_weights N/A d_bias_hidden_update N/A N/A np mean N/A hidden_0_probs hidden_k_probs axis 0 N/A d_bias_hidden_update N/A N/A N/A N/A N/A self ascent_factor N/A self learning_rate d_bias_hidden_update N/A N/A self weigth_decay N/A N/A self model_distribution bias_hidden N/A N/A self momentum N/A self d_bias_hidden N/A d_bias_visible_update N/A N/A np mean N/A visible_0_states visible_k_states axis 0 N/A d_bias_visible_update N/A N/A N/A N/A N/A self ascent_factor N/A self learning_rate d_bias_visible_update N/A N/A self weigth_decay N/A N/A self model_distribution bias_visible N/A N/A self momentum N/A self d_bias_visible N/A N/A self d_weights N/A N/A np copy d_weight_update N/A N/A self d_bias_hidden N/A N/A np copy d_bias_hidden_update N/A N/A self d_bias_visible N/A N/A np copy d_bias_visible_update N/A N/A d_weight_update d_bias_hidden_update d_bias_visible_update N/A N/A DynamicSGD N/A SGD N/A __init__ N/A N/A self model_distribution learning_rate weight_decay momentum is_ascent N/A 0.01 0.0002 0.9 True N/A N/A N/A N/A SGD __init__ self model_distribution learning_rate weight_decay momentum is_ascent N/A N/A self d_vis_vis N/A N/A np zeros shape N/A N/A model_distribution vis_vis_weights shape N/A N/A self d_vis_hid N/A N/A np zeros shape N/A N/A model_distribution vis_hid_weights shape N/A optimize N/A N/A self visible_0_states hidden_0_states hidden_0_probs hidden_k_probs hidden_k_states visible_k_probs visible_k_states visible_lagged N/A N/A N/A N/A N/A N/A visible_lagged shape N/A 1 N/A N/A N/A self model_distribution size_visible N/A N/A self model_distribution m_lag_visible N/A N/A N/A len hidden_0_states N/A len visible_k_states N/A N/A N/A len visible_0_states N/A len visible_k_states N/A N/A N/A len visible_lagged N/A len visible_k_states N/A batch_size N/A len hidden_0_states N/A d_vis_vis N/A N/A np zeros shape N/A N/A self d_vis_vis shape N/A d_vis_hid N/A N/A np zeros shape N/A N/A self d_vis_hid shape N/A lag N/A range N/A N/A self model_distribution m_lag_visible N/A N/A N/A d_vis_vis N/A N/A N/A N/A lag N/A N/A 1.0 batch_size N/A N/A np dot N/A N/A visible_0_states visible_k_states T N/A visible_lagged N/A N/A N/A N/A lag N/A lag N/A range N/A N/A self model_distribution n_lag_hidden N/A N/A N/A d_vis_hid N/A N/A N/A N/A lag N/A N/A 1.0 batch_size N/A N/A np dot N/A N/A visible_lagged N/A N/A N/A N/A lag T hidden_0_states N/A d_vis_vis N/A N/A N/A N/A N/A self ascent_factor N/A self learning_rate d_vis_vis N/A N/A self weigth_decay N/A N/A self model_distribution vis_vis_weights N/A N/A self momentum N/A self d_vis_vis N/A d_vis_hid N/A N/A N/A N/A N/A self ascent_factor N/A self learning_rate d_vis_hid N/A N/A self weigth_decay N/A N/A self model_distribution vis_hid_weights N/A N/A self momentum N/A self d_vis_hid N/A N/A self d_vis_vis N/A N/A np copy d_vis_vis N/A N/A self d_vis_hid N/A N/A np copy d_vis_hid N/A N/A d_weight_update d_bias_hidden_update d_bias_visible_update N/A N/A N/A super DynamicSGD self optimize visible_0_states hidden_0_states hidden_0_probs hidden_k_probs hidden_k_states visible_k_probs visible_k_states N/A N/A d_weight_update d_bias_hidden_update d_bias_visible_update d_vis_vis d_vis_hid N/A N/A