Module Expr Str Assign NameStore Str Assign NameStore Str Assign NameStore ListLoad Str Assign NameStore Str Assign NameStore Str Assign NameStore Str Import alias Import alias Import alias identifier ImportFrom alias ImportFrom alias alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias alias ImportFrom alias ImportFrom alias Assign NameStore Call AttributeLoad NameLoad attr NameLoad ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults NameLoad NameLoad NameLoad Num NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad NameLoad Num NameLoad NameLoad NameLoad Num NameLoad NameLoad NameLoad body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call NameLoad Delete AttributeDel NameLoad attr If CompareIs NameLoad NameLoad body Assert CompareIs NameLoad NameLoad Assert CompareIs NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad NameLoad ListLoad Num Num Num keyword ListLoad Str Str decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Str Assign AttributeStore NameLoad attr NameLoad If CompareIs AttributeLoad NameLoad attr NameLoad body Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr TryExcept body If Call AttributeLoad AttributeLoad NameLoad attr attr body Raise Call NameLoad Str handlers ExceptHandler type NameLoad body Expr Call AttributeLoad NameLoad attr Str If CompareIs AttributeLoad NameLoad attr NameLoad body Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr orelse Assign NameStore AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad orelse If Call NameLoad NameLoad Str body If UnaryOpNot BoolOpOr CompareIs AttributeLoad NameLoad attr NameLoad CompareLtE AttributeLoad NameLoad attr Num CompareEq NameLoad AttributeLoad NameLoad attr body Raise Call NameLoad BinOpAdd Str BinOpMod Str TupleLoad NameLoad AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Assign NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num keyword NameLoad Assign NameStore ListLoad For TupleStore NameStore NameStore Call NameLoad NameLoad NameLoad body Assign NameStore BinOpMod Str NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad AttributeLoad NameLoad attr Assign TupleStore NameStore NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad NameLoad AttributeLoad NameLoad attr Assert Call NameLoad NameLoad NameLoad Assert Call NameLoad NameLoad NameLoad If CompareIs NameLoad NameLoad body Raise Call NameLoad BinOpAdd BinOpAdd BinOpAdd Str Call NameLoad AttributeLoad NameLoad attr Str Str FunctionDef arguments args NameParam NameParam defaults NameLoad body Assign NameStore Lambda arguments args defaults vararg Call NameLoad Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Return NameLoad decorator_list Assign NameStore ListComp Call NameLoad NameLoad comprehension NameStore AttributeLoad NameLoad attr If CompareIsNot AttributeLoad NameLoad attr NameLoad body If BoolOpAnd CompareIs AttributeLoad NameLoad attr NameLoad CompareIs AttributeLoad NameLoad attr NameLoad body Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword NameLoad keyword AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr Call NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword NameLoad keyword ListLoad AttributeLoad NameLoad attr keyword Call AttributeLoad NameLoad attr keyword NameLoad keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr If CompareIsNot AttributeLoad NameLoad attr NameLoad body Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Str keyword NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr keyword TupleLoad Call NameLoad Str keyword Call NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Str keyword NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr keyword TupleLoad Call NameLoad Str keyword Call NameLoad AttributeLoad NameLoad attr Expr Call AttributeLoad AttributeLoad NameLoad attr attr keyword Str keyword NameLoad keyword AttributeLoad AttributeLoad NameLoad attr attr keyword TupleLoad Call NameLoad Str keyword Call NameLoad AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Assert AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr Assign NameStore Str If UnaryOpNot Call NameLoad NameLoad body Assign NameStore NameLoad Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num keyword NameLoad Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index Num keyword NameLoad If CompareEq Call NameLoad NameLoad Num body Raise Call NameLoad BinOpMod Str Call NameLoad NameLoad Assign NameStore TupleLoad Call NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr keyword NameLoad keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad keyword NameLoad Assign NameStore AttributeLoad NameLoad attr For NameStore NameLoad body If BoolOpAnd CompareIn Str NameLoad CompareIsNot NameLoad NameLoad Call NameLoad NameLoad Str body Assign NameStore SubscriptLoad NameLoad Index Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad Call NameLoad NameLoad attr Str Str Expr Call AttributeLoad AttributeLoad NameLoad attr attr BinOpAdd BinOpAdd Str NameLoad Str For NameStore AttributeLoad NameLoad attr body Expr Call NameLoad Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad SubscriptLoad NameLoad Index Num attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str If CompareIs AttributeLoad NameLoad attr NameLoad body Return NameLoad orelse Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Assert CompareIn NameLoad ListLoad NameLoad NameLoad Num Num Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str If CompareNotEq AttributeLoad NameLoad attr Num body Assign AttributeStore NameLoad attr Call NameLoad Call AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr ListComp Call AttributeLoad NameLoad attr comprehension NameStore AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str If CompareNotEq AttributeLoad NameLoad attr Num body For TupleStore NameStore NameStore Call NameLoad AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Assign NameStore BinOpAdd BinOpMult BinOpSub Num AttributeLoad NameLoad attr NameLoad BinOpMult AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad decorator_list decorator_list ClassDef bases NameLoad NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Num body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call NameLoad Delete AttributeDel NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Str Assign NameStore AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr Assign NameStore SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Index Num Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr If CompareEq Call NameLoad NameLoad Num body Return Assign NameStore SubscriptLoad NameLoad Index Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr If CompareGtE NameLoad AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad AugAssignMult NameStore AttributeLoad NameLoad attr If CompareLt NameLoad AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Str Assign AttributeStore NameLoad attr NameLoad Assign NameStore AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad orelse If BoolOpAnd CompareLtE NameLoad AttributeLoad NameLoad attr CompareNotEq AttributeLoad NameLoad attr Num body Expr Call AttributeLoad NameLoad attr Str AugAssignMult NameStore AttributeLoad NameLoad attr If CompareGt NameLoad AttributeLoad NameLoad attr body Assign NameStore AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call SubscriptLoad AttributeLoad NameLoad attr Index AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Return AttributeLoad NameLoad attr decorator_list decorator_list ClassDef bases NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam defaults body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Str If AttributeLoad NameLoad attr body Assign NameStore AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr Assign NameStore SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Index Num Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr AugAssignMult NameStore AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad AttributeLoad NameLoad attr Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call SubscriptLoad AttributeLoad NameLoad attr Index AttributeLoad NameLoad attr NameLoad decorator_list decorator_list ClassDef bases NameLoad NameLoad body Expr Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Num body Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call NameLoad Delete AttributeDel NameLoad attr Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults body Expr Str Assign NameStore AttributeLoad NameLoad attr If AttributeLoad NameLoad attr body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr Assign NameStore SubscriptLoad Call AttributeLoad AttributeLoad NameLoad attr attr Index Num Expr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr Assign NameStore SubscriptLoad AttributeLoad NameLoad attr Index AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr If CompareEq Call NameLoad NameLoad Num body Return Assign NameStore SubscriptLoad NameLoad Index Num Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad NameLoad attr NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr AttributeLoad NameLoad attr Assign NameStore AttributeLoad NameLoad attr If CompareGtE NameLoad AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad AugAssignMult NameStore AttributeLoad NameLoad attr If CompareLt NameLoad AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr Str Assign AttributeStore NameLoad attr NameLoad Assign NameStore AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad Expr Call AttributeLoad NameLoad attr Str For TupleStore NameStore NameStore Call NameLoad Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore AttributeLoad NameLoad attr orelse If BoolOpAnd CompareLtE NameLoad AttributeLoad NameLoad attr CompareNotEq AttributeLoad NameLoad attr Num body Expr Call AttributeLoad NameLoad attr Str AugAssignMult NameStore AttributeLoad NameLoad attr If CompareGt NameLoad AttributeLoad NameLoad attr body Assign NameStore AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr Call AttributeLoad Str attr NameLoad Assign AttributeStore NameLoad attr NameLoad Expr Call AttributeLoad AttributeLoad NameLoad attr attr Call SubscriptLoad AttributeLoad NameLoad attr Index AttributeLoad NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr ListComp Call AttributeLoad NameLoad attr comprehension NameStore Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam defaults body Expr Str Return AttributeLoad NameLoad attr decorator_list decorator_list
N/A N/A 
Module for performing batch gradient methods.
Technically, SGD and BGD both work with any batch size, but SGD has no line
search functionality and is thus best suited to small batches, while BGD
supports line searches and thuse works best with large batches.
 N/A __authors__ Ian Goodfellow N/A __copyright__ Copyright 2010-2012, Universite de Montreal N/A __credits__ N/A Ian Goodfellow N/A __license__ 3-clause BSD N/A __maintainer__ LISA Lab N/A __email__ pylearn-dev@googlegroups N/A logging N/A warnings N/A numpy np theano config pylearn2.compat OrderedDict first_value pylearn2.monitor Monitor pylearn2.optimization.batch_gradient_descent BatchGradientDescent pylearn2.utils.iteration is_stochastic pylearn2.training_algorithms.training_algorithm TrainingAlgorithm pylearn2.utils safe_zip pylearn2.train_extensions TrainExtension pylearn2.termination_criteria TerminationCriterion pylearn2.utils sharedX pylearn2.space CompositeSpace NullSpace pylearn2.utils.data_specs DataSpecsMapping pylearn2.utils.rng make_np_rng N/A logger N/A N/A logging getLogger __name__ BGD N/A TrainingAlgorithm N/A N/A 
    Batch Gradient Descent training algorithm class

    Parameters
    ----------
    cost : pylearn2.costs.Cost, optional
        A pylearn2 Cost, or None, in which case model.get_default_cost()
        will be used
    batch_size : int, optional
        Like the SGD TrainingAlgorithm, this TrainingAlgorithm still
        iterates over minibatches of data. The difference is that this
        class uses partial line searches to choose the step size along
        each gradient direction, and can do repeated updates on the same
        batch. The assumption is that you use big enough minibatches with
        this algorithm that a large step size will generalize reasonably
        well to other minibatches. To implement true Batch Gradient
        Descent, set the batch_size to the total number of examples
        available. If batch_size is None, it will revert to the model's
        force_batch_size attribute.
    batches_per_iter : int, optional
        WRITEME
    updates_per_batch : int, optional
        Passed through to the optimization.BatchGradientDescent's
        `max_iters parameter`
    monitoring_batch_size : int
        Size of monitoring batches.
    monitoring_batches : WRITEME
    monitoring_dataset : Dataset or dict, optional
        A Dataset or a dictionary mapping string dataset names to Datasets
    termination_criterion : WRITEME
    set_batch_size : bool, optional
        If True, BGD will attempt to override the model's
        `force_batch_size` attribute by calling set_batch_size on it.
    reset_alpha : bool, optional
        Passed through to the optimization.BatchGradientDescent's
        `reset_alpha` parameter
    conjugate : bool, optional
        Passed through to the optimization.BatchGradientDescent's
        `conjugate` parameter
    min_init_alpha : float, optional
        WRITEME
    reset_conjugate : bool, optional
        Passed through to the optimization.BatchGradientDescent's
        `reset_conjugate` parameter
    line_search_mode : WRITEME
    verbose_optimization : bool, optional
        WRITEME
    scale_step : float, optional
        WRITEME
    theano_function_mode : WRITEME
    init_alpha : WRITEME
    seed : WRITEME
     __init__ N/A N/A self cost batch_size batches_per_iter updates_per_batch monitoring_batch_size monitoring_batches monitoring_dataset termination_criterion set_batch_size reset_alpha conjugate min_init_alpha reset_conjugate line_search_mode verbose_optimization scale_step theano_function_mode init_alpha seed N/A None None None 10 None None None None False True False 0.001 True None False 1.0 None None None N/A N/A N/A N/A N/A self __dict__ update N/A locals N/A N/A self self N/A N/A monitoring_dataset None N/A N/A N/A monitoring_batches None N/A N/A monitoring_batch_size None N/A N/A N/A self _set_monitoring_dataset monitoring_dataset N/A N/A self bSetup False N/A N/A self termination_criterion termination_criterion N/A N/A self rng N/A make_np_rng seed N/A 2012 10 16 which_method N/A randn randint N/A setup N/A N/A self model dataset N/A N/A N/A 
        Allows the training algorithm to do some preliminary configuration
        *before* we actually start training the model. The dataset is provided
        in case other derived training algorithms need to modify model based on
        the dataset.

        Parameters
        ----------
        model : object
            A Python object representing the model to train. Loosely
            implementing the interface of models.model.Model.
        dataset : pylearn2.datasets.dataset.Dataset
            Dataset object used to draw training data
         N/A N/A self model model N/A N/A N/A self cost None N/A N/A N/A self cost N/A N/A model get_default_cost N/A N/A N/A N/A N/A N/A self cost is_stochastic N/A N/A N/A TypeError BGD is not compatible with stochastic costs. N/A N/A N/A NotImplementedError N/A N/A N/A N/A warnings warn BGD is not compatible with stochastic costs and cannot determine whether the current cost is stochastic. N/A N/A N/A self batch_size None N/A N/A N/A self batch_size N/A model force_batch_size N/A N/A batch_size N/A self batch_size N/A N/A self set_batch_size N/A N/A N/A N/A model set_batch_size batch_size N/A N/A N/A hasattr model force_batch_size N/A N/A N/A N/A N/A N/A model force_batch_size None N/A N/A model force_batch_size 0 N/A batch_size N/A model force_batch_size N/A N/A N/A ValueError N/A batch_size is %d but  N/A model.force_batch_size is %d N/A batch_size N/A model force_batch_size N/A N/A self monitor N/A N/A Monitor get_monitor model N/A N/A N/A N/A self monitor set_theano_function_mode N/A self theano_function_mode N/A data_specs N/A N/A N/A self cost get_data_specs model N/A mapping N/A DataSpecsMapping data_specs N/A space_tuple N/A N/A mapping flatten N/A data_specs N/A 0 return_tuple True N/A source_tuple N/A N/A mapping flatten N/A data_specs N/A 1 return_tuple True N/A theano_args N/A N/A N/A space source N/A safe_zip space_tuple source_tuple N/A N/A name N/A BGD_[%s] source N/A arg N/A N/A space make_theano_batch name name N/A N/A N/A theano_args append arg N/A theano_args N/A tuple theano_args N/A nested_args N/A N/A mapping nest theano_args N/A fixed_var_descr N/A N/A N/A self cost get_fixed_var_descr model nested_args N/A N/A self on_load_batch N/A fixed_var_descr on_load_batch N/A cost_value N/A N/A N/A self cost expr model nested_args N/A fixed_var_descr fixed_vars N/A N/A grads grad_updates N/A N/A N/A self cost get_gradients model nested_args N/A fixed_var_descr fixed_vars N/A N/A isinstance grads OrderedDict N/A N/A isinstance grad_updates OrderedDict N/A N/A cost_value None N/A N/A N/A ValueError N/A N/A N/A BGD is incompatible with  N/A str N/A self cost  because it is intractable, but BGD uses the  cost function value to do line searches. capture N/A N/A f mapping N/A mapping N/A N/A new_f N/A N/A N/A N/A args N/A f N/A N/A mapping flatten args return_tuple True N/A new_f N/A N/A obj_prereqs N/A N/A capture f N/A f N/A fixed_var_descr on_load_batch N/A N/A N/A self monitoring_dataset None N/A N/A N/A N/A N/A self monitoring_batch_size None N/A N/A self monitoring_batches None N/A N/A N/A self monitoring_batch_size N/A self batch_size N/A N/A self monitoring_batches N/A self batches_per_iter N/A N/A N/A N/A self monitor setup dataset N/A self monitoring_dataset cost N/A self cost batch_size N/A self monitoring_batch_size num_batches N/A self monitoring_batches obj_prereqs obj_prereqs cost_monitoring_args N/A fixed_var_descr fixed_vars N/A params N/A N/A model get_params N/A N/A self optimizer N/A BatchGradientDescent objective cost_value gradients grads gradient_updates grad_updates params params param_constrainers N/A N/A model modify_updates lr_scalers N/A N/A model get_lr_scalers inputs theano_args verbose N/A self verbose_optimization max_iter N/A self updates_per_batch reset_alpha N/A self reset_alpha conjugate N/A self conjugate reset_conjugate N/A self reset_conjugate min_init_alpha N/A self min_init_alpha line_search_mode N/A self line_search_mode theano_function_mode N/A self theano_function_mode init_alpha N/A self init_alpha N/A N/A N/A self monitoring_dataset None N/A N/A N/A N/A N/A self monitor add_channel name ave_step_size ipt None val N/A N/A self optimizer ave_step_size data_specs N/A N/A NullSpace dataset N/A first_value N/A self monitoring_dataset N/A N/A N/A N/A self monitor add_channel name ave_grad_size ipt None val N/A N/A self optimizer ave_grad_size data_specs N/A N/A NullSpace dataset N/A first_value N/A self monitoring_dataset N/A N/A N/A N/A self monitor add_channel name ave_grad_mult ipt None val N/A N/A self optimizer ave_grad_mult data_specs N/A N/A NullSpace dataset N/A first_value N/A self monitoring_dataset N/A N/A self first True N/A N/A self bSetup True N/A train N/A N/A self dataset N/A N/A N/A 
        .. todo::

            WRITEME
         N/A N/A self bSetup N/A model N/A self model N/A rng N/A self rng N/A train_iteration_mode shuffled_sequential N/A N/A N/A is_stochastic train_iteration_mode N/A N/A rng None N/A data_specs N/A N/A N/A self cost get_data_specs N/A self model N/A mapping N/A DataSpecsMapping data_specs N/A space_tuple N/A N/A mapping flatten N/A data_specs N/A 0 return_tuple True N/A source_tuple N/A N/A mapping flatten N/A data_specs N/A 1 return_tuple True N/A N/A N/A len space_tuple 0 N/A N/A N/A NotImplementedError N/A Unable to train with BGD, because the cost does not actually use data from the data set. data_specs: %s N/A str data_specs N/A flat_data_specs N/A N/A CompositeSpace space_tuple source_tuple N/A iterator N/A N/A dataset iterator mode train_iteration_mode batch_size N/A self batch_size num_batches N/A self batches_per_iter data_specs flat_data_specs return_tuple True rng rng N/A mode N/A self theano_function_mode N/A data iterator N/A N/A N/A N/A targets source_tuple N/A mode None N/A hasattr mode record N/A N/A Y N/A data N/A N/A N/A source_tuple index targets N/A stry N/A N/A N/A str Y replace N/A N/A N/A N/A mode record handle_line N/A N/A data Y  stry N/A on_load_batch N/A self on_load_batch N/A N/A N/A on_load_batch N/A N/A mapping nest data N/A N/A N/A self before_step model N/A N/A N/A N/A self optimizer minimize data N/A N/A N/A self after_step model N/A actual_batch_size N/A N/A N/A flat_data_specs N/A 0 np_batch_size data N/A N/A N/A N/A model monitor report_batch actual_batch_size N/A continue_learning N/A N/A self model N/A N/A N/A 
        .. todo::

            WRITEME
         N/A N/A N/A self termination_criterion None N/A N/A True N/A N/A rval N/A N/A N/A self termination_criterion continue_learning N/A self model N/A N/A rval N/A True False 0 1 N/A rval N/A before_step N/A N/A self model N/A N/A N/A 
        .. todo::

            WRITEME
         N/A N/A N/A self scale_step 1.0 N/A N/A N/A self params N/A list N/A N/A model get_params N/A N/A self value N/A N/A N/A param get_value N/A param N/A self params N/A after_step N/A N/A self model N/A N/A N/A 
        .. todo::

            WRITEME
         N/A N/A N/A self scale_step 1 N/A N/A N/A param value N/A safe_zip N/A self params N/A self value N/A N/A value N/A N/A N/A 1.0 N/A self scale_step value N/A N/A self scale_step N/A N/A param get_value N/A N/A N/A param set_value value N/A N/A StepShrinker N/A TrainExtension TerminationCriterion N/A N/A 
    .. todo::

        WRITEME
     __init__ N/A N/A self channel scale giveup_after scale_up max_scale N/A 1.0 1.0 N/A N/A N/A N/A N/A self __dict__ update N/A locals N/A N/A self self N/A N/A self continue_learning True N/A N/A self first True N/A N/A self prev N/A np inf N/A on_monitor N/A N/A self model dataset algorithm N/A N/A N/A 
        .. todo::

            WRITEME
         N/A monitor N/A model monitor N/A N/A self first N/A N/A N/A self first False N/A N/A self monitor_channel N/A sharedX N/A algorithm scale_step N/A hack N/A N/A N/A N/A monitor channels values N/A 0 N/A N/A N/A monitor add_channel scale_step N/A hack graph_input N/A self monitor_channel dataset N/A hack dataset data_specs N/A hack data_specs N/A channel N/A N/A monitor channels N/A N/A self channel N/A v N/A channel val_record N/A N/A N/A len v 1 N/A N/A N/A latest N/A v N/A -1 N/A N/A N/A logger info N/A N/A Latest {0}: {1} format N/A self channel latest N/A N/A N/A logger info N/A N/A Previous is {0} format N/A self prev N/A cur N/A algorithm scale_step N/A N/A latest N/A self prev N/A N/A N/A N/A logger info N/A N/A Looks like using {0} isn't working out so great for us. format cur N/A cur N/A self scale N/A N/A cur N/A self giveup_after N/A N/A N/A N/A logger info Guess we just have to give up. N/A N/A self continue_learning False N/A cur N/A self giveup_after N/A N/A N/A logger info N/A N/A Let's see how {0} does. format cur N/A N/A N/A N/A latest N/A self prev N/A N/A self scale_up 1.0 N/A N/A N/A N/A logger info Looks like we're making progress on the validation set, let's try speeding up N/A cur N/A self scale_up N/A N/A cur N/A self max_scale N/A N/A cur N/A self max_scale N/A N/A N/A logger info N/A N/A New scale is {0} format cur N/A N/A algorithm scale_step cur N/A N/A N/A N/A self monitor_channel set_value N/A N/A N/A np cast N/A N/A config floatX cur N/A N/A self prev latest N/A __call__ N/A N/A self model N/A N/A N/A 
        .. todo::

            WRITEME
         N/A N/A self continue_learning N/A N/A ScaleStep N/A TrainExtension N/A N/A 
    .. todo::

        WRITEME
     __init__ N/A N/A self scale min_value N/A N/A N/A N/A self scale scale N/A N/A self min_value min_value N/A N/A self first True N/A on_monitor N/A N/A self model dataset algorithm N/A N/A N/A 
        .. todo::

            WRITEME
         N/A N/A self first N/A N/A monitor N/A model monitor N/A N/A self first False N/A N/A self monitor_channel N/A sharedX N/A algorithm scale_step N/A hack N/A N/A N/A N/A monitor channels values N/A 0 N/A N/A N/A monitor add_channel scale_step N/A hack graph_input N/A self monitor_channel dataset N/A hack dataset N/A cur N/A algorithm scale_step N/A cur N/A self scale N/A cur N/A max cur N/A self min_value N/A N/A algorithm scale_step cur N/A N/A N/A N/A self monitor_channel set_value N/A N/A N/A np cast N/A N/A config floatX cur N/A N/A BacktrackingStepShrinker N/A TrainExtension TerminationCriterion N/A N/A 
    .. todo::

        WRITEME
     __init__ N/A N/A self channel scale giveup_after scale_up max_scale N/A 1.0 1.0 N/A N/A N/A N/A N/A self __dict__ update N/A locals N/A N/A self self N/A N/A self continue_learning True N/A N/A self first True N/A N/A self prev N/A np inf N/A on_monitor N/A N/A self model dataset algorithm N/A N/A N/A 
        .. todo::

            WRITEME
         N/A monitor N/A model monitor N/A N/A self first N/A N/A N/A self first False N/A N/A self monitor_channel N/A sharedX N/A algorithm scale_step N/A hack N/A N/A N/A N/A monitor channels values N/A 0 N/A N/A N/A monitor add_channel scale_step N/A hack graph_input N/A self monitor_channel dataset N/A hack dataset N/A channel N/A N/A monitor channels N/A N/A self channel N/A v N/A channel val_record N/A N/A N/A len v 1 N/A N/A N/A latest N/A v N/A -1 N/A N/A N/A logger info N/A N/A Latest {0}: {1} format N/A self channel latest N/A N/A N/A logger info N/A N/A Previous is {0} format N/A self prev N/A cur N/A algorithm scale_step N/A N/A latest N/A self prev N/A N/A N/A N/A logger info N/A N/A Looks like using {0} isn't working out so great for us. format cur N/A cur N/A self scale N/A N/A cur N/A self giveup_after N/A N/A N/A N/A logger info Guess we just have to give up. N/A N/A self continue_learning False N/A cur N/A self giveup_after N/A N/A N/A logger info N/A N/A Let's see how {0} does. format cur N/A N/A N/A logger info Reloading saved params from last call N/A N/A p v N/A safe_zip N/A N/A model get_params N/A self stored_values N/A N/A N/A N/A p set_value v N/A latest N/A self prev N/A N/A N/A N/A latest N/A self prev N/A N/A self scale_up 1.0 N/A N/A N/A N/A logger info Looks like we're making progress on the validation set, let's try speeding up N/A cur N/A self scale_up N/A N/A cur N/A self max_scale N/A N/A cur N/A self max_scale N/A N/A N/A logger info N/A N/A New scale is {0} format cur N/A N/A algorithm scale_step cur N/A N/A N/A N/A self monitor_channel set_value N/A N/A N/A np cast N/A N/A config floatX cur N/A N/A self prev latest N/A N/A self stored_values N/A N/A N/A param get_value N/A param N/A N/A model get_params N/A __call__ N/A N/A self model N/A N/A N/A 
        .. todo::

            WRITEME
         N/A N/A self continue_learning N/A N/A