Module ImportFrom alias alias alias ImportFrom alias ImportFrom alias Import alias identifier Import alias Import alias Assign NameStore ListLoad Str Str Str Str Str FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults Num Num Num TupleLoad Num Num NameLoad body Assert BoolOpOr CompareNotEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num CompareEq NameLoad NameLoad Str Assert BoolOpOr CompareNotEq NameLoad NameLoad CompareEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num AttributeLoad NameLoad attr Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore AttributeLoad Call NameLoad NameLoad NameLoad keyword NameLoad attr Assign NameStore BinOpMult NameLoad SubscriptLoad NameLoad Index Num Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore SubscriptLoad Call NameLoad Call NameLoad AttributeLoad NameLoad attr Slice Num Assign NameStore Num Assign NameStore Call NameLoad SubscriptLoad AttributeLoad NameLoad attr Index Num While BoolOpAnd CompareGt NameLoad NameLoad CompareLt NameLoad NameLoad body AugAssignAdd NameStore Num For NameStore NameLoad body Assign NameStore Call NameLoad SubscriptLoad NameLoad Index NameLoad IfExp CompareGt NameLoad Num NameLoad NameLoad Assign NameStore BinOpAdd BinOpMult UnaryOpUSub NameLoad AttributeLoad BinOpDiv Call AttributeLoad NameLoad attr NameLoad Call NameLoad SubscriptLoad NameLoad Index NameLoad NameLoad attr BinOpMult NameLoad SubscriptLoad NameLoad Index NameLoad If CompareNotEq NameLoad Num body Expr Str Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad ExtSlice Slice Num Slice NameLoad Assign NameStore BinOpMult NameLoad SubscriptLoad NameLoad Index BinOpSub NameLoad Num Assign SubscriptStore NameLoad Index NameLoad NameLoad AugAssignAdd SubscriptStore AttributeLoad NameLoad attr Index NameLoad NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore AttributeLoad Call NameLoad NameLoad NameLoad keyword NameLoad attr Assign NameStore BinOpMult NameLoad SubscriptLoad NameLoad Index Num Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad If CompareEq BinOpMod NameLoad Num Num body Print Str NameLoad Str NameLoad Print Str Print BinOpMod Str TupleLoad NameLoad NameLoad Print BinOpMod Str Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad Print BinOpMod Str NameLoad If BoolOpAnd NameLoad Call NameLoad keyword Str body Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults Num TupleLoad Num Num Num Num Num NameLoad body Assert BoolOpOr CompareNotEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num CompareEq NameLoad NameLoad Str Assert BoolOpOr CompareNotEq NameLoad NameLoad CompareEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num AttributeLoad NameLoad attr Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore ListComp Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad comprehension NameStore AttributeLoad NameLoad attr Assign NameStore ListComp Call AttributeLoad NameLoad attr keyword AttributeLoad NameLoad attr comprehension NameStore AttributeLoad NameLoad attr Assign NameStore BinOpMult ListLoad Num Call NameLoad AttributeLoad NameLoad attr Assign NameStore TupleLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore AttributeLoad Call NameLoad NameLoad NameLoad keyword NameLoad attr Assign NameStore BinOpMult NameLoad SubscriptLoad NameLoad Index Num Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad Assign NameStore Call NameLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Assign NameStore SubscriptLoad Call NameLoad Call NameLoad AttributeLoad NameLoad attr Slice Num Assign NameStore Num While BoolOpAnd CompareGt NameLoad NameLoad CompareLt NameLoad NameLoad body AugAssignAdd NameStore Num For NameStore NameLoad body Assign NameStore AttributeLoad BinOpDiv Call AttributeLoad NameLoad attr NameLoad Call NameLoad SubscriptLoad NameLoad Index NameLoad NameLoad attr If CompareNotEq NameLoad Num body Expr Str Assign NameStore Call AttributeLoad NameLoad attr SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index NameLoad ExtSlice Slice Num Slice NameLoad Assign NameStore BinOpMult NameLoad SubscriptLoad NameLoad Index BinOpSub NameLoad Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad SubscriptLoad NameLoad Index NameLoad Assign NameStore Call AttributeLoad NameLoad attr CompareGt NameLoad Num Assign NameStore Call AttributeLoad NameLoad attr CompareLt NameLoad Num Assign NameStore Call AttributeLoad NameLoad attr CompareEq NameLoad Num If Call AttributeLoad NameLoad attr NameLoad body Assign SubscriptStore SubscriptLoad NameLoad Index NameLoad Index NameLoad Call AttributeLoad NameLoad attr BinOpMult SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index NameLoad NameLoad NameLoad Assign SubscriptStore SubscriptLoad NameLoad Index NameLoad Index NameLoad Call AttributeLoad NameLoad attr UnaryOpUSub Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index NameLoad SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index NameLoad AugAssignAdd SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index NameLoad SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index NameLoad If Call AttributeLoad NameLoad attr NameLoad body Assign SubscriptStore SubscriptLoad NameLoad Index NameLoad Index NameLoad Call AttributeLoad NameLoad attr BinOpMult SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index NameLoad NameLoad NameLoad If CompareGt NameLoad NameLoad body AugAssignSub SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index NameLoad SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index NameLoad Assign SubscriptStore NameLoad Index NameLoad Num If Call AttributeLoad NameLoad attr NameLoad body Assign SubscriptStore SubscriptLoad NameLoad Index NameLoad Index NameLoad Call AttributeLoad NameLoad attr UnaryOpUSub Call AttributeLoad NameLoad attr SubscriptLoad NameLoad Index NameLoad SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index NameLoad AugAssignAdd SubscriptStore SubscriptLoad AttributeLoad NameLoad attr Index NameLoad Index NameLoad SubscriptLoad SubscriptLoad NameLoad Index NameLoad Index NameLoad Assign SubscriptStore NameLoad Index NameLoad NameLoad Assign NameStore NameLoad Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad keyword NameLoad Assign NameStore SubscriptLoad NameLoad Index Num Assign NameStore AttributeLoad Call NameLoad NameLoad NameLoad keyword NameLoad attr Assign NameStore BinOpMult NameLoad SubscriptLoad NameLoad Index Num Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad If CompareEq BinOpMod NameLoad Num Num body Print Str NameLoad Str NameLoad Print Str Print BinOpMod Str TupleLoad NameLoad NameLoad Print BinOpMod Str Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad Print BinOpMod Str NameLoad If BoolOpAnd NameLoad Call NameLoad keyword Str body Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Str NameLoad body ImportFrom alias Assert BoolOpOr CompareNotEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num CompareEq NameLoad NameLoad Str Assert BoolOpOr CompareNotEq NameLoad NameLoad CompareEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num AttributeLoad NameLoad attr Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Lambda arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Assign NameStore Lambda arguments args NameParam NameParam NameParam NameParam NameParam NameParam defaults Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Assign NameStore Call NameLoad NameLoad Call AttributeLoad NameLoad attr keyword NameLoad keyword NameLoad keyword TupleLoad NameLoad NameLoad NameLoad NameLoad NameLoad Expr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr If UnaryOpNot AttributeLoad NameLoad attr body Print Str AttributeLoad NameLoad attr Print BinOpMod Str AttributeLoad NameLoad attr orelse Print Str Print BinOpMod Str AttributeLoad NameLoad attr Print BinOpMod Str Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad If BoolOpAnd NameLoad Call NameLoad keyword Str body Expr Call AttributeLoad NameLoad attr decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam NameParam NameParam defaults Num TupleLoad NameLoad body Assert BoolOpOr CompareNotEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num CompareEq NameLoad NameLoad Str Assert BoolOpOr CompareNotEq NameLoad NameLoad CompareEq NameLoad SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num AttributeLoad NameLoad attr Str Assert CompareEq SubscriptLoad AttributeLoad AttributeLoad SubscriptLoad NameLoad Index Num attr attr Index Num SubscriptLoad SubscriptLoad AttributeLoad NameLoad attr Index Num Index Num Str Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr ListComp AttributeLoad NameLoad attr comprehension NameStore NameLoad Assign NameStore Num Assign NameStore Num Assign NameStore Num Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call NameLoad NameLoad Assign NameStore UnaryOpUSub Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Assign NameStore NameLoad Assign NameStore NameLoad Assign NameStore Num While CompareLt NameLoad NameLoad body AugAssignAdd NameStore Num Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad If NameLoad body Assign NameStore NameLoad Assign NameStore BinOpDiv NameLoad Call AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpDiv BinOpSub Call AttributeLoad NameLoad attr BinOpAdd NameLoad BinOpMult NameLoad NameLoad NameLoad NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad NameLoad Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpSub NameLoad NameLoad AugAssignAdd NameStore BinOpMult NameLoad NameLoad AugAssignAdd NameStore BinOpMult NameLoad NameLoad If CompareLt NameLoad Num body AugAssignAdd NameStore BinOpMult BinOpSub NameLoad BinOpDiv BinOpMult Num NameLoad NameLoad NameLoad Assign NameStore BinOpMult Num BinOpSub NameLoad BinOpDiv NameLoad NameLoad AugAssignSub NameStore BinOpMult NameLoad NameLoad AugAssignMult NameStore Num Assign NameStore NameLoad Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr NameLoad Assign NameStore BinOpDiv NameLoad NameLoad Assign NameStore BinOpAdd NameLoad BinOpMult NameLoad NameLoad Assign TupleStore NameStore NameStore TupleLoad Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Assign NameStore BinOpDiv BinOpMult BinOpMult Num NameLoad BinOpSub NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad Num If CompareGtE NameLoad Num body If CompareLt NameLoad NameLoad body Break Assign NameStore NameLoad Assign NameStore NameLoad Assign NameStore UnaryOpUSub Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad Assign NameStore NameLoad Assign NameStore Num If CompareEq BinOpMod NameLoad NameLoad Num body Assign NameStore NameLoad orelse Assign NameStore BinOpDiv BinOpSub Call AttributeLoad NameLoad attr NameLoad NameLoad Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad Assign NameStore BinOpAdd NameLoad BinOpMult NameLoad NameLoad If CompareGt NameLoad Num body Assign NameStore BinOpMult Num NameLoad orelse Assign NameStore NameLoad If CompareLt NameLoad Num body Assign NameStore BinOpMult Num NameLoad If CompareEq BinOpMod NameLoad Num Num body Print Str NameLoad Str NameLoad Expr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr NameLoad Print Str Print BinOpMod Str TupleLoad NameLoad NameLoad Print BinOpMod Str Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad Print BinOpMod Str NameLoad If BoolOpAnd NameLoad Call NameLoad keyword Str body Expr Call AttributeLoad NameLoad attr decorator_list
N/A tools dropout add_bias confirm activation_functions softmax_function cost_functions softmax_neg_loss N/A numpy np N/A collections N/A math N/A all N/A backpropagation scaled_conjugate_gradient scipyoptimize resilient_backpropagation generalized_hebbian backpropagation N/A N/A network trainingset testset cost_function ERROR_LIMIT learning_rate momentum_factor max_iterations input_layer_dropout hidden_layer_dropout save_trained_network N/A 0.001 0.03 0.9 N/A 0.0 0.0 False N/A N/A N/A N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 N/A cost_function softmax_neg_loss When using the `softmax` activation function, the cost function MUST be `softmax_neg_loss`. N/A N/A N/A cost_function softmax_neg_loss N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 When using the `softmax_neg_loss` cost function, the activation function in the final layer MUST be `softmax`. N/A N/A N/A N/A N/A N/A trainingset N/A 0 features shape N/A 0 N/A network n_inputs ERROR: input size varies from the defined input setting N/A N/A N/A N/A N/A N/A trainingset N/A 0 targets shape N/A 0 N/A N/A N/A network layers N/A -1 N/A 0 ERROR: output size varies from the defined output setting N/A training_data N/A N/A np array N/A N/A instance features N/A instance trainingset N/A training_targets N/A N/A np array N/A N/A instance targets N/A instance trainingset N/A test_data N/A N/A np array N/A N/A instance features N/A instance testset N/A test_targets N/A N/A np array N/A N/A instance targets N/A instance testset N/A momentum N/A N/A collections defaultdict int N/A N/A input_signals derivatives N/A N/A network update training_data trace True N/A out N/A input_signals N/A -1 N/A cost_derivative N/A N/A cost_function out training_targets derivative True T N/A delta N/A cost_derivative N/A derivatives N/A -1 N/A error N/A cost_function N/A N/A network update test_data test_targets N/A layer_indexes N/A N/A range N/A len N/A network layers N/A -1 N/A epoch 0 N/A n_samples N/A float N/A N/A training_data shape N/A 0 N/A N/A N/A error ERROR_LIMIT N/A epoch max_iterations N/A N/A epoch 1 N/A i layer_indexes N/A N/A dropped N/A dropout N/A input_signals N/A i N/A N/A i 0 hidden_layer_dropout input_layer_dropout N/A dW N/A N/A N/A learning_rate N/A N/A N/A N/A np dot delta N/A add_bias N/A input_signals N/A i n_samples T N/A momentum_factor N/A momentum N/A i N/A N/A i 0 N/A N/A Do not calculate the delta unnecessarily. N/A weight_delta N/A N/A np dot N/A N/A N/A network weights N/A i N/A N/A 1 N/A delta N/A delta N/A weight_delta N/A derivatives N/A N/A i 1 N/A N/A momentum N/A i dW N/A N/A N/A network weights N/A i dW N/A N/A input_signals derivatives N/A N/A network update training_data trace True N/A out N/A input_signals N/A -1 N/A cost_derivative N/A N/A cost_function out training_targets derivative True T N/A delta N/A cost_derivative N/A derivatives N/A -1 N/A error N/A cost_function N/A N/A network update test_data test_targets N/A N/A N/A epoch 1000 0 N/A N/A [training] Current error: error 	Epoch: epoch N/A [training] Finished: N/A N/A [training]   Converged to error bound (%.4g) with error %.4g. N/A ERROR_LIMIT error N/A N/A [training]   Measured quality: %.4g N/A N/A network measure_quality training_data training_targets cost_function N/A N/A [training]   Trained for %d epochs. epoch N/A N/A save_trained_network N/A confirm promt Do you wish to store the trained network? N/A N/A N/A N/A network save_network_to_file N/A resilient_backpropagation N/A N/A network trainingset testset cost_function ERROR_LIMIT max_iterations weight_step_max weight_step_min start_step learn_max learn_min save_trained_network N/A 0.001 N/A 50.0 0.0 0.5 1.2 0.5 False N/A N/A N/A N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 N/A cost_function softmax_neg_loss When using the `softmax` activation function, the cost function MUST be `softmax_neg_loss`. N/A N/A N/A cost_function softmax_neg_loss N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 When using the `softmax_neg_loss` cost function, the activation function in the final layer MUST be `softmax`. N/A N/A N/A N/A N/A N/A trainingset N/A 0 features shape N/A 0 N/A network n_inputs ERROR: input size varies from the defined input setting N/A N/A N/A N/A N/A N/A trainingset N/A 0 targets shape N/A 0 N/A N/A N/A network layers N/A -1 N/A 0 ERROR: output size varies from the defined output setting N/A training_data N/A N/A np array N/A N/A instance features N/A instance trainingset N/A training_targets N/A N/A np array N/A N/A instance targets N/A instance trainingset N/A test_data N/A N/A np array N/A N/A instance features N/A instance testset N/A test_targets N/A N/A np array N/A N/A instance targets N/A instance testset N/A weight_step N/A N/A N/A np full N/A weight_layer shape start_step N/A weight_layer N/A network weights N/A dW N/A N/A N/A np ones shape N/A weight_layer shape N/A weight_layer N/A network weights N/A previous_dEdW N/A N/A 1 N/A len N/A network weights N/A prev_error N/A N/A N/A input_signals derivatives N/A N/A network update training_data trace True N/A out N/A input_signals N/A -1 N/A cost_derivative N/A N/A cost_function out training_targets derivative True T N/A delta N/A cost_derivative N/A derivatives N/A -1 N/A error N/A cost_function N/A N/A network update test_data test_targets N/A n_samples N/A float N/A N/A training_data shape N/A 0 N/A layer_indexes N/A N/A range N/A len N/A network layers N/A -1 N/A epoch 0 N/A N/A N/A error ERROR_LIMIT N/A epoch max_iterations N/A N/A epoch 1 N/A i layer_indexes N/A N/A dEdW N/A N/A N/A N/A np dot delta N/A add_bias N/A input_signals N/A i n_samples T N/A N/A i 0 N/A N/A Do not calculate the delta unnecessarily. N/A weight_delta N/A N/A np dot N/A N/A N/A network weights N/A i N/A N/A 1 N/A delta N/A delta N/A weight_delta N/A derivatives N/A N/A i 1 N/A diffs N/A N/A np multiply dEdW N/A previous_dEdW N/A i N/A pos_indexes N/A N/A np where N/A diffs 0 N/A neg_indexes N/A N/A np where N/A diffs 0 N/A zero_indexes N/A N/A np where N/A diffs 0 N/A N/A N/A np any pos_indexes N/A N/A N/A N/A weight_step N/A i N/A pos_indexes N/A N/A np minimum N/A N/A N/A weight_step N/A i N/A pos_indexes learn_max weight_step_max N/A N/A N/A dW N/A i N/A pos_indexes N/A N/A np multiply N/A N/A N/A np sign N/A dEdW N/A pos_indexes N/A N/A weight_step N/A i N/A pos_indexes N/A N/A N/A N/A network weights N/A i N/A pos_indexes N/A N/A dW N/A i N/A pos_indexes N/A N/A N/A np any neg_indexes N/A N/A N/A N/A weight_step N/A i N/A neg_indexes N/A N/A np maximum N/A N/A N/A weight_step N/A i N/A neg_indexes learn_min weight_step_min N/A N/A error prev_error N/A N/A N/A N/A N/A network weights N/A i N/A neg_indexes N/A N/A dW N/A i N/A neg_indexes N/A N/A dEdW N/A neg_indexes 0 N/A N/A N/A np any zero_indexes N/A N/A N/A N/A dW N/A i N/A zero_indexes N/A N/A np multiply N/A N/A N/A np sign N/A dEdW N/A zero_indexes N/A N/A weight_step N/A i N/A zero_indexes N/A N/A N/A N/A network weights N/A i N/A zero_indexes N/A N/A dW N/A i N/A zero_indexes N/A N/A previous_dEdW N/A i dEdW N/A prev_error error N/A N/A input_signals derivatives N/A N/A network update training_data trace True N/A out N/A input_signals N/A -1 N/A cost_derivative N/A N/A cost_function out training_targets derivative True T N/A delta N/A cost_derivative N/A derivatives N/A -1 N/A error N/A cost_function N/A N/A network update test_data test_targets N/A N/A N/A epoch 1000 0 N/A N/A [training] Current error: error 	Epoch: epoch N/A [training] Finished: N/A N/A [training]   Converged to error bound (%.4g) with error %.4g. N/A ERROR_LIMIT error N/A N/A [training]   Measured quality: %.4g N/A N/A network measure_quality training_data training_targets cost_function N/A N/A [training]   Trained for %d epochs. epoch N/A N/A save_trained_network N/A confirm promt Do you wish to store the trained network? N/A N/A N/A N/A network save_network_to_file N/A scipyoptimize N/A N/A network trainingset testset cost_function method save_trained_network N/A Newton-CG False N/A scipy.optimize minimize N/A N/A N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 N/A cost_function softmax_neg_loss When using the `softmax` activation function, the cost function MUST be `softmax_neg_loss`. N/A N/A N/A cost_function softmax_neg_loss N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 When using the `softmax_neg_loss` cost function, the activation function in the final layer MUST be `softmax`. N/A N/A N/A N/A N/A N/A trainingset N/A 0 features shape N/A 0 N/A network n_inputs ERROR: input size varies from the defined input setting N/A N/A N/A N/A N/A N/A trainingset N/A 0 targets shape N/A 0 N/A N/A N/A network layers N/A -1 N/A 0 ERROR: output size varies from the defined output setting N/A training_data N/A N/A np array N/A N/A instance features N/A instance trainingset N/A training_targets N/A N/A np array N/A N/A instance targets N/A instance trainingset N/A test_data N/A N/A np array N/A N/A instance features N/A instance testset N/A test_targets N/A N/A np array N/A N/A instance targets N/A instance testset N/A error_function_wrapper N/A N/A N/A weights training_data training_targets test_data test_targets cost_function N/A N/A N/A network error weights test_data test_targets cost_function N/A gradient_function_wrapper N/A N/A N/A weights training_data training_targets test_data test_targets cost_function N/A N/A N/A network gradient weights training_data training_targets cost_function N/A results N/A minimize error_function_wrapper N/A N/A network get_weights method method jac gradient_function_wrapper args N/A training_data training_targets test_data test_targets cost_function N/A N/A N/A network set_weights N/A results x N/A N/A N/A results success N/A N/A [training] WARNING: N/A results message N/A N/A [training]   Terminated with error %.4g. N/A results fun N/A N/A [training] Finished: N/A N/A [training]   Completed with error %.4g. N/A results fun N/A N/A [training]   Measured quality: %.4g N/A N/A network measure_quality training_data training_targets cost_function N/A N/A save_trained_network N/A confirm promt Do you wish to store the trained network? N/A N/A N/A N/A network save_network_to_file N/A scaled_conjugate_gradient N/A N/A network trainingset testset cost_function ERROR_LIMIT max_iterations save_trained_network N/A 1e-06 N/A False N/A N/A N/A N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 N/A cost_function softmax_neg_loss When using the `softmax` activation function, the cost function MUST be `softmax_neg_loss`. N/A N/A N/A cost_function softmax_neg_loss N/A softmax_function N/A N/A N/A network layers N/A -1 N/A 1 When using the `softmax_neg_loss` cost function, the activation function in the final layer MUST be `softmax`. N/A N/A N/A N/A N/A N/A trainingset N/A 0 features shape N/A 0 N/A network n_inputs ERROR: input size varies from the defined input setting N/A N/A N/A N/A N/A N/A trainingset N/A 0 targets shape N/A 0 N/A N/A N/A network layers N/A -1 N/A 0 ERROR: output size varies from the defined output setting N/A training_data N/A N/A np array N/A N/A instance features N/A instance trainingset N/A training_targets N/A N/A np array N/A N/A instance targets N/A instance trainingset N/A test_data N/A N/A np array N/A N/A instance features N/A instance testset N/A test_targets N/A N/A np array N/A N/A instance targets N/A instance testset N/A sigma0 1e-06 N/A lamb 1e-06 N/A lamb_ 0 N/A vector N/A N/A network get_weights N/A N N/A len vector N/A grad_new N/A N/A N/A network gradient vector training_data training_targets cost_function N/A r_new grad_new N/A success True N/A k 0 N/A N/A k max_iterations N/A N/A k 1 N/A r N/A N/A np copy r_new N/A grad N/A N/A np copy grad_new N/A mu N/A N/A np dot grad grad N/A success N/A N/A success False N/A sigma N/A sigma0 N/A N/A math sqrt mu N/A s N/A N/A N/A N/A network gradient N/A vector N/A sigma grad training_data training_targets cost_function N/A N/A network gradient vector training_data training_targets cost_function sigma N/A delta N/A N/A np dot N/A grad T s N/A zetta N/A lamb lamb_ N/A s N/A zetta grad N/A delta N/A zetta mu N/A N/A delta 0 N/A N/A s N/A N/A lamb N/A N/A 2 delta mu grad N/A lamb_ N/A 2 N/A lamb N/A delta mu N/A delta N/A lamb mu N/A delta -1 N/A lamb lamb_ N/A phi N/A N/A np dot N/A grad T r N/A alpha N/A phi delta N/A vector_new N/A vector N/A alpha grad N/A N/A f_old f_new N/A N/A N/A network error vector test_data test_targets cost_function N/A N/A network error vector_new test_data test_targets cost_function N/A comparison N/A N/A N/A 2 delta N/A f_old f_new N/A N/A np power phi 2 N/A N/A comparison 0 N/A N/A N/A f_new ERROR_LIMIT N/A N/A N/A vector vector_new N/A f_old f_new N/A r_new N/A N/A N/A network gradient vector training_data training_targets cost_function N/A success True N/A lamb_ 0 N/A N/A N/A k N 0 N/A N/A grad_new r_new N/A N/A beta N/A N/A N/A N/A np dot r_new r_new N/A N/A np dot r_new r phi N/A grad_new N/A r_new N/A beta grad N/A N/A comparison 0.75 N/A N/A lamb N/A 0.5 lamb N/A N/A lamb_ lamb N/A N/A comparison 0.25 N/A N/A lamb N/A 4 lamb N/A N/A N/A k 1000 0 N/A N/A [training] Current error: f_new 	Epoch: k N/A N/A N/A network set_weights N/A N/A np array vector_new N/A [training] Finished: N/A N/A [training]   Converged to error bound (%.4g) with error %.4g. N/A ERROR_LIMIT f_new N/A N/A [training]   Measured quality: %.4g N/A N/A network measure_quality training_data training_targets cost_function N/A N/A [training]   Trained for %d epochs. k N/A N/A save_trained_network N/A confirm promt Do you wish to store the trained network? N/A N/A N/A N/A network save_network_to_file N/A