Module Import alias identifier TryExcept body ImportFrom alias handlers ExceptHandler body Assign NameStore Lambda arguments args NameParam defaults BinOpDiv Num BinOpAdd Num Call AttributeLoad NameLoad attr UnaryOpUSub NameLoad FunctionDef arguments args NameParam NameParam defaults NameLoad body Assign NameStore Call AttributeLoad NameLoad attr BinOpSub NameLoad Call AttributeLoad NameLoad attr NameLoad keyword Num keyword NameLoad Assign NameStore BinOpDiv NameLoad Call AttributeLoad NameLoad attr NameLoad keyword Num keyword NameLoad If NameLoad body Return Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr orelse Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad Num Num Assign NameStore Call NameLoad NameLoad If NameLoad body Return Call AttributeLoad NameLoad attr NameLoad BinOpSub Num NameLoad orelse Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str Assign NameStore Num Assign NameStore BinOpAdd Num Call AttributeLoad NameLoad attr BinOpMult NameLoad NameLoad If NameLoad body Return BinOpDiv BinOpMult Num NameLoad BinOpPow NameLoad Num orelse Return BinOpAdd BinOpDiv BinOpMult Num BinOpMult NameLoad NameLoad NameLoad Num decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str Assign NameStore Num Assign NameStore BinOpAdd Num Call AttributeLoad NameLoad attr BinOpMult NameLoad NameLoad If NameLoad body Return BinOpDiv NameLoad BinOpPow NameLoad Num orelse Return BinOpDiv BinOpMult NameLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body If NameLoad body Return Call AttributeLoad CompareGt NameLoad Num attr NameLoad orelse Return Call AttributeLoad NameLoad attr Num NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad Num body Expr Str If NameLoad body Return Call AttributeLoad NameLoad attr CompareGt NameLoad Num NameLoad Num orelse Assign NameStore Call AttributeLoad NameLoad attr NameLoad AugAssignMult SubscriptStore NameLoad Index CompareLt NameLoad Num NameLoad Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad If NameLoad body Return BinOpSub Num Call AttributeLoad NameLoad attr NameLoad Num orelse Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body If NameLoad body Return Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr orelse Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body If NameLoad body Return BinOpDiv Call AttributeLoad NameLoad attr NameLoad BinOpAdd Num Call AttributeLoad NameLoad attr NameLoad orelse Return Call AttributeLoad NameLoad attr BinOpAdd Num Call AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body If NameLoad body Return BinOpDiv Num BinOpPow BinOpAdd Num Call AttributeLoad NameLoad attr NameLoad Num orelse Return BinOpDiv NameLoad BinOpAdd Num Call AttributeLoad NameLoad attr NameLoad decorator_list
N/A N/A numpy np N/A N/A scipy.special expit N/A N/A N/A N/A expit N/A N/A N/A x N/A N/A 1.0 N/A 1 N/A N/A np exp N/A x softmax_function N/A N/A signal derivative N/A False N/A N/A e_x N/A N/A np exp N/A signal N/A N/A np max signal axis 1 keepdims True N/A signal N/A e_x N/A N/A np sum e_x axis 1 keepdims True N/A derivative N/A N/A N/A N/A np ones N/A signal shape N/A N/A signal N/A sigmoid_function N/A N/A signal derivative N/A False N/A N/A signal N/A N/A np clip signal -500 500 N/A signal N/A expit signal N/A derivative N/A N/A N/A N/A np multiply signal N/A 1 signal N/A N/A signal N/A elliot_function N/A N/A signal derivative N/A False N/A N/A  A fast approximation of sigmoid  N/A s 1 N/A abs_signal N/A 1 N/A N/A np abs N/A signal s N/A derivative N/A N/A N/A N/A 0.5 s N/A abs_signal 2 N/A N/A N/A N/A N/A 0.5 N/A signal s abs_signal 0.5 N/A symmetric_elliot_function N/A N/A signal derivative N/A False N/A N/A  A fast approximation of tanh  N/A s 1.0 N/A abs_signal N/A 1 N/A N/A np abs N/A signal s N/A derivative N/A N/A N/A s N/A abs_signal 2 N/A N/A N/A N/A signal s abs_signal N/A ReLU_function N/A N/A signal derivative N/A False N/A N/A derivative N/A N/A N/A N/A N/A signal 0 astype float N/A N/A N/A N/A np maximum 0 signal N/A LReLU_function N/A N/A signal derivative leakage N/A False 0.01 N/A N/A 
    Leaky Rectified Linear Unit
     N/A derivative N/A N/A N/A N/A np clip N/A signal 0 leakage 1.0 N/A N/A output N/A N/A np copy signal N/A N/A output N/A N/A output 0 leakage N/A output N/A tanh_function N/A N/A signal derivative N/A False N/A N/A signal N/A N/A np tanh signal N/A derivative N/A N/A N/A 1 N/A N/A np power signal 2 N/A N/A signal N/A linear_function N/A N/A signal derivative N/A False N/A N/A derivative N/A N/A N/A N/A np ones N/A signal shape N/A N/A signal N/A softplus_function N/A N/A signal derivative N/A False N/A N/A derivative N/A N/A N/A N/A N/A np exp signal N/A 1 N/A N/A np exp signal N/A N/A N/A N/A np log N/A 1 N/A N/A np exp signal N/A softsign_function N/A N/A signal derivative N/A False N/A N/A derivative N/A N/A N/A 1.0 N/A N/A 1 N/A N/A np abs signal 2 N/A N/A N/A signal N/A 1 N/A N/A np abs signal N/A