A tiny fashion-mnist model to demostrate the potential of the learnable activation - OptAEG-V1.
The model can reach 90.2% accuracy with only 48.5k parameters.
The OptAEG-V1 learnable activation is based on a theory of Arithmetic Expression Geometry which is still in developing. Please visit the draft papers on theory and neural networks for a reference