Abstract-In this paper, the natural gradient descent method for the multilayer stochastic complex-valued neural networks is considered, and the natural gradient is given for a single stochastic complex-valued neuron as an example. Since the space of the learnable parameters of stochastic complex-valued neural networks is not the Euclidean space but a curved manifold, the complex-valued natural gradient method is expected to exhibit excellent learning performance.
Nitta REF , developed the natural gradient descent method for the multilayer stochastic complex-valued neural networks, and derived the natural gradient for a single stochastic complex-valued neuron.
Natural Gradient Descent for Training Stochastic Complex-Valued Neural Networks
International Journal of Advanced Computer Science and Applications
Computer Science