Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: The natural gradient learning method is known to have ideal performances for on-line training of multilayer perceptrons. It avoids plateaus, which give rise to slow convergence of the backpropagation method. It is Fisher efficient, whereas the conventional method is not. Hover, for implementing the method, it is necessary to calculate the Fisher information matrix and its inverse, which is practically very difficult. This article proposes an adaptive method of directly obtaining the inverse of the Fisher information matrix. It generalizes the adaptive Gauss-Newton algorithms and provides a solid theoretical justification of them. Simulations show that the proposed adaptive method works very ll for realizing natural gradient learning.
['Shun-ichi Amari', 'Hyeyoung Park', 'Kenji Fukumizu']
I am writing a research paper on a idea Adaptive Method of Realizing Natural Gradient Learning for Multilayer Perceptrons
[{"from": "human", "value": "I am writing a research paper on a idea Adaptive Method of Realizing Natural Gradient Learning for Multilayer Perceptrons"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: The natural gradient learning method is known to have ideal performances for on-line training of multilayer perceptrons. It avoids plateaus, which give rise to slow convergence of the backpropagation method. It is Fisher efficient, whereas the conventional method is not. Hover, for implementing the method, it is necessary to calculate the Fisher information matrix and its inverse, which is practically very difficult. This article proposes an adaptive method of directly obtaining the inverse of the Fisher information matrix. It generalizes the adaptive Gauss-Newton algorithms and provides a solid theoretical justification of them. Simulations show that the proposed adaptive method works very ll for realizing natural gradient learning."}]