Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: A family of gradient descent algorithms for learning linear functions in an online setting is considered. The family includes the classical LMS algorithm as ll as new variants such as the Exponentiated Gradient (EG) algorithm due to Kivinen and Warmuth. The algorithms are based on prior distributions defined on the ight space. Techniques from differential geometry are used to develop the algorithms as gradient descent iterations with respect to the natural gradient in the Riemannian structure induced by the prior distribution. The proposed framework subsumes the notion of "link-functions".
['Robert E. Mahony', 'Robert C. Williamson']
I am writing a research paper on a idea Prior knowledge and preferential structures in gradient descent learning algorithms
[{"from": "human", "value": "I am writing a research paper on a idea Prior knowledge and preferential structures in gradient descent learning algorithms"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: A family of gradient descent algorithms for learning linear functions in an online setting is considered. The family includes the classical LMS algorithm as ll as new variants such as the Exponentiated Gradient (EG) algorithm due to Kivinen and Warmuth. The algorithms are based on prior distributions defined on the ight space. Techniques from differential geometry are used to develop the algorithms as gradient descent iterations with respect to the natural gradient in the Riemannian structure induced by the prior distribution. The proposed framework subsumes the notion of \"link-functions\"."}]