Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Reinforcement learning aims at learning a policy from interactions with the environment to maximize the long-term reward. In practice,  commonly expect that the policy can be a nonlinear mapping from the state features to the candidate actions, and thus has the ability to fit complex decision situations. Functional representation, by which a function is represented as a combination of basis functions, is a porful tool for learning non-linear functions, and has been used in policy learning (e.g., the non-parametric policy gradient (NPPG) method). Despite the many unique advantages of functional representation, it has a practical defect that a functional represented policy involves a lot of basis functions, and consequently the policy learning algorithm will be costed a lot of time in calculating the many constituting basis functions. This defect will badly hamper the functional representation from being practically applicable in reinforcement learning tasks, as the complex policies are to be continually evaluated. In this work,  proposed the napping mechanism to improve the efficiency of using the functional representation, which periodically simplifies the generated function by a simple approximation model along with the learning process.  integrated the napping mechanism into the NPPG algorithm, and carried out empirical studies. Experiment results shod that the NPPG with napping can not only drastically improve the training and predicting speed from the original NPPG, but also improve the performance significantly.
['Qing Da', 'Yang Yu', 'Zhi-Hua Zhou']
I am writing a research paper on a idea Napping for functional representation of policy
[{"from": "human", "value": "I am writing a research paper on a idea Napping for functional representation of policy"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely: Reinforcement learning aims at learning a policy from interactions with the environment to maximize the long-term reward. In practice,  commonly expect that the policy can be a nonlinear mapping from the state features to the candidate actions, and thus has the ability to fit complex decision situations. Functional representation, by which a function is represented as a combination of basis functions, is a porful tool for learning non-linear functions, and has been used in policy learning (e.g., the non-parametric policy gradient (NPPG) method). Despite the many unique advantages of functional representation, it has a practical defect that a functional represented policy involves a lot of basis functions, and consequently the policy learning algorithm will be costed a lot of time in calculating the many constituting basis functions. This defect will badly hamper the functional representation from being practically applicable in reinforcement learning tasks, as the complex policies are to be continually evaluated. In this work,  proposed the napping mechanism to improve the efficiency of using the functional representation, which periodically simplifies the generated function by a simple approximation model along with the learning process.  integrated the napping mechanism into the NPPG algorithm, and carried out empirical studies. Experiment results shod that the NPPG with napping can not only drastically improve the training and predicting speed from the original NPPG, but also improve the performance significantly."}]