Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely:  consider the problem of average reward optimization in domains with partial observability, within the modeling framework of linear predictive state representations (PSRs) (Littman et al., 2001). The key to average-reward computation is to have a ll-defined stationary behavior of a system, so the required averages can be computed. If, additionally, the stationary behavior varies smoothly with changes in policy parameters, average-reward control through policy search also becomes a possibility. ,  show that PSRs have a ll-behaved stationary distribution, which is a rational function of policy parameters. Based on this result,  define a related reward process particularly suitable for average reward optimization, and analyze its properties.  show that in such a predictive state reward process, the average reward is a rational function of the policy parameters, whose complexity depends on the dimension of the underlying linear PSR. This result suggests that average reward-based policy search methods can be effective when the dimension of the system is small, even when the system representation in the POMDP framework requires many hidden states.  provide illustrative examples of this type.
['Yuri Grinberg', 'Doina Precup']
I am writing a research paper on a idea Average Reward Optimization Objective In Partially Observable Domains
[{"from": "human", "value": "I am writing a research paper on a idea Average Reward Optimization Objective In Partially Observable Domains"}, {"from": "gpt", "value": "Thats a unique idea.You should consider the following idea to enhance your idea so that it would impact uniquely:  consider the problem of average reward optimization in domains with partial observability, within the modeling framework of linear predictive state representations (PSRs) (Littman et al., 2001). The key to average-reward computation is to have a ll-defined stationary behavior of a system, so the required averages can be computed. If, additionally, the stationary behavior varies smoothly with changes in policy parameters, average-reward control through policy search also becomes a possibility. ,  show that PSRs have a ll-behaved stationary distribution, which is a rational function of policy parameters. Based on this result,  define a related reward process particularly suitable for average reward optimization, and analyze its properties.  show that in such a predictive state reward process, the average reward is a rational function of the policy parameters, whose complexity depends on the dimension of the underlying linear PSR. This result suggests that average reward-based policy search methods can be effective when the dimension of the system is small, even when the system representation in the POMDP framework requires many hidden states.  provide illustrative examples of this type."}]