HAMs-family Based Method for Hierarchical Decomposition
This paper introduces the concept of "policy-coupled" semi-Markov decision processes(SMDPs) into HAMs.It defines the concept of HAM-decomposable and makes the relations among the HAM machine,HAM-decomposable,and "policy-coupled" SMDPs clear.It also proves that HAMs is suitable for solving the "policy-coupled" SMDPs problem.Based on these,this paper gives a method for hierarchical decomposition on a class of "policy-coupled" SMDPs with a DAG call graph and presents a precondition that can be used for determining whether or not can generate a valid hierarchical decomposition.Lastly,a typical experiment is tested for illustrating the characteristics of this method.