Precise estimation of computational physiological model pa- rameters from patient data is one of the main hurdles towards their clinical applicability. Designing robust estimation algorithms is often a tedious and model-specific process. We propose to use, for the first time to our knowledge, artificial intelligence (AI) concepts to learn how to personalize a computational model, inspired by how an expert manually personalizes. We reformulate the parameter estimation problem in terms of Markov decision process and reinforcement learning. In an off-line phase, the artificial agent, called Vito, automatically learns a representa- tive state-action-state model through data-driven exploration of the com- putational model under consideration. In other words, Vito learns how the model behaves under change of parameters and how to personalize it. Vito then controls the on-line personalization by exploiting its automati- cally derived action policy. Because the algorithm is model-independent, personalizing a completely new model would require only adjusting some simple parameters of the agent and defining the observations to match, without the full knowledge of the model itself. Vito was evaluated on two challenging problems: the inverse problem of cardiac electrophysiology and the personalization of a lumped-parameter whole-body circulation model. Obtained results suggested that Vito could achieve equivalent goodness of fit than standard methods, while being more robust (up to 25% higher success rates) and with faster (up to three times) convergence rate. Our AI approach could thus make model personalization algorithms generalizable and self-adaptable to any patient, like a human operator.
['Dominik Neumann', 'Tommaso Mansi', 'Lucian Mihai Itu', 'Bogdan Georgescu', 'Elham Kayvanpour', 'Farbod Sedaghat-Hamedani', 'J. Haas', 'Hugo A. Katus', 'Benjamin Meder', 'Stefan Steidl', 'Joachim Hornegger', 'Dorin Comaniciu']
Vito – A Generic Agent for Multi-physics Model Personalization: Application to Heart Modeling