As they travel, Rory sees that it can be dangerous to be on the TARDIS. He gets to the point in his travels that he tells the Doctor he does not want to travel any more if they are going to always be as risk.