Harriet Harman and Foreign Secretary David Miliband said they were not preparing leadership bids .
Despite growing speculation over Brown 's future , most of his ministers wanted him to lead the party .
Harriet Harman and Foreign Secretary David Miliband said most were not preparing leadership bids .
Despite growing speculation over Brown 's future , most of his ministers wanted him to lead the party .