 But in either case the battle started at the walls of Hougoumont, and by many accounts was lost there, as the farm, although nearly destroyed, never fell. Willington observed after the battle that the success of the battle turned upon the closing of the gates at Hougoumont. The French commander whose division was to take the farm was Jerome Bonaparte, Napoleon's youngest brother.