 The IOC, as it's known, the International Olympic Committee, holds all the power when it comes to staging the games or not. Inside of the host city contract, it said very clearly that it was the IOC that had the power to cancel the Olympics instead of locals.