He was the Ambassador to England in 1936. By 1939 he had fallen out of favor with the government. He was against the military expansion Japan was engaged in at the time. All he felt he could do was retire. He was later imprisoned for these same views. When General Douglas MacArthur became the military governor of Japan, Yoshida was called to Tokyo to become the new foreign minister.