Yoshida was born in Nagasaki on August 24, 1988. He joined J1 League club Nagoya Grampus Eight (later "Nagoya Grampus") from their youth team in 2007. he played many matches as center back from first season. The club won the 2nd place in the 2009 Emperor's Cup. In January 2010, he moved to Dutch Eredivisie club VVV-Venlo. He played many matches from the 2010/11 season. In summer 2012, he moved to English Premier League club Southampton. He played 154 matches for the club in 8 seasons. In January 2020, he moved to Italian Serie A club Sampdoria.