This is a pun on the word stripes. People of many stripes can mean a diverse group of people, or people who wear clothing with many stripes on them. Referees wear shirts with stripes on them.
Sports are refereed by people of many stripes .