Track and field has contributed 323 of the USA 's golds .
Swimming has 246 in the all - time medal count .
Track and field has contributed 323 of the USA 's golds , while swimming has 246 in the all - time medal count .