Patterson did n't fight several top challengers .
Patterson did n't actually hurt boxing overall as its Heavyweight Champion fought infrequently .
Patterson did n't fight several top challengers and actually hurt boxing overall as its Heavyweight Champion fought infrequently .