A lack of sleep affects a variety of hormones and chemicals in your body. This, in turn, can have a harmful impact on your testosterone. Make sleep a priority, aiming for 7 to 8 hours per night, even if it means rearranging your schedule or dropping your habit of late-night TV. Prize your sleep, just like you'd prize a healthy diet and active lifestyle. It's that important.