So by "hanging out," the scrotum keeps sperm a few degrees cooler. Too much heat can lower sperm count (but not enough to act as a form of birth control). So tight clothing and underwear that keep testicles closer to body heat might, in theory, affect sperm count.