Cancer and its treatments can significantly impact a man's sperm count. Various types of cancer, especially those affecting the reproductive organs such as testicular and prostate cancer, can directly reduce sperm production. Additionally, the physical and emotional stress associated with a cancer diagnosis can indirectly influence sperm health.