Changes in sexual desire swelling in the testicles or problems with erection are the common symptoms of male infertility. But there are some uncommon signs of male infertility every man should be aware of. Did you know recurrent respiratory infection could be a sign of infertility in men? Dr Rajalaxmi Walavalkar Consultant Reproductive Medicine and Surgery Cocoon Fertility India explains the three common symptoms of male infertility. Very small testicles: It is a primary sign of Klinefelter's syndrome where the testis are too small to produce either the male hormone testosterone or sperm. This happens in 1 in 600 people.