Should I go ahead with varicocelectomy to improve my sperm count?

Hi doctor,

I have been diagnosed with bilateral varicocele grade II and III. My urologist recommended microscopic varicocelectomy after reviewing my test results. I am 32 years old and all of my blood test results, including hormones were in the normal range. However, my semen analysis showed that there are approximately 34 million sperms and out of which 60% are of good motility that is approximately 20 million. My semen analysis from 6 years ago was nearly 90 million sperm count with 60% motility. I understand that my current sperm count is at the bottom of the normal range. Me and my wife are not planning to have kids for the next one or two years and have not tried yet. My doctor recommends the surgery because there is going to be some improvement in the sperm count if he performs the procedure. I prefer to avoid the surgery if not necessary. I have a few questions. Is the sperm count going to be significantly different three years from now after performing the procedure? Is there a downside with leaving a permanent suture in my body for the rest of my life? What happens to the permanent sutures if the veins shrink or get absorbed by the body? I am not comfortable with leaving an external object (silk in my case) in my body for the rest of my life, especially if it causes problems in the future and I have to remove it later on. I am a highly active person and play soccer and go to the gym regularly. I am not sure how experienced the doctor should be for this procedure. My doctor is relatively young and obviously less experienced. Please help.