Low Normal Testosterone in 45 yr old, fatigued, Low sex drive- Herbs to help??

So glad I found this website! My husband has been seeing an Encronologist, he is close to being Hypothyroid, one test levels was 4.53, a week later they were 2.49 (well within normal range), so she said he does not have a Thyroid problem. He is thin, weights 150 lbs, He has a loss of Sex drive & being fatigues, he has been stressed at work also. His testosterone #'s have been 344, 326, 503, and 223 (normal being 250-1100), and his Testosterone Free #'s were also LOW normal. He can not get any kind of Testosterone Therapy Treatment, Encron says NOTHING can naturarally raise Testosterone levels, she said NOT to take any herbs. Expects us to wait until a few years when his levels drop to below 250, then she can help us. I have started him on TongKat ali extract 50:1 (3 x day), I also have him taking Horney Goat Weed (2 x day) L-arginine 3 grams. And some other supplements. But would like to know what YOU suggest to help him, as we can not get any help from any Doctors at all. I do not want to give him things that will hurt in the long run, he has Diabetes in his family so concerend about that creeping up in the near future. Thank you .