Teething 5 month old that doesn't poop well

I have a 5 month old boy who is teething. He has a cow's milk allergy, and has, since birth not been regular with his bowel movements. I am currently breastfeeding him (I only drink goat's milk now) and just 3 days ago started him on homemade organic butternut squash to supplement his feedings. He is a very healthy big baby (about the size of an 8 month old) and otherwise the sweetest baby in the world when not uncomfortable from not pooping or in pain from teething. For teething I have given him Hyland's teething tablets (they stopped being effective), calc phos 6x (I do not feel hit fits this profile, but I was desperate), calc carb 30c (this appears to be the remedy from him, but I did not see any result), and Chamomilla 30x (works a little bit, but not for long).

For his bowel movement issue I was giving him nat phos 6x (that was actually more for the gas issue he used to have) and Nux Vomica 6x. He had an absolutely TERRIBLE reaction to the nux- milk came out his nose, his eyes were watery and he spit up terribly. He also had splotches all over his forehead like a dairy allergic reaction. It was awful. I gave him Chamomilla 30x to bring him out of it along with a warm bath and some essential oils.

All in all I feel I have given him too many remedies. Can anyone assist me in this issue? He comfort nurses almost all night.