I Am 6 Months Preggo With Baby Number 3………?

my hubby is concerned that if i sleep on my right side that something bad will happen to our baby. I have a long body pillow that I use and every single night I sleep on my left side all night. But now I have a problem. The problem is between my thigh and hip bone the muscle there hurts. I get up in the middle of the night some nights just to stretch my muscle for some relief. This does not help much. My regular doctor is the one who told me to lay on my left side when I went to her to take a preggo test. At that time I was 7 weeks. Now my OB never mentioned to me to sleep on my left side.
But what my hubby is trying to say is that something harmful will happen to our baby if I dont sleep on my left side. We have 2 other kids and nothing has happend to neither one of them. I slept on my back and both sides throughout my pregnancy with both of them and they are fine. I talked to a on call doctor earlier today and he said that was ok if I switched positions. I told my hubby that the doctor said it was ok to do this. He arguing with me talking about that if something happens to the baby he is holding me responsible and we’re getting a divorce (because I want to change positions and sleep between my left and right side). It’s already hard being preggo and then for ur hubby to tell u something like that brings on more stress. So how can I get him to see that sleeping on either side of my body will not harm the baby in any way? Mind u he was drinking when he said that and watching the Michigan game. I can ask him again what he said when he sobbers up. I told him that he can go to the doctor with me when I go in 2 weeks to ask the doctor himself. He doesn’t want to go. So how else can I convince him that I can sleep on my right side and left side without harming our baby? There is nothing wrong with our other 2 kids. No smart answers please. Thank u in advance for ur help.