How do i handle this?

I live with ny boyfriend of 3 years now in our apt and were on the second floor. I have 2 dogs one iv had since before we started dating and the other I got shortly after we moved into the apt. They are potty trained if you take them outside they'll stand by the door and I take them out but it I'm not home boyfriend refuses to take them out the yells at me when they use the bathroom in the house and I told him hes going to have to help me and taoe them out when I'm not home. And he says " their not my damn responsibility and I'm not going to take then out". And so I can't help if it be won't take them out when I'm not home. I would leave them outside but there isn't a fenced in area at the apartments. When we fight he always says he wants them gone and he knows they mean the world to me but he doesn't care he's so jealous of them.