Been together for 4 years, Should I leave this guy?

I have been with this guy for 4 years now and we have 2 handsome baby boys. he proposed to me at the nicu (babies were premies) at babies bedside. 2 years ago, he didnt have a car, i did, i almost never even drove my car and he did freely, not that it was a problem. 2 years later, i lost my car and now he has one, he always hesitates to allow me to drive and i have to "schedule" days when i need the car and the things scheduled have to be "important". I dont mind staying home withthe kids, but jeez ive been 'sheltered' for over a year now (every since i lost my car i guess freedom left too). Everytime i try to talk to him to let him know how i feel, he says im playiong 'victim' but im juz trying to get him to realize i didnt treat him that way we he was the one without. he leaves home @5:00 a.m to take his mom to work simply bcuz, get this, she doesnt want to drive, but i have to stay home? we;re taking a break from eachother now, me and the kids are not at "our home". he is. we're at my moms house (how f*ckd up is that?).. there is nothing that i want more than my family but god does it feel good to flirt and chat with other single guys now. My current bf doesnt pay me any attention and acts like i dont exist at home, he does not touch me, hug me, nothing. he says that im abbrassive and say mean things and at times i do. i have faults too. what do u think? should i stick in there or say f*ck it?