I don't like my daughter going everywhere and ?

My family gets mad at me. My daughter is only a week and 4 days, and everyday one of my family members come to see her, and they don't want to leave without her. Now I'm a tough person, I tell them No, but my grandmom said I'm making it seem like I don't want anyone around her. Wtf Yo, Caylee was in the damn NICU because she was freaking premature, and she was so tiny, still is, Hell yeah I don't want everyone around her, because EVERYONE has germs. My mom just said forget it, but its making me mad. I let them comeover everyday and see her, and their ghetto and loud as it is. My support system in my family is great, but why is it that if I don't want my daughter to leave my site, I'm the bad person. But if I curse them out, I'd be immature. If I yell at them I'm immature, and I'm not even immature!