Can you go in the NICU when you're sick?

I'm almost positive you can't since it poses too big of a risk on the babies, but I just want to make sure I'm getting my facts straight.