If they were diplomats, then no, the baby would not be American. So, if the pregnant F2 visa holder enters the US AND THEN GIVES BIRTH in the US, then yes, the baby is American. That doesn't mean that the family can stay in the US, though. Only the baby has the right to live in the US, not the parents.