About one baby in 5,000 is born with one or two teeth already present In the mouth Julius Caesar and Napoleon, for example, are both reputed to have had this distinction. It sometimes runs in families. These teeth are not fully formed and will fall out; occasionally, however, they present a danger of choking the baby, and so it is better to have them removed. The teeth will develop normally later on.