Google: Add new-born child to Visa
You should send form 1022 and a birth certificate to your CO. S/he will add your baby to the application and tell you what documents to apply for and upload. You baby will have to complete medicals as well, but it is a very simple examination for newborns.