Don't Feed Babies A Ton Of Rice Cereal, Says FDA Beth Skwarecki Apr 18, 2016, 4:00am 1 Rice cereal is a popular first food for babies. It's also kind of high in arsenic, according to the US Food and Drug Administration, so if your kid gets a steady rice cereal diet, it's time to diversify.