Babies represent innocense and purity just as white is a symbol of purity. Baptism clothing has traditionally been white to honor the Holy Spirit and God.