The placenta does not allow everything in the mother's blood to pass to the fetus. I do not know if bilirubin crosses the placenta, and if it does, what level of bilirubin the fetus' blood will reach as a percentage of the mother's bilirubin level. Even though bile duct obstruction may cause jaundice, if your wife never appeared jaundiced, she may not have had any significant elevation of her bilirubin level. As stated above, I know of know evidence that prolonged exposure to low levels of bilirubin starting early in fetal life can cause brain damage. Neither do I know of any evidence that it is not harmful.
Brain damage associated with high bilirubin levels usually causes sensorineural hearing loss.
If your baby has sensorineural hearing loss, that would raise your index of suspicion that bilirubin may have contributed to her problem. The cause of cerebral palsy remains unknown since the exact condition has not been reproduced in animal models. Many children who suffer perinatal asphyxia and other adverse perinatal events do not develop cerebral palsy. Therefore, the most I could say is that it may be possible that maternal jaundice during pregnancy might contribute to an adverse outcome for the baby. I can't stand letting him do this.