Fundamentally AI and Machine Learning Algorithms are statistical models.  Development of these models require many decisions, approximations, and compromises to meet their desired performance. I will address challenges specific to the development of medical AI decision support that will impact broader adoption of such systems for operational medicine.