Before revision:   To answer the question "What would a human operator like to ask the ML model?" we propose a conversational system explaining decisions of the predictive model.
After revision:  The analysis of needs, if done, takes the form of an A/B test rather than a study of open questions. To answer the question "What would a human operator like to ask the ML model?" we propose a conversational system explaining decisions of the predictive model.