question generation is all done in java now, but some tokenization still done in python