multithread on development set
leaving-one out (if there is no separated developement set)