Wait until make_thunk to compile convnet lib