mpi/predict: Add ignored --per-rank-times argument
mpi: Add funneled mode

In funneled mode, the communication thread polls alternatively on
MPI_Testsome and a spinlocked list of callbacks.  The worker threads
add callbacks to the list rather than touching MPI, allowing the use
of MPI_THREAD_FUNNELED.