Update hmm_util.c

mod forward_prob with int h