The Grimgar novels say that Haru ends up with Mary, but he falls in love with Yume in the anime.