In c. 1302 before his father's death, Harvey accompanied him during the Franco-Flemish War. After Harvey V's death, he is said to have taken part to the Battle of Mons-en-Pévèle, which Philip IV of France won with difficulty. He fought the Flemish again under Philip V in 1318 and Philip VI in 1328.