There are 2 types of letter h:
Mute h (or silent h): h muet in French
Aspirated h: h aspiré in French
The mute his found in words that often come from Latin whereas the aspirated h is found in French words that have Germanic roots, the Franks, as explained in this book.