Charlemagne’s grandfather and father had both effectively become the rulers of the Franks’ Kingdom even if it wasn’t official. However, when Charlemagne was three years old, his father Pepin got rid of his last competitor, and the Carolingians became the ruling dynasty among the Franks.