The First Men's history before they reached Westeros is lost in time, as they had no recording system. They only gave their history through songs and stories, many of which got lost.