Horses originated from the United States and other countries in North America more than 50 million years ago. However, they went extinct on the continent about 10,000 years ago.