The critical difference between ponies and horses is height. Standard horses are usually over 14.2 hands high, while anything below that is considered a pony.