Registering a new horse at a stable will cost you 20 rupees. From there, boarding and withdrawing that horse is free. You can register up to 10 horses after earning all the pony point rewards.