If you are already registered with your domain with WordPress.com, you don't have to use WordPress.com as your host. Thus the domain you registered is yours, and you can use it with any hosting you want. You can also keep the domain registered with WordPress.com and modify the name servers to point somewhere else.