WooCommerce is indeed a WordPress plugin. You can start for free, but to ensure the smooth operation of your store, you need to buy a domain, hosting, SSL certificate, and premium themes and plugins.