Yes, totally, and 100%. Once your website or design work has been signed off by yourself the website, content, and graphics ownership will all be handed over to you.
Please note: This doesn’t include any of the open-source WordPress CMS, Plugins, or Stock Photography used to create your website, as they’re owned by third parties but with free-to-use licenses, but the actual design and content will be 100% yours.