Websites like Coinbase give you an online Bitcoin wallet, which is easy to use and fine to get you started. However, they still act as a mediator. So if you're serious about buying and using Bitcoin, you'll want to get your own BTC wallet that you control and sits on an offline USB stick.