Webcams typically turn themselves off when not in use. If you are still nervous, you can always guarantee the webcam is turned off by removing it from the USB port or deleting its files from your system settings. It’s a tad overkill, but it can be done.
If you’re worried about someone peeking along, you can actually buy a webcam cover, which you place in front of the camera.