Yes, it's important to remove the stinger as quickly as possible to minimize the amount of venom injected. Scrape it out sideways using something with a firm edge, like a credit card, rather than tweezers, which can squeeze more venom into the skin.