You can, but the texture won’t be as crisp. Baking is what gives caramel corn its signature crunch by hardening the caramel, so skipping this step will leave you with softer, stickier popcorn.