Yes, you should open windows when using a self-cleaning oven. The fumes from the oven can be harmful if breathed in, so it's important to ventilate the room well.