No, you should not preheat oven empty because it is not the safe option for you. You have to place the dish whichever you are cooking or baking inside the oven in a preheat mode as well.