Yes, olive oil could ruin your nonstick pan if you heat the oil above its smoke point. As long as you keep your nonstick pan over low heat, however, olive oil usually doesn't cause any significant damage.