You first should remove your furnace's front cover panel. This should reveal the pilot, a tiny solitary burner resembling a candle or a single flame on a gas stove. If you don't see any flame or fire, your oven pilot light is out.