It definitely is safe! Just be sure to follow the recipe exactly, poke holes in the skin first, and always handle a hot potato with oven mitts.