Yes, you can. You would need to take it out to remove the wrapper and then put it back in the box. We have actually never done that ourselves, but it is a common way to serve brie or camembert. Neither will be in a very hot oven for long, so this is a great option.