Yes! it's perfectly safe to bake the Boursin cheese, even though it's usually served cold.