It will not be a total disaster but it will different: not as creamy with a salty roasted flavor. If that works for the recipe go ahead. But it probably will not enhance most baked goods.