You can but your mixture will be more difficult to work with as it will be softer. I prefer a full fat cream cheese.