A serving of peanut butter also has over twice as much saturated fat as a serving of almond butter. While saturated fat isn't necessarily harmful in moderation, too much of it can raise your cholesterol, which can increase your risk of cardiovascular disease.