Yes, you can totally remove the crystal sweetener but the bread won't be very sweet. The dates themself are not enough to sweeten the crumb.