Yes, you can! Cutting back on the sugar won't mess up this bread recipe. Be aware though, that the sugar not only brings the sweetness, it plays a key role in getting that moist and perfect texture. So if you cut it down too much, the texture may suffer as well as the taste.