Coffee cake can taste bitter if it has been overbaked. Be sure to set a timer and watch your coffee cake as it bakes. If the top is golden brown, but the center isn't set, lower the oven temperature and continue baking until a toothpick inserted into the center comes out clean.