Like many other items, it's possible that Leavening Agent could drop as loot from slain NPCs. However, it's an incredibly impractical farming method, and thus I would advise either foraging for Leavening Agent or farming it in your base.